EXAD: A System for Explainable Anomaly Detection on Big Data Traces - Archive ouverte HAL Access content directly
Conference Papers Year :

EXAD: A System for Explainable Anomaly Detection on Big Data Traces

(1) , (2) , (1) , (3) , (4, 5)
1
2
3
4
5
Fei Song
  • Function : Author
  • PersonId : 1041225
Arnaud Stiegler
  • Function : Author
  • PersonId : 1052218
Jesse Read
  • Function : Author
  • PersonId : 751910
  • IdHAL : jesse-read

Abstract

Big Data systems are producing huge amounts of data in real-time. Finding anomalies in these systems is becoming increasingly important, since it can help to reduce the number of failures, and improve the mean time of recovery. In this work, we present EXAD, a new prototype system for explainable anomaly detection, in particular for detecting and explaining anomalies in time-series data obtained from traces of Apache Spark jobs. Apache Spark has become the most popular software tool for processing Big Data. The new system contains the most well-known approaches to anomaly detection, and a novel generator of artificial traces, that can help the user to understand the different performances of the different methodologies. In this demo, we will show how this new framework works, and how users can benefit of detecting anomalies in an efficient and fast way when dealing with traces of jobs of Big Data systems.
Fichier principal
Vignette du fichier
exad_icdm2018.pdf (1.09 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-02264598 , version 1 (07-08-2019)

Identifiers

  • HAL Id : hal-02264598 , version 1

Cite

Fei Song, Arnaud Stiegler, Yanlei Diao, Jesse Read, Albert Bifet. EXAD: A System for Explainable Anomaly Detection on Big Data Traces. ICDMW 2018 - IEEE International Conference on Data Mining Workshops, Nov 2018, Singapore, Singapore. ⟨hal-02264598⟩
262 View
314 Download

Share

Gmail Facebook Twitter LinkedIn More