Large Scale Experimentation on Anomaly Detection Scalability and Performance - Archive ouverte HAL
Communication Dans Un Congrès Année : 2018

Large Scale Experimentation on Anomaly Detection Scalability and Performance

Résumé

This paper presents a study of various standard anomalies detection techniques in internet networks, using machine learning algorithms, classification algorithms, and graph techniques working on SQL/Mapreduce and SQL-Graph implementation platforms. This approach shows its efficiency for the study of large datasets. Firstly, several algorithmic approaches and possible implementations have been studied and tested by experiment to see how the SQL-MapReduce and SQL-Graph implementation can process large-scale data. Secondly the performance and scalability of the algorithms for large volumes of data have been compared to choose the most appropriate for typical anomaly detection. The application scope is very broad, such as spam detection, crime detection, mafia or terrorism community detection, network intrusion detection, malignant tumors detection in healthcare, fraud detection on banking transactions, identity theft detection etc. The main problem we will address on this paper is the processing performance on large scale data using an implementation of Massively Parallel Processing (MPP), SQL-MapReduce, and SQl-Graph.
Fichier principal
Vignette du fichier
ICA3272 2018 - Large Scale Experimentation on Anomaly Detection Scalability and Performance (FINAL).pdf (993.05 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02022807 , version 1 (25-06-2021)

Identifiants

  • HAL Id : hal-02022807 , version 1

Citer

Yaya Sylla, Pierre Morizet-Mahoudeaux, Stephen Brobst. Large Scale Experimentation on Anomaly Detection Scalability and Performance. 20th International Conference on Artificial Intelligence (ICAI 2018), Jul 2018, Las Vegas, United States. pp.36-43. ⟨hal-02022807⟩
136 Consultations
65 Téléchargements

Partager

More