Data-driven evaluation of intrusion detectors: a methodological framework - Archive ouverte HAL Access content directly
Conference Papers Year : 2023

Data-driven evaluation of intrusion detectors: a methodological framework


Intrusion detection systems are an important domain in cybersecurity research. Countless solutions have been proposed, continuously improving upon one another. Yet, and despite the introduction of distinct approaches, including machine-learning methods, the evaluation methodology has barely evolved. In this paper, we design a comprehensive evaluation framework for Machine Learning (ML)-based intrusion detection systems (IDS) and take into account the unique aspects of ML algorithms, their strengths and weaknesses. The framework design is inspired by both i) traditional IDS evaluation methods and ii) recommendations for evaluating ML algorithms in diverse application areas. Data quality being the key to machine learning, we focus on data-driven evaluation by exploring data-related issues. Our approach goes beyond evaluating intrusion detection performance (also known as effectiveness) and aims at proposing standard data manipulation methods to tackle robustness and stability. Finally, we evaluate our framework through a qualitative comparison with other IDS evaluation approaches from the state of the art.
Fichier principal
Vignette du fichier
Data_driven_evaluation_of_intrusion_detectors___a_taxonomy___FPS2022.pdf (399.72 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-04055085 , version 1 (15-05-2023)



Solayman Ayoubi, Gregory Blanc, Houda Jmila, Thomas Silverston, Sébastien Tixeuil. Data-driven evaluation of intrusion detectors: a methodological framework. FPS 2022 - 15th International Symposium on Foundations & Practice of Security, Dec 2022, Ottawa, ON, Canada. pp.142-157, ⟨10.1007/978-3-031-30122-3_9⟩. ⟨hal-04055085⟩
63 View
28 Download



Gmail Facebook X LinkedIn More