A New Metric for Measuring the Intrinsic Quality in Data Collected for Quantitative Classification - Archive ouverte HAL
Article Dans Une Revue Lecture Notes in Artificial Intelligence Année : 2025

A New Metric for Measuring the Intrinsic Quality in Data Collected for Quantitative Classification

Résumé

Learning an optimal classification model intrinsically depends on data quality. Despite many efforts for its characterization, existing methods have often limited quality measures to specific criteria, leading to the lack of comprehensive definitions and rigorous formulations. Indeed, its evaluation is related to the context and often requires external elements, which implies a process that is long and prone to errors. Therefore, there is still a strong need for solutions that enable effective data quality assessment. This paper addresses the resulting scientific challenges and introduces a new metric, specifically designed for numerical classification problems. Unlike existing measures, the proposed solution is based on the correlated evolution between classification performance and data deterioration. Therefore, it offers three main advantages: Being model independent, not requiring the use of external reference data while offering a solution that is easy to adapt for several real-world scenarios. Additionally, we provide a comprehensive interpretation of the quality scores and illustrate the main evaluation levels with use cases. We demonstrate its effectiveness through extensive experiments and comparisons with the state of the art.
Fichier sous embargo
Fichier sous embargo
0 1 12
Année Mois Jours
Avant la publication
jeudi 2 janvier 2025
Fichier sous embargo
jeudi 2 janvier 2025
Connectez-vous pour demander l'accès au fichier

Dates et versions

hal-04735348 , version 1 (14-10-2024)

Identifiants

  • HAL Id : hal-04735348 , version 1

Citer

Roxane Jouseau, Sébastien Salva, C. Samir. A New Metric for Measuring the Intrinsic Quality in Data Collected for Quantitative Classification. Lecture Notes in Artificial Intelligence, In press, 2. ⟨hal-04735348⟩
9 Consultations
1 Téléchargements

Partager

More