Learning from multi-label data with interactivity constraints: an extensive experimental study - Archive ouverte HAL Access content directly
Journal Articles Expert Systems with Applications Year : 2015

Learning from multi-label data with interactivity constraints: an extensive experimental study

Abstract

Interactive classification aims at introducing user preferences in the learning process to produce individualized outcomes more adapted to each user’s behaviour than the fully automatic approaches. The current interactive classification systems generally adopt a singlelabel classification paradigm that constrains items to span one label at a time and consequently limit the user’s expressiveness while he/she interacts with data that are inherently multi-label. Moreover, the experimental evaluations are mainly subjective and closely depend on the targeted use cases and the interface characteristics. This paper presents the first extensive study of the impact of the interactivity constraints on the performances of a large set of twelve well-established multi-label learning methods. We restrict ourselves to the evaluation of the classifier predictive and time-computation performances while the number of training examples regularly increases and we focus on the beginning of the classification task where few examples are available. The classifier performances are evaluated with an experimental protocol independent of any implementation environment on a set of twelve multi-label benchmarks of various sizes from different domains. Our comparison shows that four classifiers can be distinguished for the prediction quality: RF-PCT (Random Forest of Predictive Clustering Trees, Kocev (2012)), EBR (Ensemble of Binary Relevance, (Read et al., 2011)), CLR (Calibrated Label Ranking, Fürnkranz et al. (2008)) and MLkNN (Multi-label kNN, Zhang and Zhou (2007)) with an advantage for the first two ensemble classifiers. Moreover, only RF-PCT competes with the fastest classifiers and is therefore considered as the most promising classifier for an interactive multi-label learning system.
Fichier principal
Vignette du fichier
paper_review.pdf (773.17 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01131396 , version 1 (13-03-2015)

Identifiers

Cite

Noureddine-Yassine Nair-Benrekia, Pascale Kuntz, Frank Meyer. Learning from multi-label data with interactivity constraints: an extensive experimental study. Expert Systems with Applications, 2015, 42 (13), pp.5723 - 5736. ⟨10.1016/j.eswa.2015.03.006⟩. ⟨hal-01131396⟩
326 View
491 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More