An Empirical Comparison of Supervised Ensemble Learning Approaches - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2013

An Empirical Comparison of Supervised Ensemble Learning Approaches

Haytham Elghazel
Alex Aussem

Résumé

We present an extensive empirical comparison between twenty prototypical supervised ensemble learning algorithms, including Boosting, Bagging, Random Forests, Rotation Forests, Arc-X4, Class-Switching and their variants, as well as more recent techniques like Random Patches. These algorithms were compared against each other in terms of threshold, ranking/ordering and probability metrics over nineteen UCI benchmark datasets with binary labels. We also examine the influence of two base learners, CART and Extremely Randomized Trees, and the effect of calibrating the models via Isotonic Regression on each performance metric. The selected datasets were already used in various empirical studies and cover different application domains. The experimental analysis was restricted to the hundred most relevant features according to the SNR filter method with a view to dramatically reducing the computational burden involved by the simulation. The source code and the detailed results of our study are publicly available.
Fichier non déposé

Dates et versions

hal-01339258 , version 1 (29-06-2016)

Identifiants

  • HAL Id : hal-01339258 , version 1

Citer

Mohamed Bibimoune, Haytham Elghazel, Alex Aussem. An Empirical Comparison of Supervised Ensemble Learning Approaches. International Workshop on Complex Machine Learning Problems with Ensemble Methods COPEM@ECML/PKDD'13, Sep 2013, Prague, Czech Republic. pp.123-138. ⟨hal-01339258⟩
112 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More