Do we need rebalancing strategies? A theoretical and empirical study around SMOTE and its variants - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2024

Do we need rebalancing strategies? A theoretical and empirical study around SMOTE and its variants

Résumé

Synthetic Minority Oversampling Technique (SMOTE) is a common rebalancing strategy for handling imbalanced tabular data sets. However, few works analyze SMOTE theoretically. In this paper, we prove that SMOTE (with default parameter) tends to copy the original minority samples asymptotically. We also prove that SMOTE exhibits boundary artifacts, thus justifying existing SMOTE variants. Then we introduce two new SMOTE-related strategies, and compare them with state-of-the-art rebalancing procedures. Surprisingly, for most data sets, we observe that applying no rebalancing strategy is competitive in terms of predictive performances, with tuned random forests, logistic regression or LightGBM. For highly imbalanced data sets, our new methods, named CV-SMOTE and Multivariate Gaussian SMOTE, are competitive. Besides, our analysis sheds some lights on the behavior of common rebalancing strategies, when used in conjunction with random forests.
Fichier principal
Vignette du fichier
main.pdf (533.8 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04438941 , version 1 (05-02-2024)
hal-04438941 , version 2 (21-05-2024)
hal-04438941 , version 3 (22-05-2024)
hal-04438941 , version 4 (31-05-2024)
hal-04438941 , version 5 (10-10-2024)

Identifiants

Citer

Abdoulaye Sakho, Emmanuel Malherbe, Erwan Scornet. Do we need rebalancing strategies? A theoretical and empirical study around SMOTE and its variants. 2024. ⟨hal-04438941v5⟩
158 Consultations
103 Téléchargements

Altmetric

Partager

More