MMD-based Variable Importance for Distributional Random Forest - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS) Année : 2024

MMD-based Variable Importance for Distributional Random Forest

Résumé

Distributional Random Forest (DRF) is a flexible forest-based method to estimate the full conditional distribution of a multivariate output of interest given input variables. In this article, we introduce a variable importance algorithm for DRFs, based on the well-established drop and relearn principle and MMD distance. While traditional importance measures only detect variables with an influence on the output mean, our algorithm detects variables impacting the output distribution more generally. We show that the introduced importance measure is consistent, exhibits high empirical performance on both real and simulated data, and outperforms competitors. In particular, our algorithm is highly efficient to select variables through recursive feature elimination, and can therefore provide small sets of variables to build accurate estimates of condi- tional output distributions.
Fichier principal
Vignette du fichier
arXiv.pdf (1.33 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04251588 , version 1 (20-10-2023)

Identifiants

  • HAL Id : hal-04251588 , version 1

Citer

Clément Bénard, Jeffrey Naf, Julie Josse. MMD-based Variable Importance for Distributional Random Forest. Proceedings of The 27th International Conference on Artificial Intelligence and Statistics (AISTATS), In press. ⟨hal-04251588⟩
83 Consultations
86 Téléchargements

Partager

Gmail Facebook X LinkedIn More