A quantitative approach for the comparison of additive local explanation methods - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Information Systems Année : 2023

A quantitative approach for the comparison of additive local explanation methods

Une approche quantitative pour la comparaison des méthodes d'explications locales additives

Résumé

Local additive explanation methods are increasingly used to understand the predictions of complex Machine Learning (ML) models. The most used additive methods, SHAP and LIME, suffer from limitations that are rarely measured in the literature. This paper aims to measure these limitations on a wide range (304) of OpenML datasets using six quantitative metrics, and also evaluate emergent coalitional-based methods to tackle the weaknesses of other methods. We illustrate and validate results on a specific medical dataset, SA-Heart. Our findings reveal that LIME and SHAP's approximations are particularly efficient in high dimension and generate intelligible global explanations, but they suffer from a lack of precision regarding local explanations and possibly unwanted behavior when changing the method's parameters. Coalitional-based methods are computationally expensive in high dimension, but offer higher quality local explanations. Finally, we present a roadmap summarizing our work by pointing out the most appropriate method depending on dataset dimensionality and user's objectives.
Fichier principal
Vignette du fichier
Extension_DOLAP_2022___Benchmark_Explicabilité.pdf (3.51 Mo) Télécharger le fichier

Dates et versions

hal-04239122 , version 1 (13-10-2023)

Identifiants

Citer

Emmanuel Doumard, Julien Aligon, Elodie Escriva, Jean-Baptiste Excoffier, Paul Monsarrat, et al.. A quantitative approach for the comparison of additive local explanation methods. Information Systems, 2023, 114 (Special issue on DOLAP 2022: Design, Optimization, Languages and Analytical Processing of Big Data), pp.102162. ⟨10.1016/j.is.2022.102162⟩. ⟨hal-04239122⟩
52 Consultations
33 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More