Unsupervised discovery of Interpretable Visual Concepts - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Information Sciences Année : 2024

Unsupervised discovery of Interpretable Visual Concepts

Résumé

Providing interpretability of deep-learning models to non-experts, while fundamental for a responsible real-world usage, is challenging. Attribution maps from xAI techniques, such as Integrated Gradients, are a typical example of a visualization technique containing a high level of information, but with difficult interpretation. In this paper, we propose two methods, Maximum Activation Groups Extraction (MAGE) and Multiscale Interpretable Visualization (Ms-IV), to explain the model’s decision, enhancing global interpretability. MAGE finds, for a given CNN, combinations of features which, globally, form a semantic meaning, that we call concepts. We group these similar feature patterns by clustering in “concepts”, that we visualize through Ms-IV. This last method is inspired by Occlusion and Sensitivity analysis (incorporating causality), and uses a novel metric, called Class-aware Order Correlation (CaOC), to globally evaluate the most important image regions according to the model’s decision space. We compare our approach to xAI methods such as LIME and Integrated Gradients. Experimental results evince the Ms-IV higher localization and faithfulness values. Finally, qualitative evaluation of combined MAGE and Ms-IV demonstrates humans’ ability to agree, based on the visualization, with the decision of clusters’ concepts; and, to detect, among a given set of networks, the existence of bias.
Fichier principal
Vignette du fichier
main.pdf (9.61 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04190721 , version 1 (29-08-2023)
hal-04190721 , version 2 (13-10-2023)
hal-04190721 , version 3 (20-11-2023)

Identifiants

Citer

Caroline Mazini Rodrigues, Nicolas Boutry, Laurent Najman. Unsupervised discovery of Interpretable Visual Concepts. Information Sciences, 2024, 661, pp.120159. ⟨10.1016/j.ins.2024.120159⟩. ⟨hal-04190721v3⟩
133 Consultations
50 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More