Explaining an image classifier with a generative model conditioned by uncertainty - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Explaining an image classifier with a generative model conditioned by uncertainty

Résumé

Identifying sources of uncertainty in an image classifier is a crucial challenge. Indeed, the decision process of those models is opaque and does not necessarily correspond to what we might expect. To help characterize classifiers, generative models can be used as they allow the control of visual attributes. Here we use a generative adversarial network to generate images corresponding to how a classifier sees the image. More specifically, we consider the classifier maximum softmax probability as an uncertainty estimation and use it as an additional input to condition the generative model. This allows us to generate images that result in uncertain predictions, giving us a global view of which images are harder to classify. We can also increase the uncertainty of a given image and observe the impact of an attribute, providing a more local understanding of the decision process. We perform experiments on the MNIST dataset, augmented with corruptions. We believe that generative models are a helpful tool to explain the behavior and uncertainties of image classifiers
Fichier principal
Vignette du fichier
main.pdf (858.52 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04194943 , version 1 (11-11-2023)
hal-04194943 , version 2 (02-10-2024)

Identifiants

  • HAL Id : hal-04194943 , version 2

Citer

Adrien Le Coz, Stéphane Herbin, Faouzi Adjed. Explaining an image classifier with a generative model conditioned by uncertainty. Workshop Uncertainty meets Explainability, ECML-PKDD 2023, Sep 2023, Torino, Italy. ⟨hal-04194943v2⟩
267 Consultations
219 Téléchargements

Partager

More