H²O: Heatmap by Hierarchical Occlusion - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

H²O: Heatmap by Hierarchical Occlusion

Romain Bourqui
  • Fonction : Auteur
  • PersonId : 1078969

Résumé

The rise of Deep Learning (DL) has led to a breakthrough in the research field of content-based multimedia indexing. Newly de- veloped systems based on complex models outperform classic ma- chine learning algorithms in object detection, image segmentation or classification tasks. However, despite their high performance, these systems still make mistakes. To be used in industrial condi- tions, these systems must be able to provide trustworthy decisions with guarantees or justifications. Therefore, it is crucial to provide means to analyze and comprehend the decision process that leads a model to its decision. Image classification implies tracking and understanding which input features the model relies on to make its prediction. This paper focuses on features attribution techniques and proposes Heatmaps by Hierarchical Occlusion (H²O), a novel method for detecting pattern-relevant features in an image. We also propose two new pairs of metrics that overcome some evaluation issues: (a) Insertion and Deletion Spearman correlation coefficients which both estimate a correlation between the computed scores in a saliency map and the importance for the model of the associated pixels in the image. (b) Insertion Positive and Deletion Negative Gradient Sums both estimate the coherence of the scores in the saliency maps. Both visual inspection and evaluation on 7 metrics show that H²O is competitive against state-of-the-art methods.
Fichier principal
Vignette du fichier
H2O_CBMI_2023.pdf (8.05 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04212098 , version 1 (20-09-2023)

Identifiants

  • HAL Id : hal-04212098 , version 1

Citer

Luc-Etienne Pommé, Romain Bourqui, Romain Giot. H²O: Heatmap by Hierarchical Occlusion. CBMI 2023, Sep 2023, Orléans, France. ⟨hal-04212098⟩

Collections

CNRS
21 Consultations
18 Téléchargements

Partager

Gmail Facebook X LinkedIn More