Visual interpretation of CNN decision-making process using Simulated Brain MRI - Archive ouverte HAL
Communication Dans Un Congrès Année : 2021

Visual interpretation of CNN decision-making process using Simulated Brain MRI

Résumé

Convolutional neural networks (CNNs) are being extensively used to analyze medical images given the remarkable performances achieved so far. Due to the non-transparent decision-making process, CNNs are thought to be black boxes, so hindering their applicability. We submit a novel visualization technique to shed light on CNNs decisions in a classification task. Brain magnetic resonance images are fed as input to an original 3D CNN to allow discrimination of normal against modified brain data. This modification targets specific brain regions by linearly increasing their intensity, and involves regions with very different features in dimension, position, and enclosed tissues. The proposed visualization method merges all convolutional layers output in order to highlight where the model is “looking” during the decision-making process. Our visualizations allow to recover the same areas modified in the images, thus proving they are relevant to the prediction as expected. Comparing results from models with different accuracy, show that even in the case of low performance the expected regions are present in the activation maps leading the way to ameliorations of the CNN architecture.
Fichier non déposé

Dates et versions

hal-04037117 , version 1 (20-03-2023)

Identifiants

Citer

Edouard Villain, Giulia Maria Mattia, Federico Nemmi, Patrice Peran, Xavier Franceries, et al.. Visual interpretation of CNN decision-making process using Simulated Brain MRI. 34th IEEE International Symposium on Computer-Based Medical Systems (CBMS 2021), Jun 2021, Aveiro, Portugal. pp.515-520, ⟨10.1109/CBMS52027.2021.00102⟩. ⟨hal-04037117⟩
46 Consultations
0 Téléchargements

Altmetric

Partager

More