Studying and Exploiting the Relationship Between Model Accuracy and Explanation Quality - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Studying and Exploiting the Relationship Between Model Accuracy and Explanation Quality

Résumé

Many explanation methods have been proposed to reveal insights about the internal procedures of black-box models like deep neural networks. Although these methods are able to generate explanations for individual predictions, little research has been conducted to investigate the relationship of model accuracy and explanation quality, or how to use explanations to improve model performance. In this paper, we evaluate explanations using a metric based on area under the ROC curve (AUC), treating expert-provided image annotations as ground-truth explanations, and quantify the correlation between model accuracy and explanation quality when performing image classifications with deep neural networks. The experiments are conducted using two image datasets: the CUB-200-2011 dataset and a Kahikatea dataset that we publish with this paper. For each dataset, we compare and evaluate seven different neural networks with four different explainers in terms of both accuracy and explanation quality. We also investigate how explanation quality evolves as loss metrics change through the training iterations of each model. The experiments suggest a strong correlation between model accuracy and explanation quality. Based on this observation, we demonstrate how explanations can be exploited to benefit the model selection process—even if simply maximising accuracy on test data is the primary goal.

Dates et versions

hal-04468425 , version 1 (20-02-2024)

Identifiants

Citer

Yunzhe Jia, Eibe Frank, Bernhard Pfahringer, Albert Bifet, Nick Jin Sean Lim. Studying and Exploiting the Relationship Between Model Accuracy and Explanation Quality. Machine Learning and Knowledge Discovery in Databases. Research Track - European Conference, ECML PKDD 2021, Bilbao, Spain, September 13-17, 2021, Proceedings, Part II, Sep 2021, Bilbao, Spain. pp.699--714, ⟨10.1007/978-3-030-86520-7_43⟩. ⟨hal-04468425⟩
6 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More