Regularization, Semi-supervision, and Supervision for a Plausible Attention-Based Explanation - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Regularization, Semi-supervision, and Supervision for a Plausible Attention-Based Explanation

Résumé

Attention mechanism is contributing to the majority of recent advances in machine learning for natural language processing. Additionally, it results in an attention map that shows the proportional influence of each input in its decision. Empirical studies postulate that attention maps can be provided as an explanation for model output. However, it is still questionable to ask whether this explanation helps regular people to understand and accept the model output (the plausibility of the explanation). Recent studies show that attention weights in RNN encoders are hardly plausible because they spread on input tokens. We thus propose three additional constraints to the learning objective function to improve the plausibility of the attention map: regularization to increase the attention weight sparsity, semi-supervision to supervise the map by a heuristic and supervision by human annotation. Results show that all techniques can improve the attention map plausibility at some level. We also observe that specific instructions for human annotation might have a negative effect on classification performance. Beyond the attention map, results on text classification tasks also show that the contextualization layer plays a crucial role in finding the right space for finding plausible tokens, no matter how constraints bring the gain.
Fichier principal
Vignette du fichier
Paper_63.pdf (2.19 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04132646 , version 1 (19-06-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04132646 , version 1

Citer

Duc Hau Nguyen, Cyrielle Mallart, Guillaume Gravier, Pascale Sébillot. Regularization, Semi-supervision, and Supervision for a Plausible Attention-Based Explanation. NLDB 2023 - 28th International Conference on Natural Language and Information Systems, Jun 2023, Derby, United Kingdom. pp.1-14. ⟨hal-04132646⟩
40 Consultations
42 Téléchargements

Partager

Gmail Facebook X LinkedIn More