Exploiting Label Dependencies for Multi-Label Document Classification Using Transformers - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Exploiting Label Dependencies for Multi-Label Document Classification Using Transformers

Résumé

We introduce in this paper a new approach to improve deep learningbased architectures for multi-label document classification. Dependencies between labels are an essential factor in the multi-label context. Our proposed strategy takes advantage of the knowledge extracted from label co-occurrences. The proposed method consists in adding a regularization term to the loss function used for training the model, in a way that incorporates the label similarities given by the label co-occurrences to encourage the model to jointly predict labels that are likely to co-occur, and and not consider labels that are rarely present with each other. This allows the neural model to better capture label dependencies. Our approach was evaluated on three datasets: the standard AAPD dataset, a corpus of scientific abstracts and Reuters-21578, a collection of news articles, and a newly proposed multi-label dataset called arXiv-ACM. Our method demonstrates improved performance, setting a new state-of-the-art on all three datasets. CCS CONCEPTS • Applied computing → Document metadata; Digital libraries and archives; • Information systems → Digital libraries and archives; Content analysis and feature selection; Document collection models; • Computing methodologies → Neural networks.
Fichier principal
Vignette du fichier
3573128.3609356.pdf (494.97 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Licence : Copyright (Tous droits réservés)

Dates et versions

hal-04222602 , version 1 (13-03-2024)

Identifiants

Citer

Haytame Fallah, Emmanuel Bruno, Patrice Bellot, Elisabeth Murisasco. Exploiting Label Dependencies for Multi-Label Document Classification Using Transformers. DocEng '23: ACM Symposium on Document Engineering 2023, Aug 2023, Limerick, Ireland. pp.1-4, ⟨10.1145/3573128.3609356⟩. ⟨hal-04222602⟩
28 Consultations
1 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More