DisCut and DiscReT: MELODI at DISRPT 2023 - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

DisCut and DiscReT: MELODI at DISRPT 2023

Résumé

This paper presents the results obtained by the MELODI team for the three tasks proposed within the DISRPT 2023 shared task on discourse: segmentation, connective identification, and relation classification. The competition involves corpora in various languages in several underlying frameworks, and proposes two tracks depending on the presence or not of annotations of sentence boundaries and syntactic information. For these three tasks, we rely on a transformer-based architecture, and investigate several optimizations of the models, including hyper-parameter search and layer freezing. For discourse relations, we also explore the use of adapters-a lightweight solution for model fine-tuning-and introduce relation mappings to partially deal with the label set explosion we are facing within the setting of the shared task in a multi-corpus perspective. In the end, we propose one single architecture for segmentation and connectives, based on XLM-RoBERTa large, freezed at lower layers, with new stateof-the-art results for segmentation, and we propose 3 different models for relations, since the task makes it harder to generalize across all corpora.
Fichier principal
Vignette du fichier
2023.disrpt-1.3.pdf (299.02 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04310774 , version 1 (27-11-2023)

Identifiants

Citer

Eleni Metheniti, Chloé Braud, Philippe Muller, Laura Rivière. DisCut and DiscReT: MELODI at DISRPT 2023. 3rd Shared Task on Discourse Relation Parsing and Treebanking (DISRPT 2023), Jul 2023, Toronto, Canada. pp.29-42, ⟨10.18653/v1/2023.disrpt-1.3⟩. ⟨hal-04310774⟩
71 Consultations
68 Téléchargements

Altmetric

Partager

More