UO-LouTAL at SemEval-2023 Task 6: Lightweight Systems for Legal Processing - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

UO-LouTAL at SemEval-2023 Task 6: Lightweight Systems for Legal Processing

Résumé

This paper presents the work produced by students of the University of Orlans Masters in Natural Language Processing program by way of participating in SemEval Task 6, LegalEval, which aims to enhance the capabilities of legal professionals through automated systems. Two out of the three sub-tasks available – Rhetorical Role prediction (RR) and Legal Named Entity Recognition (L-NER) – were tackled, with the express intent of developing lightweight and interpretable systems. For the L-NER sub-task, a CRF model was trained, augmented with post-processing rules for some named entity types. A macro F1 score of 0.74 was obtained on the DEV set, and 0.64 on the evaluation set. As for the RR sub-task, two sentence classification systems were built: one based on the Bag-of-Words technique with L-NER system output integrated, the other using a sentence-transformer approach. Rule-based post-processing then converted the results of the sentence classification systems into RR predictions. The better-performing Bag-of-Words system obtained a macro F1 score of 0.49 on the DEV set and 0.57 on the evaluation set.
Fichier principal
Vignette du fichier
2023.semeval-1.195.pdf (252.32 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04313194 , version 1 (29-11-2023)

Identifiants

Citer

Sébastien Bosch, Louis Estève, Joanne Loo, Anne-Lyse Minard. UO-LouTAL at SemEval-2023 Task 6: Lightweight Systems for Legal Processing. 17th International Workshop on Semantic Evaluation (SemEval-2023), Jul 2023, Toronto, Canada. pp.1412-1420, ⟨10.18653/v1/2023.semeval-1.195⟩. ⟨hal-04313194⟩
22 Consultations
24 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More