Communication Dans Un Congrès Année : 2025

SELEXINI - a large and diverse automatically parsed corpus of French

Résumé

The annotation of large text corpora is essential for many tasks. We present here a large automatically annotated corpus for French. This corpus is divided into two parts: the first from BigScience, and the second from HPLT. The annotated documents from HPLT were selected in order to optimise the lexical diversity of the final corpus SELEXINI. An analysis of the impact of this selection was carried out on syntactic diversity, as well as on the quality of the new words resulting from the HPLT part of SELEXINI. We have shown that despite the introduction of interesting new words, the texts extracted from HPLT are very noisy. Furthermore, increasing lexical diversity did not increase syntactic diversity.

Fichier principal
Vignette du fichier
2025.bucc-1.10.pdf (1.47 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Licence

Dates et versions

hal-04978746 , version 1 (06-03-2025)

Licence

Identifiants

  • HAL Id : hal-04978746 , version 1

Citer

Manon Scholivet, Agata Savary, Louis Estève, Marie Candito, Carlos Ramisch. SELEXINI - a large and diverse automatically parsed corpus of French. BUCC - Building and Using Comparable Corpora, Jan 2025, Abu Dhabi, United Arab Emirates. ⟨hal-04978746⟩
1674 Consultations
300 Téléchargements

Partager

  • More