Inter-annotator agreement for a speech corpus pronounced by French and German language learners - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2015

Inter-annotator agreement for a speech corpus pronounced by French and German language learners

Résumé

This paper presents the results of an investigation of inter-annotator agreement for the non-native and native French part of the IFCASL corpus. This large bilingual speech corpus for French and German language learners was manually annotated by several annotators. This manual annotation is the starting point which will be used both to improve the automatic segmentation algorithms and derive diagnosis and feedback. The agreement is evaluated by comparing the manual alignments of seven annotators to the manual alignment of an expert, for 18 sentences. Whereas results for the presence of the devoicing diacritic show a certain degree of disagreement between the annotators and the expert, there is a very good consistency between annotators and the expert for temporal boundaries as well as insertions and deletions. We find a good overall agreement for boundaries between annotators and expert with a mean deviation of 7.6 ms and 93% of boundaries within 20 ms.
Fichier principal
Vignette du fichier
slate_agreement_v7.pdf (204.29 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01185194 , version 1 (19-08-2015)

Identifiants

  • HAL Id : hal-01185194 , version 1

Citer

Odile Mella, Dominique Fohr, Anne Bonneau. Inter-annotator agreement for a speech corpus pronounced by French and German language learners. Workshop on Speech and Language Technology in Education, ISCA Special Interest Group (SIG) on Speech and Language Technology in Education, Sep 2015, Leipzig, Germany. ⟨hal-01185194⟩
258 Consultations
250 Téléchargements

Partager

Gmail Facebook X LinkedIn More