A Multimodal Educational Corpus of Oral Courses: Annotation, Analysis and Case Study - Archive ouverte HAL
Communication Dans Un Congrès Année : 2020

A Multimodal Educational Corpus of Oral Courses: Annotation, Analysis and Case Study

Résumé

This paper presents a French multimodal educational dataset of oral courses. This corpus is part of the PASTEL (Performing Automated Speech Transcription for Enhancing Learning) project aiming to explore the potential of synchronous speech transcription and application in specific teaching situations (Bettenfeld et al., 2018; Bettenfeld et al., 2019). It includes 10 hours of different lectures, manually transcribed and segmented. The main interest of this corpus lies in its multimodal aspect: in addition to speech, the courses were filmed and the written presentation supports (slides) are made available. The dataset may then serve researches in multiple fields, from speech and language to image and video processing. The dataset will be freely available to the research community. In this paper, we first describe in details the annotation protocol, including a detailed analysis of the manually labeled data. Then, we propose some possible use cases of the corpus with baseline results. The use cases concern scientific fields from both speech and text processing, with language model adaptation, thematic segmentation and transcription to slide alignment.
Fichier principal
Vignette du fichier
2020.lrec-1.529.pdf (1.58 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02496700 , version 1 (25-01-2024)

Identifiants

  • HAL Id : hal-02496700 , version 1

Citer

Salima Mdhaffar, Yannick Estève, Antoine Laurent, Nicolas Hernandez, Richard Dufour, et al.. A Multimodal Educational Corpus of Oral Courses: Annotation, Analysis and Case Study. LREC, May 2020, Marseille, France. ⟨hal-02496700⟩
190 Consultations
68 Téléchargements

Partager

More