Communication Dans Un Congrès Année : 2024

Emotags: Computer-Assisted Verbal Labelling of Expressive Audiovisual Utterances for Expressive Multimodal TTS

Résumé

We developed a web app for ascribing verbal descriptions to expressive audiovisual utterances. These descriptions are limited to lists of adjective tags that are either suggested via a navigation in emotional latent spaces built using discriminant analysis of BERT embeddings, or entered freely by participants. We show that such verbal descriptions collected on-line via Prolific on massive French audiovisual data (742 participants, 8 970 tagged utterances up-to-now) provide Expressive MFciteultimodal Text-to-Speech Synthesis with precise verbal control over desired emotional content.

Fichier principal
Vignette du fichier
2024.lrec-main.505.pdf (1.33 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04709149 , version 1 (25-09-2024)

Licence

Identifiants

  • HAL Id : hal-04709149 , version 1

Citer

Gérard Bailly, Romain Legrand, Martin Lenglet, Frédéric Elisei, Maëva Garnier, et al.. Emotags: Computer-Assisted Verbal Labelling of Expressive Audiovisual Utterances for Expressive Multimodal TTS. LREC-COLING 2024 - Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), Calzolari, Nicoletta; Kan, Min-Yen; Hoste, Veronique; Lenci, Alessandro; Sakti, Sakriani; Xue, Nianwen, May 2024, Turin, Italy. pp.5689-5695. ⟨hal-04709149⟩
488 Consultations
268 Téléchargements

Partager

  • More