Speaking Rate Control of end-to-end TTS Models by Direct Manipulation of the Encoder's Output Embeddings - Archive ouverte HAL
Communication Dans Un Congrès Année : 2022

Speaking Rate Control of end-to-end TTS Models by Direct Manipulation of the Encoder's Output Embeddings

Résumé

Since neural Text-To-Speech models have achieved such high standards in terms of naturalness, the main focus of the field has gradually shifted to gaining more control over the expressiveness of the synthetic voices. One of these leverages is the control of the speaking rate that has become harder for a human operator to control since the introduction of neural attention networks to model speech dynamics. While numerous models have reintroduced an explicit duration control (ex: Fast-Speech2), these models generally rely on additional tasks to complete during their training. In this paper, we show how an acoustic analysis of the internal embeddings delivered by the encoder of an unsupervised end-to-end TTS Tacotron2 model is enough to identify and control some acoustic parameters of interest. Specifically, we compare this speaking rate control with the duration control offered by a supervised FastSpeech2 model. Experimental results show that the control provided by embeddings reproduces a behaviour closer to natural speech data.
Fichier principal
Vignette du fichier
lenglet22_interspeech.pdf (400.58 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03793220 , version 1 (30-09-2022)
hal-03793220 , version 2 (30-09-2022)

Identifiants

Citer

Martin Lenglet, Olivier Perrotin, Gérard Bailly. Speaking Rate Control of end-to-end TTS Models by Direct Manipulation of the Encoder's Output Embeddings. Interspeech 2022 - 23rd Annual Conference of the International Speech Communication Association, Sep 2022, Incheon, South Korea. pp.11-15, ⟨10.21437/interspeech.2022-759⟩. ⟨hal-03793220v2⟩
185 Consultations
231 Téléchargements

Altmetric

Partager

More