Introducing Prosodic Speaker Identity for a Better Expressive Speech Synthesis Control - Archive ouverte HAL
Communication Dans Un Congrès Année : 2020

Introducing Prosodic Speaker Identity for a Better Expressive Speech Synthesis Control

Résumé

To have more control over Text-to-Speech (TTS) synthesis and to improve expressivity, it is necessary to disentangle prosodic information carried by the speaker's voice identity from the one belonging to linguistic properties. In this paper, we propose to analyze how information related to speaker voice identity affects a Deep Neural Network (DNN) based multi-speaker speech synthesis model. To do so, we feed the network with a vector encoding speaker information in addition to a set of basic linguistic features. We then compare three main speaker coding configurations: a) simple one-hot vector describing the speaker gender and identifier ; b) an embedding vector extracted from a speaker recognition pre-trained model ; c) a prosodic vector which summarizes information such as melody, intensity, and duration. To measure the impact of the input feature vector, we investigate the representation of the latent space at the output of the first layer of the network. The aim is to have an overview of our data representation and model behavior. Furthermore, we conducted a subjective assessment to validate the result. Results show that the prosodic identity of the speaker is captured by the model and therefore allows the user to control more precisely synthesis.
Fichier principal
Vignette du fichier
75.pdf (3.07 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-03000148 , version 1 (11-11-2020)

Identifiants

Citer

Aghilas Sini, Sébastien Le Maguer, Damien Lolive, Elisabeth Delais-Roussarie. Introducing Prosodic Speaker Identity for a Better Expressive Speech Synthesis Control. 10th International Conference on Speech Prosody 2020, May 2020, Tokyo, Japan. pp.935-939, ⟨10.21437/speechprosody.2020-191⟩. ⟨hal-03000148⟩
167 Consultations
221 Téléchargements

Altmetric

Partager

More