Phone-Level Embeddings for Unit Selection Speech Synthesis - Archive ouverte HAL Access content directly
Conference Papers Year : 2018

Phone-Level Embeddings for Unit Selection Speech Synthesis


Deep neural networks have become the state of the art in speech synthesis. They have been used to directly predict signal parameters or provide unsupervised speech segment descriptions through embeddings. In this paper, we present four models with two of them enabling us to extract phone-level embeddings for unit selection speech synthesis. Three of the models rely on a feed-forward DNN, the last one on an LSTM. The resulting embeddings enable replacing usual expert-based target costs by an euclidean distance in the embedding space. This work is conducted on a French corpus of an 11 hours audiobook. Perceptual tests show the produced speech is preferred over a unit selection method where the target cost is defined by an expert. They also show that the embeddings are general enough to be used for different speech styles without quality loss. Furthermore, objective measures and a perceptual test on statistical parametric speech synthesis show that our models perform comparably to state-of-the-art models for parametric signal generation, in spite of necessary simplifications, namely late time integration and information compression.
Fichier principal
Vignette du fichier
samplepaper.pdf (297.84 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01840812 , version 1 (16-07-2018)



Antoine Perquin, Gwénolé Lecorvé, Damien Lolive, Laurent Amsaleg. Phone-Level Embeddings for Unit Selection Speech Synthesis. SLSP 2018 - 6th International Conference on Statistical Language and Speech Processing, Oct 2018, Mons, Belgium. pp.21-31, ⟨10.1007/978-3-030-00810-9_3⟩. ⟨hal-01840812⟩
237 View
461 Download



Gmail Facebook X LinkedIn More