Independent and Automatic Evaluation of Speaker-Independent Acoustic-to-Articulatory Reconstruction - Archive ouverte HAL
Conference Papers Year : 2020

Independent and Automatic Evaluation of Speaker-Independent Acoustic-to-Articulatory Reconstruction

Abstract

Reconstruction of articulatory trajectories from the acoustic speech signal has been proposed for improving speech recognition and text-to-speech synthesis. However, to be useful in these settings, articulatory reconstruction must be speakerindependent. Furthermore, as most research focuses on single, small data sets with few speakers, robust articulatory reconstruction could profit from combining data sets. Standard evaluation measures such as root mean squared error and Pearson correlation are inappropriate for evaluating the speakerindependence of models or the usefulness of combining data sets. We present a new evaluation for articulatory reconstruction which is independent of the articulatory data set used for training: the phone discrimination ABX task. We use the ABX measure to evaluate a bi-LSTM based model trained on three data sets (14 speakers), and show that it gives information complementary to standard measures, enabling us to evaluate the effects of data set merging, as well as the speaker independence of the model.
Fichier principal
Vignette du fichier
Interspeech_2020__articulatory_inversion.pdf (234.59 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03087264 , version 1 (23-12-2020)

Identifiers

  • HAL Id : hal-03087264 , version 1

Cite

Maud Parrot, Juliette Millet, Ewan Dunbar. Independent and Automatic Evaluation of Speaker-Independent Acoustic-to-Articulatory Reconstruction. Interspeech 2020 - 21st Annual Conference of the International Speech Communication Association, Oct 2020, Shanghai / Virtual, China. ⟨hal-03087264⟩
233 View
267 Download

Share

More