Improvement to a NAM-captured whisper-to-speech system - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Speech Communication Année : 2010

Improvement to a NAM-captured whisper-to-speech system

Viet-Anh Tran
  • Fonction : Auteur correspondant
  • PersonId : 907457

Connectez-vous pour contacter l'auteur
Gérard Bailly
Hélène Loevenbruck
Tomoki Toda
  • Fonction : Auteur

Résumé

Exploiting a tissue-conductive sensor - a stethoscopic microphone - the system developed at NAIST which converts Non-Audible Murmur (NAM) to audible speech by GMM-based statistical mapping is a very promising technique. The quality of the converted speech is however still insufficient for computer-mediated communication, notably because of the poor estimation of from unvoiced speech and because of impoverished phonetic contrasts. This paper presents our investigations to improve the intelligibility and naturalness of the synthesized speech and first objective and subjective evaluations of the resulting system. The first improvement concerns voicing and estimation. Instead of using a single GMM for both, we estimate a continuous using a GMM, trained on target voiced segments only. The continuous estimation is filtered by a voicing decision computed by a neural network. The objective and subjective improvement is significant. The second improvement concerns the input time window and its dimensionality reduction: we show that the precision of estimation is also significantly improved by extending the input time window from 90 to 450ms and by using a Linear Discriminant Analysis (LDA) instead of the original Principal Component Analysis (PCA). Estimation of spectral envelope is also slightly improved with LDA but is degraded with larger time windows. A third improvement consists in adding visual parameters both as input and output parameters. The positive contribution of this information is confirmed by a subjective test. Finally, HMM-based conversion is compared with GMM-based conversion.

Mots clés

Fichier principal
Vignette du fichier
PEER_stage2_10.1016%2Fj.specom.2009.11.005.pdf (1.63 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00616229 , version 1 (20-08-2011)

Identifiants

Citer

Viet-Anh Tran, Gérard Bailly, Hélène Loevenbruck, Tomoki Toda. Improvement to a NAM-captured whisper-to-speech system. Speech Communication, 2010, 52 (4), pp.314. ⟨10.1016/j.specom.2009.11.005⟩. ⟨hal-00616229⟩

Collections

PEER
32 Consultations
194 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More