Improvement to a NAM captured whisper-to-speech system - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2008

Improvement to a NAM captured whisper-to-speech system

Résumé

In this paper, new techniques to improve whisper-to-speech conversion are investigated, in the framework of silent speech telephone communication. A preliminary conversion method from Non-Audible Murmur (NAM) to modal speech, based on statistical mapping trained using aligned corpora has been proposed. Although it is a very promising technique, its performance is still insufficient due to the difficulties in estimating F0 from unvoiced speech. In this paper, two distinct modifications are proposed, in order to improve the naturalness of the synthesized speech. In the first modification, LDA (Linear Discriminant Analysis) is used instead of PCA (Principal Component Analysis) to reduce the dimensionality of the input spectral vectors. In addition, the influence of long-term variation of spectral information on pitch estimation is examined. The second modification is an attempt to integrate visual information as a complementary input to improve spectral estimation, F0 estimation and voicing decision.
Fichier principal
Vignette du fichier
vat_IS08.pdf (130.88 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00333288 , version 1 (15-11-2008)

Identifiants

  • HAL Id : hal-00333288 , version 1

Citer

Viet-Anh Tran, Gérard Bailly, Hélène Loevenbruck, Christian Jutten. Improvement to a NAM captured whisper-to-speech system. Interspeech 2008 - 9th Annual Conference of the International Speech Communication Association, Sep 2008, Brisbane, Australia. pp.1465-1468. ⟨hal-00333288⟩
317 Consultations
273 Téléchargements

Partager

Gmail Facebook X LinkedIn More