Voicing decision based on phonemes classification and spectral moments for whisper-to-speech conversion - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Voicing decision based on phonemes classification and spectral moments for whisper-to-speech conversion

Résumé

Cordectomized or laryngectomized patients recover the ability to speak thanks to devices able to produce a naturalsounding voice source in real time. However, constant voicing can impair the naturalness and intelligibility of reconstructed speech. Voicing decision, consisting in identifying whether an uttered phone should be voiced or not, is investigated here as an automatic process in the context of whisperto-speech (W2S) conversion systems. Whereas state-of-the-art approaches apply DNN techniques on high-dimensional acoustic features, we seek here a low-resource alternative approach for a perceptually-meaningful mapping between acoustic features and voicing decision, suitable for real-time applications. Our method first classifies whisper signal frames into phoneme classes based on their spectral centroid and spread, and then discriminates voiced phonemes from their unvoiced counterpart based on class-dependent spectral centroid thresholds. We compared our method to a simpler approach using a single centroid threshold on several databases of annotated whispers in both single-speaker and multi-speaker training setups. While both approaches reach voicing accuracy higher than 91%, the proposed method allows to avoid some systematic voicing decision errors, which may allow users to learn to adapt their speech in real-time to compensate for remaining voicing errors.
Fichier principal
Vignette du fichier
2022_Ardaillon_Interspeech.pdf (441.29 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03780337 , version 1 (30-09-2022)

Identifiants

Citer

Luc Ardaillon, Nathalie Henrich Bernardoni, Olivier Perrotin. Voicing decision based on phonemes classification and spectral moments for whisper-to-speech conversion. Interspeech 2022 - 23rd Annual Conference of the International Speech Communication Association, Sep 2022, Incheon, South Korea. pp.2253-2257, ⟨10.21437/interspeech.2022-10675⟩. ⟨hal-03780337⟩
102 Consultations
76 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More