Multi-frame amplitude envelope estimation for modification of singing voice - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE/ACM Transactions on Audio, Speech and Language Processing Année : 2016

Multi-frame amplitude envelope estimation for modification of singing voice

Résumé

Singing voice synthesis benefits from very high-quality estimation of the resonances and anti-resonances of the vocal tract filter (VTF), i.e., an amplitude spectral envelope. In the state of the art, a single frame of DFT transform is commonly used as a basis for building spectral envelopes. Even though multiple frame analysis (MFA) has already been suggested for envelope estimation, it is not yet used in concrete applications. Indeed, even though existing attempts have shown very interesting results, we will demonstrate that they are either over complicated or fail to satisfy the high accuracy that is necessary for singing voice. In order to allow future applications of MFA, this article aims to improve the theoretical understanding and advantages of MFA-based methods. The use of singing voice signals is very beneficial for studying MFA methods due to the fact that the VTF configuration can be relatively stable and, at the same time, the vibrato creates a regular variation that is easy to model. By simplifying and extending previous works, we also suggest and describe two MFA-based methods. To better understand the behaviors of the envelope estimates, we designed numerical measurements to assess single frame analysis and MFA methods using synthetic signals. With listening tests, we also designed two proofs of concept using pitch scaling and conversion of timbre. Both evaluations show clear and positive results for MFA-based methods, thus, encouraging this research direction for future applications.
Fichier non déposé

Dates et versions

hal-01448760 , version 1 (29-01-2017)

Identifiants

  • HAL Id : hal-01448760 , version 1

Citer

Gilles Degottex, Luc Ardaillon, Axel Roebel. Multi-frame amplitude envelope estimation for modification of singing voice. IEEE/ACM Transactions on Audio, Speech and Language Processing, 2016, 24 (7), pp.1242-1254. ⟨hal-01448760⟩
159 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More