Multi-frame amplitude envelope estimation for modification of singing voice - Archive ouverte HAL Access content directly
Journal Articles IEEE/ACM Transactions on Audio, Speech and Language Processing Year : 2016

Multi-frame amplitude envelope estimation for modification of singing voice

Abstract

Singing voice synthesis benefits from very high-quality estimation of the resonances and anti-resonances of the vocal tract filter (VTF), i.e., an amplitude spectral envelope. In the state of the art, a single frame of DFT transform is commonly used as a basis for building spectral envelopes. Even though multiple frame analysis (MFA) has already been suggested for envelope estimation, it is not yet used in concrete applications. Indeed, even though existing attempts have shown very interesting results, we will demonstrate that they are either over complicated or fail to satisfy the high accuracy that is necessary for singing voice. In order to allow future applications of MFA, this article aims to improve the theoretical understanding and advantages of MFA-based methods. The use of singing voice signals is very beneficial for studying MFA methods due to the fact that the VTF configuration can be relatively stable and, at the same time, the vibrato creates a regular variation that is easy to model. By simplifying and extending previous works, we also suggest and describe two MFA-based methods. To better understand the behaviors of the envelope estimates, we designed numerical measurements to assess single frame analysis and MFA methods using synthetic signals. With listening tests, we also designed two proofs of concept using pitch scaling and conversion of timbre. Both evaluations show clear and positive results for MFA-based methods, thus, encouraging this research direction for future applications.
No file

Dates and versions

hal-01448760 , version 1 (29-01-2017)

Identifiers

  • HAL Id : hal-01448760 , version 1

Cite

Gilles Degottex, Luc Ardaillon, Axel Roebel. Multi-frame amplitude envelope estimation for modification of singing voice. IEEE/ACM Transactions on Audio, Speech and Language Processing, 2016, 24 (7), pp.1242-1254. ⟨hal-01448760⟩
160 View
0 Download

Share

Gmail Facebook X LinkedIn More