Nonnegative tensor factorization with frequency modulation cues for blind audio source separation - Archive ouverte HAL
Communication Dans Un Congrès Année : 2016

Nonnegative tensor factorization with frequency modulation cues for blind audio source separation

Résumé

We present Vibrato Nonnegative Tensor Factorization, an algorithm for single-channel unsupervised audio source separation with an application to separating instrumental or vocal sources with nonstationary pitch from music recordings. Our approach extends Nonnegative Matrix Factorization for audio modeling by including local estimates of frequency modulation as cues in the separation. This permits the modeling and unsupervised separation of vibrato or glissando musical sources, which is not possible with the basic matrix factorization formulation. The algorithm factorizes a sparse nonnegative tensor comprising the audio spectrogram and local frequency- slope-to-frequency ratios, which are estimated at each time-frequency bin using the Distributed Derivative Method. The use of local frequency modulations as separation cues is motivated by the principle of common fate partial grouping from Auditory Scene Analysis, which hypothesizes that each latent source in a mixture is characterized perceptually by coherent frequency and amplitude modulations shared by its component partials. We derive multiplicative factor updates by Minorization-Maximization, which guarantees convergence to a local optimum by iteration. We then compare our method to the baseline on two separation tasks: one considers synthetic vibrato notes, while the other considers vibrato string instrument recordings.
Fichier principal
Vignette du fichier
ismir.pdf (976.49 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01316485 , version 1 (21-09-2016)

Identifiants

  • HAL Id : hal-01316485 , version 1

Citer

Elliot Creager, Noah Stein, Roland Badeau, Philippe Depalle. Nonnegative tensor factorization with frequency modulation cues for blind audio source separation. 17th International Society for Music Information Retrieval (ISMIR) Conference, Aug 2016, New York, NY, United States. ⟨hal-01316485⟩
176 Consultations
31 Téléchargements

Partager

More