Binaural Localization of Multiple Sound Sources by Non-Negative Tensor Factorization - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE/ACM Transactions on Audio, Speech and Language Processing Année : 2018

Binaural Localization of Multiple Sound Sources by Non-Negative Tensor Factorization

Résumé

—This paper presents non-negative factorization of audio signals for the binaural localization of multiple sound sources within realistic and unknown sound environments. Non-negative tensor factorization (NTF) provides a sparse representation of multi-channel audio signals in time, frequency, and space that can be exploited in computational audio scene analysis and robot audition for the separation and localization of sound sources. In the proposed formulation, each sound source is represented by mean of spectral dictionaries, temporal activation, and its distribution within each channel (here, left and right ears). This distribution, being dependent on the frequency, can be interpreted as an explicit estimation of the Head-Related Transfer Function (HRTF) of a binaural head which can then be converted into the estimated sound source position. Moreover, the semi-supervised formulation of the non-negative factorization allows to integrate prior knowledge about some sound sources of interest whose dictionaries can be learned in advance, whereas the remaining sources are considered as background sound which remains unknown and is estimated on-the-fly. The proposed NTF-based sound source localization is here applied to binaural sound source localization of multiple speakers within realistic sound environments.
Fichier principal
Vignette du fichier
Binaural_Localization_of_Multiple_Sound.pdf (4 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01722004 , version 1 (02-03-2018)

Identifiants

Citer

Laurent Benaroya, Nicolas Obin, Marco Liuni, Axel Roebel, Wilson Raumel, et al.. Binaural Localization of Multiple Sound Sources by Non-Negative Tensor Factorization. IEEE/ACM Transactions on Audio, Speech and Language Processing, 2018, pp.1 - 1. ⟨10.1109/TASLP.2018.2806745⟩. ⟨hal-01722004⟩
287 Consultations
415 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More