EEG-based Decoding of Auditory Attention to a Target Instrument for Neuro-steered Music Source Separation - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2021

EEG-based Decoding of Auditory Attention to a Target Instrument for Neuro-steered Music Source Separation

Résumé

This paper describes a novel neuro-steered music source separation framework and conducts an extensive evaluation of the proposed system on MAD-EEG, a dataset composed of EEG recordings of subjects attending to a particular in duo and trio music excerpts. We propose an unsupervised non-negative matrix factorisation (NMF) variant, named Contrastive-NMF, that separates a target instrument, guided by the user's selective auditory attention to that instrument, which is tracked in his/her electroencephalographic (EEG) response to music. We analyse the impact of multiple aspects of the musical stimuli, such as the number and type of instruments in the mixture, the spatial rendering and the music genre, obtaining encouraging results, especially in difficult cases where non-informed models struggle. We believe that this unsupervised NMF variant is advantageous for neuro-steered music source separation as it allows us to incorporate additional information in a principled optimisation fashion and does not need training data, which is particularly difficult to acquire for applications involving EEG recording.
Fichier principal
Vignette du fichier
Cantisani_AAD_C_NMF_ArXiv.pdf (1.93 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04349308 , version 1 (17-12-2023)
hal-04349308 , version 2 (04-04-2024)

Identifiants

  • HAL Id : hal-04349308 , version 2

Citer

Giorgia Cantisani, Slim Essid, Gael Richard. EEG-based Decoding of Auditory Attention to a Target Instrument for Neuro-steered Music Source Separation. 2021. ⟨hal-04349308v2⟩
39 Consultations
19 Téléchargements

Partager

Gmail Facebook X LinkedIn More