Investigating the cortical tracking of speech and music with sung speech - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Investigating the cortical tracking of speech and music with sung speech

Résumé

The cortical tracking of speech and music has been primarily investigated separately. Here, we propose a novel paradigm involving sung speech to systematically compare the cortical encoding of sung speech with that of speech and music alone, offering a benchmark for using it in auditory research with ecologically-valid tasks. While this approach will ultimately lead to a variety of neural indices of speech and music processing at various levels of abstraction, the first step is to examine the envelope tracking of sung speech. EEG is recorded from subjects listening to a set of stimuli explicitly designed and built for the comparison: hummed melodies, speech monologues, and sung speech sharing the lyrics with the speech condition and the melody with the music condition. Preliminary analyses using encoding and decoding modeling show robust and consistent acoustic responses across conditions, with the only significant differences exclusively due to melody processing.
Fichier principal
Vignette du fichier
AE_Song_Interspeech2023.pdf (10.02 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04216921 , version 1 (25-09-2023)

Identifiants

Citer

Giorgia Cantisani, Amirhossein Chalehchaleh, Giovanni Di Liberto, Shihab Shamma. Investigating the cortical tracking of speech and music with sung speech. Proc. INTERSPEECH 2023, International Speech Communication Association (ISCA), Aug 2023, Dublin, Ireland. pp.5157-5161, ⟨10.21437/Interspeech.2023-1949⟩. ⟨hal-04216921⟩
62 Consultations
31 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More