Investigating the cortical tracking of speech and music with sung speech - Archive ouverte HAL Access content directly
Conference Papers Year : 2023

Investigating the cortical tracking of speech and music with sung speech

Abstract

The cortical tracking of speech and music has been primarily investigated separately. Here, we propose a novel paradigm involving sung speech to systematically compare the cortical encoding of sung speech with that of speech and music alone, offering a benchmark for using it in auditory research with ecologically-valid tasks. While this approach will ultimately lead to a variety of neural indices of speech and music processing at various levels of abstraction, the first step is to examine the envelope tracking of sung speech. EEG is recorded from subjects listening to a set of stimuli explicitly designed and built for the comparison: hummed melodies, speech monologues, and sung speech sharing the lyrics with the speech condition and the melody with the music condition. Preliminary analyses using encoding and decoding modeling show robust and consistent acoustic responses across conditions, with the only significant differences exclusively due to melody processing.
Fichier principal
Vignette du fichier
AE_Song_Interspeech2023.pdf (10.02 Mo) Télécharger le fichier
Origin : Publisher files allowed on an open archive

Dates and versions

hal-04216921 , version 1 (25-09-2023)

Identifiers

Cite

Giorgia Cantisani, Amirhossein Chalehchaleh, Giovanni Di Liberto, Shihab Shamma. Investigating the cortical tracking of speech and music with sung speech. Proc. INTERSPEECH 2023, International Speech Communication Association (ISCA), Aug 2023, Dublin, Ireland. pp.5157-5161, ⟨10.21437/Interspeech.2023-1949⟩. ⟨hal-04216921⟩
60 View
30 Download

Altmetric

Share

Gmail Facebook X LinkedIn More