Article Dans Une Revue Lingua Année : 2023

Visualizing prosodic structure: Manual gestures as highlighters of prosodic heads and edges in English academic discourses

Résumé

Research has shown a close temporal relationship between prominence-lending tonal movements in speech and prominence in manual gesture. However, prosodic structure consists of not only prosodic heads (i.e., pitch accentuation) but also prosodic edges. To our knowledge, no previous studies have assessed the value of prosodic edges (nuclear vs. phrase-initial prenuclear pitch accents) as anchoring sites for different types of gestures (i.e., referential vs. non-referential) while independently controlling for the relative degree of prominence associated with the pitch accent. The English M3D-TED corpus, which contains over 23 minutes of multimodal speech, was analyzed in terms of prosody and gesture. Results showed that while the majority of manual gesture strokes overlapped a pitch accented syllable (85.99%), apex alignment occurred at a relatively low rate (50.4%) and alignment rates did not significantly differ between referential and non-referential gestures. At the phrasal level, crucially our results also showed that strokes align with phrase-initial prenuclear pitch accents over nuclear accents, and this relationship is not driven by relative prominence. These findings show that both prosodic heads and prosodic edges (i.e., phrase initial and final positions) are key sites for both referential and non-referential gesture production.

Fichier principal
Vignette du fichier
Rohrer-Delais-Prieto-2023_LINGUA.pdf (1.12 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Licence

Dates et versions

hal-04370544 , version 1 (03-01-2024)

Licence

Identifiants

Citer

Patrick Rohrer, Elisabeth Delais-Roussarie, Pilar Prieto. Visualizing prosodic structure: Manual gestures as highlighters of prosodic heads and edges in English academic discourses. Lingua, 2023, 293, pp.103583. ⟨10.1016/j.lingua.2023.103583⟩. ⟨hal-04370544⟩
75 Consultations
270 Téléchargements

Altmetric

Partager

  • More