Journal Articles Speech Communication Year : 2023

The role of prosody and hand gestures in the perception of boundaries in speech✰

Abstract

This paper investigates the use of prosodic, gestural, and syntactic information in the perception of boundaries in extracts of spontaneous speech in British English. Experiment 1 aimed at investigating the effect of prosody on naive participants' perception of boundary strength. 13 naive listeners had to rate boundary strength for 64 extracts on a 5-point scale. The stimuli all contained three tone-units, the second being a syntactic subordinate construction, which was established as a variable. The prosodic cues at the boundary between the tone-units were also established as variables, and were subject to manipulation (addition of a single cue associated with the perception of a prosodic boundary). Experiment 2 aimed at assessing the effect of gesture on naive participants' perception of boundary strength. In Experiment 2, 24 naive listeners had to measure boundary strength for 24 extracts on a 5-point scale. The stimuli all contained three tone-units, the second being a syntactic subordinate construction, which was established as a variable. The hand gestures produced in co-occurrence with the tone-units were established as variables, and were subject to manipulation. Results show that prosody modulates perceived boundary strength, but not gesture, based on the variables we included. Silent pauses have the strongest effect on perceived boundary strength, but final syllabic lengthening and pitch reset also have separate effects as single predictors. Our data also shows a trend concerning the production of two identical hand gestures in terms of configuration and trajectory.

Domains

Linguistics
Fichier principal
Vignette du fichier
Lelandais-Thiberge-2023-SPECOM.pdf (1.63 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Licence

Dates and versions

hal-04094509 , version 1 (03-06-2024)

Licence

Identifiers

Cite

Manon Lelandais, Gabriel Thiberge. The role of prosody and hand gestures in the perception of boundaries in speech✰. Speech Communication, 2023, 150, pp.41-65. ⟨10.1016/j.specom.2023.05.001⟩. ⟨hal-04094509⟩
124 View
80 Download

Altmetric

Share

More