Dynamic Approach to Comprehensibility Assessment in Foreign Language Pronunciation Training
Résumé
In foreign language acquisition, being easily understood stands as the primary objective in pronunciation training. The term commonly associated with this ease of understanding is "comprehensibility," denoting the effort a listener exerts to understand a speaker. While it is relatively straightforward to measure the deviation between a learner's speech and a reference model, gauging the degree of effort required by the listener is considerably more challenging, if not impossible.
Conventional methods involve soliciting listener ratings on a scale to assess the perceived ease or difficulty in understanding the speaker. However, such global judgments often overlook the dynamic nature of effort perception throughout the speech, hindering the identification of phenomena influencing this perception. Addressing this limitation, Nagle et al. (2018) pioneered a dynamic approach to comprehensibility rating. They enlisted 24 native Spanish speakers to assess comprehensibility on a +5 to -5 scale while listening to recordings from three L2 Spanish speakers. Despite a significant individual variation in rating behaviors, the study revealed that low comprehensibility judgments significantly impacted global ratings, with positive judgments not necessarily correlating with improved overall ratings. Post-experiment, listeners attributed positive judgments to discourse and fluency, while negative judgments were often linked to lexical and grammar errors.
Our study replicates this dynamic rating protocol within the context of an investigation on pause patterns and lexical stress realization by French-L1 speakers of English. Eighty monolingual English native speakers were tasked with dynamically rating 16 short excerpts of spontaneous speech from French-L1 speakers of English at CEFR B1 and B2 levels. These excerpts, selected from 1,577 recordings by 176 speakers, were chosen based on pause distributions and lexical stress quality. Transcription, pause identification, and lexical stress labeling were conducted using the Pauses and Lexical Stress Processing Pipeline (Coulange et al., in press).
Differing from Nagle et al. (2018), our raters were equipped with a unique button to press when they felt difficulty understanding the speaker. Each recording, lasting between 30 and 60 seconds and featuring different speakers to prevent habituation, was presented in random order. Following each recording, raters globally assessed the speaker's performance on pronunciation accuracy, fluency, and ease of understanding on a scale of 0 to 100. Raters were also given the option to specify, in optional comments, the pronunciation features they believed contributed to increased difficulty in understanding. Our presentation will delve into rater behaviors under this protocol, exploring convergence patterns, linguistic features around which ratings coalesce, and correlations with global assessments.
Fichier principal
CoulangeAl2024_EPIP8.pdf (66.65 Ko)
Télécharger le fichier
CoulangeAl2024_EPIP8_slides.pdf (5.73 Mo)
Télécharger le fichier
Origine | Fichiers produits par l'(les) auteur(s) |
---|
Origine | Fichiers produits par l'(les) auteur(s) |
---|