Mastering Overdetection and Underdetection in Learner-Answer Processing: Simple Techniques for Analysis and Diagnosis. - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Calico Journal Année : 2009

Mastering Overdetection and Underdetection in Learner-Answer Processing: Simple Techniques for Analysis and Diagnosis.

Résumé

This paper presents a "didactic triangulation" strategy to cope with the problem of reliability of NLP applications for Computer Assisted Language Learning (CALL) systems. It is based on the implementation of basic but well mastered NLP techniques, and put the emphasis on an adapted gearing between computable linguistic clues and didactic features of the evaluated activities. We claim that a correct balance between noise (i.e. false error detection) - and silence (i.e. undetected errors) is not only an outcome of NLP techniques, but of an appropriate didactic integration of what NLP can do well - and what it cannot do. Based on this approach, ExoGen is a prototype for generating activities such as gapfill exercises. It integrates a module for error detection and description, which checks learners' answers against expected ones. Through the analysis of graphic, orthographic and morphosyntactic differences, it is able to diagnose problems like spelling errors, lexical mix-ups, errors prone agreement, conjugation errors, etc. The first evaluation of ExoGen outputs, based on the FRIDA learner corpus, has yielded very promising results, paving the way for the development of an efficient and general model adapted to a wide variety of activities.
Fichier principal
Vignette du fichier
CALICO.Journal.final2.pdf (773.14 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00612628 , version 1 (09-02-2019)

Identifiants

Citer

Olivier Kraif, Claude Ponton, Alexia Blanchard. Mastering Overdetection and Underdetection in Learner-Answer Processing: Simple Techniques for Analysis and Diagnosis.. Calico Journal, 2009, 26 (3), pp.592-610. ⟨10.1558/cj.v26i3.592-610⟩. ⟨hal-00612628⟩

Collections

UGA LIDILEM
98 Consultations
222 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More