Real-time interpretation of geometric shapes for digital learning
Résumé
In the context of the ACTIF project that aims for active and collaborative learning promotion, this paper presents a pattern recognition and analysis system for Geometry learning in middle school. The goal is to allow students to draw geometric shapes on a touch-tablet, given a teacher's instruction. To make the student active, the system have to recognize and analyze on the fly the student's productions in order to produce real-time visual, corrective, and guidance feedback. We base our work on the visual grammar CD-CMG [1] (Context Driven Constraints Multi-set Grammar), to model the domain prior knowledge and interpret the hand-drawn sketches on the fly. Our first contribution lies in adapting this grammar to the Geometry domain to cover the geometric objects taught in middle school curriculum. Although being expressive enough to model this large scope, the formalism could not cope with the exigence of real-time analysis, given that the multiple interactions between geometric objects generate combinatorial issues. Our second contribution lies in extending the formalism which resulted in having an acceptable performance for a real-time user interaction system. The first experiments show that the proposed approach allows complexity and interpretation time reduction.
Origine | Fichiers produits par l'(les) auteur(s) |
---|
Loading...