Multimodal Focus Attention Detection in an Augmented Driver Simulator - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Personal and Ubiquitous Computing Année : 2006

Multimodal Focus Attention Detection in an Augmented Driver Simulator

Résumé

This project proposes to develop a driver simulator, which takes into account information about the user state of mind (level of attention, fatigue state, stress state). The user'sstate of mind analysis is based on video data and physiological signals. Facial movements such as eyes blinking, yawning, head rotations... are detected on video data: they are used in order to evaluate the fatigue and attention level of the driver. The user'selectrocardiogram and galvanic skin response are recorded andanalyzed in order to evaluate the stress level of the driver. A driver simulator software is modified in order to be able to appropriately react to these critical situations of fatigue andstress: some visual messages are sent to the driver, wheelvibrations are generated and the driver is supposed to react to the alertness messages. A flexible and efficient multi threaded server architecture is proposed to support multi messages sent bydifferent modalities. Strategies for data fusion and fission are also provided. Some of these components are integrated within the first prototype of OpenInterface (the Multimodal Similar platform).
Fichier principal
Vignette du fichier
project4_eNTERFACE2005.pdf (1.13 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00256659 , version 1 (16-02-2008)

Identifiants

Citer

Alexandre Benoit, Laurent Bonnaud, Alice Caplier, Philippe Ngo, L. Lawson, et al.. Multimodal Focus Attention Detection in an Augmented Driver Simulator. Personal and Ubiquitous Computing, 2006, not yet published. ⟨10.1007/s00779-007-0173-0⟩. ⟨hal-00256659⟩

Collections

UGA CNRS LIS
272 Consultations
497 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More