Automatic Context-Aware Inference of Engagement in HMI: A Survey - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Affective Computing Année : 2023

Automatic Context-Aware Inference of Engagement in HMI: A Survey

Hanan Salam
Oya Celiktutan
Hatice Gunes

Résumé

Engagement is the process by which participants establish, maintain, and end their perceived connection. Automatic engagement inference is one of the tasks required to develop successful human-centered HMI applications. Engagement is a multi-faceted multimodal construct requiring high accuracy in interpretating contextual, verbal and non-verbal cues, making the development of an intelligent automated engagement inference system challenging. Existing surveys concentrate on specific application settings, and a comprehensive survey covering the different engagement facets, definition and inference across various contexts is lacking. Moreover, despite the importance of context-aware modeling, the literature lacks a systematic context-aware overview on the topic. This paper presents a comprehensive survey on previous work in engagement for HMI, entailing interdisciplinary definition, engagement components, publicly available datasets, ground truth assessment, and commonly used features and methods, serving as a guide for the development of future HMI interfaces with reliable context-aware engagement inference capability. An in-depth review across embodied and disembodied interaction modes, and an emphasis on the interaction context of which engagement is studied sets apart this survey from existing ones. Our findings suggest four important directions for future research: (1) context-aware computational modeling, (2) temporal dynamics, (3) personalised computing, and (4) bias and fairness of engagement inference systems.
Fichier principal
Vignette du fichier
2209.15370.pdf (2.7 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04109343 , version 1 (30-05-2023)

Identifiants

Citer

Hanan Salam, Oya Celiktutan, Hatice Gunes, Mohamed Chetouani. Automatic Context-Aware Inference of Engagement in HMI: A Survey. IEEE Transactions on Affective Computing, 2023, pp.1-20. ⟨10.1109/TAFFC.2023.3278707⟩. ⟨hal-04109343⟩
15 Consultations
24 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More