Communication Dans Un Congrès Année : 2024

MultiMediate'24: Multi-Domain Engagement Estimation

Résumé

Estimating the momentary level of participant's engagement is an important prerequisite for assistive systems that support human interactions. Previous work has addressed this task in within-domain evaluation scenarios, i.e. training and testing on the same dataset. This is in contrast to real-life scenarios where domain shifts between training and testing data frequently occur. With MultiMediate'24, we present the first challenge addressing multi-domain engagement estimation. As training data, we utilise the NOXI database of dyadic novice-expert interactions. In addition to within-domain test data, we add two new test domains. First, we introduce recordings following the NOXI protocol but covering languages that are not present in the NOXI training data. Second, we collected novel engagement annotations on the MPIIGroupInteraction dataset which consists of group discussions between three to four people. In this way, MultiMediate'24 evaluates the ability of approaches to generalise across factors such as language and cultural background, group size, task, and screen-mediated vs face-to-face interaction. This paper describes the MultiMediate'24 challenge and presents baseline results. In addition, we discuss selected challenge solutions.

Fichier principal
Vignette du fichier
main.pdf (1.41 Mo) Télécharger le fichier
2024_ACMMM.pdf (1.41 Mo) Télécharger le fichier
2024_ACMMM.zip (1.09 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04868959 , version 1 (15-01-2025)

Licence

Identifiants

Citer

Philipp Müller, Michal Balazia, Tobias Baur, Michael Dietz, Alexander Heimerl, et al.. MultiMediate'24: Multi-Domain Engagement Estimation. MM 2024 : The 32nd ACM International Conference on Multimedia, ACM, Oct 2024, Melbourne, Australia. pp.11377-11382, ⟨10.1145/3664647.3689004⟩. ⟨hal-04868959⟩
140 Consultations
215 Téléchargements

Altmetric

Partager

  • More