Supporting Multi-user Participation with Affective Multimodal Fusion - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2011

Supporting Multi-user Participation with Affective Multimodal Fusion

Céline Coutrix
Giulio Jacucci
  • Fonction : Auteur
  • PersonId : 1349414
Ivan Advouevski
  • Fonction : Auteur
Valentin Vervondel
  • Fonction : Auteur
Marc Cavazza
Stephen W Gilroy
  • Fonction : Auteur
Lorenza Parisi
  • Fonction : Auteur
  • PersonId : 1349416

Résumé

In this paper, we present an application of affective computing as an art installation designed for group interaction. The Common Touch utilises a large multi-touch display, presenting interactive visualisations of emotive slogans. The artistic brief is to engage participants in the exploration, touching and manipulation of slogans. Participants reveal the missing words of slogans by touching them. The Common Touch utilises several input modalities to build an affective representation of the group interactions: emotional speech recognition, video feature extraction, multikeyword spotting and touch events. The output of affective fusion is used to refine the selection of slogans presented. We include results of a series of experiments using The Common Touch with 24 subjects in groups of 3 using video analysis, logs and questionnaires for data collection. We describe, through interaction analysis, how users utilised the different modalities, suggesting implications for implementing multimodal aesthetic applications to support multiuser participation: tracking multiuser engagement, coverage of possible affective cues in each modality, multimodality in temporal and event analysis, dramaturgy and performative interaction.
Fichier principal
Vignette du fichier
C5-SupportingMultiUser-Coutrix.pdf (710.1 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04447185 , version 1 (08-02-2024)

Identifiants

Citer

Céline Coutrix, Giulio Jacucci, Ivan Advouevski, Valentin Vervondel, Marc Cavazza, et al.. Supporting Multi-user Participation with Affective Multimodal Fusion. 2011 Ninth International Conference on Creating, Connecting and Collaborating through Computing (C5), Jan 2011, Kyoto, Japan. pp.24-31, ⟨10.1109/C5.2011.14⟩. ⟨hal-04447185⟩
7 Consultations
5 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More