Engaging Spect-actors with Multimodal Digital Puppetry - Archive ouverte HAL
Communication Dans Un Congrès Année : 2010

Engaging Spect-actors with Multimodal Digital Puppetry

Céline Coutrix
Giulio Jacucci
  • Fonction : Auteur
Anna Spagnolli
  • Fonction : Auteur
Lingyi Ma
  • Fonction : Auteur
Matti Helin
  • Fonction : Auteur
Gabriela Richard
  • Fonction : Auteur
Lorenza Parisi
  • Fonction : Auteur
Stefano Roveda
  • Fonction : Auteur
Prayag Narula
  • Fonction : Auteur

Résumé

We present Euclide, a multimodal system for live animation of a virtual puppet that is composed of a data glove, MIDI music board, keyboard, and mouse. The paper reports on a field study in which Euclide was used in a science museum to animate visitors as they passed by five different stations. Quantitative and qualitative analysis of several hours of videos served investigation of how the various features of the multimodal system were used by different puppeteers in the unfolding of the sessions. We found that the puppetry was truly multimodal, utilizing several input modalities simultaneously; the structure of sessions followed performative strategies; and the engagement of spectators was co-constructed. The puppeteer uses nonverbal resources (effects) and we examined how they are instrumental to talk as nonverbal turns, verbal accompaniment, and virtual gesturing. These findings allow describing digital puppetry as an emerging promising field of application for HCI that acts as a source of insights applicable in a range of multimodal performative interactive systems.
Fichier principal
Vignette du fichier
NordiCHI10-EngagingSpectactors-Coutrix.pdf (1.52 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04447199 , version 1 (08-02-2024)

Identifiants

Citer

Céline Coutrix, Giulio Jacucci, Anna Spagnolli, Lingyi Ma, Matti Helin, et al.. Engaging Spect-actors with Multimodal Digital Puppetry. NordiCHI '10: 6th Nordic Conference on Human-Computer Interaction, Oct 2010, Reykjavik, Iceland. pp.138-147, ⟨10.1145/1868914.1868934⟩. ⟨hal-04447199⟩
18 Consultations
32 Téléchargements

Altmetric

Partager

More