An Integrated Framework for Understanding Multimodal Embodied Experiences in Interactive Virtual Reality - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

An Integrated Framework for Understanding Multimodal Embodied Experiences in Interactive Virtual Reality

Résumé

Virtual Reality (VR) technology enables ``embodied interactions'' in realistic environments where users can freely move and interact, with deep physical and emotional states. However, a comprehensive understanding of the embodied user experience is currently limited by the extent to which one can make relevant observations, and the accuracy at which observations can be interpreted. Paul Dourish proposed a way forward through the characterisation of embodied interactions in three senses: ontology, intersubjectivity, and intentionality. In a joint effort between computer and neuro-scientists, we built a framework to design studies that investigate multimodal embodied experiences in VR, and apply it to study the impact of simulated low-vision on user navigation. Our methodology involves the design of 3D scenarios annotated with an ontology, modelling intersubjective tasks, and correlating multimodal metrics such as gaze and physiology to derive intentions. We show how this framework enables a more fine-grained understanding of embodied interactions in behavioural research.
Fichier principal
Vignette du fichier
IMX.pdf (5.11 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence
Copyright (Tous droits réservés)

Dates et versions

hal-04102737 , version 1 (22-05-2023)
hal-04102737 , version 2 (16-06-2023)

Licence

Copyright (Tous droits réservés)

Identifiants

Citer

Florent Alain Sauveur Robert, Hui-Yin Wu, Lucile Sassatelli, Stephen Ramanoel, Auriane Gros, et al.. An Integrated Framework for Understanding Multimodal Embodied Experiences in Interactive Virtual Reality. 2023 IMX - ACM International Conference on Interactive Media Experiences, Jun 2023, Nantes, France. https://dl.acm.org/conference/imx, ⟨10.1145/3573381.3596150⟩. ⟨hal-04102737v2⟩
426 Consultations
217 Téléchargements

Altmetric

Partager

More