Perceiving and rendering users in a 3D interaction - Archive ouverte HAL
Communication Dans Un Congrès IHCI 2010 : Second IEEE International Conference on Intelligent Human Computer Interaction Année : 2012

Perceiving and rendering users in a 3D interaction

Résumé

In a computer supported distant collaboration, communication between users can be enhanced with a visual channel. Plain videos of individual users unfortunately fail to render their joint actions on the objects they share, which limits their mutual perception. Remote interaction can be enhanced by immersing user representations (avatars) and the shared objects in a networked 3D virtual environment, so user actions are rendered by avatar mimicry. Communication gesture (not actions) are captured by real-time computer vision and rendered. We have developed a system based on a single-webcam for body and face 3D motion capture. We have used a library of communication gestures to learn statistical gesture models and used them as prior constraints for monocular motion capture, so improving tracking ambiguous poses and rendering some motion details. We have developed an open source library for real-time image analysis and computer vision that supports acceleration by consumer graphical processing units (GPUs). Finally, users are rendered with low-bandwidth avatar animation, thus opening the path to low-cost remote virtual presence at home.
Fichier principal
Vignette du fichier
IHCI_2010_-_Horain_et_al.pdf (734.72 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-00836606 , version 1 (21-06-2013)

Identifiants

  • HAL Id : hal-00836606 , version 1

Citer

Patrick Horain, José Marques Soares, Dianle Zhou, Zhenbo Li, David Antonio Gomez Jauregui, et al.. Perceiving and rendering users in a 3D interaction. IHCI 2010 : Second IEEE International Conference on Intelligent Human Computer Interaction, Jan 2010, Allahabad, India. pp.42-53. ⟨hal-00836606⟩
138 Consultations
323 Téléchargements

Partager

More