3D reconstruction for tele-immersion in 360° live stream - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

3D reconstruction for tele-immersion in 360° live stream

Résumé

Nowadays, most volumetric tele-immersion systems are based on a multi-camera system to capture a dynamic 3D place. With these acquisition devices, the development of a mobile tele-immersion system seems compromised, as a lot of equipment would have to be moved. One promising way to achieve a mobile system would be to use a single 360° camera and develop ways of reconstructing in 3D a dynamic scene in real time from a single point of view. Therefore, we propose an approach to freely navigate into a 360° video captured with a static camera. The approach considers three types of elements in the scene, the environment, the object of interest and the people, and relies on a different 3D representation for each type of element. Distinguishing the scene elements enables a real-time method to be adopted, by reconstructing static elements once and using fast-computable 3D representations for dynamic elements. As the method is real-time, we develop a streaming pipeline to enable XR users to move live within the camera stream.
Fichier principal
Vignette du fichier
167-175.pdf (2.98 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04481691 , version 1 (28-02-2024)

Identifiants

Citer

Clément Dluzniewski, Hakim Chekirou, Jérémie Le Garrec, Claude Andriot, Frédéric Noël. 3D reconstruction for tele-immersion in 360° live stream. ICAT-EGVE 2023 - International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments, Dec 2023, Dublin, Ireland. ⟨10.2312/egve.20231325⟩. ⟨hal-04481691⟩
35 Consultations
2 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More