Towards Foveated Rendering For Immersive Remote Telerobotics - Archive ouverte HAL
Communication Dans Un Congrès Année : 2022

Towards Foveated Rendering For Immersive Remote Telerobotics

D Mazzanti
S Anastasi
D Caldwell
P Fiorini
N Deshpande

Résumé

In remote telerobotics applications, real-time 3D perception through RGB-D cameras (real-time 3D reconstruction, point-clouds), and its rendering inside modern virtual reality (VR) environments, can enhance a user's sense of presence and immersion in a remote scene. However, this approach requires that the whole pipeline from sensor data acquisition to VR rendering satisfy the speed, throughput, and visual quality requirements. Point-cloud data suffers from network latency and throughput limitations that can negatively impact user experience. In this research, the human visual system was taken as an inspiration to address this problem. Human eyes have their sharpest visual acuity at the center of their fieldof-view, which falls off at the periphery. A remote 3D data visualization framework is proposed that utilizes this acuity fall-off to facilitate the processing, transmission, buffering, and rendering in VR of dense point-clouds / 3D reconstructed scenes. The proposed framework shows significant reductions in latency and throughput needs, higher than 60% in both. A preliminary user study shows that the framework does not significantly affect the perceived visual quality.
Fichier principal
Vignette du fichier
foveated.pdf (5.4 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03610377 , version 1 (16-03-2022)

Identifiants

  • HAL Id : hal-03610377 , version 1

Citer

Y Tefera, D Mazzanti, S Anastasi, D Caldwell, P Fiorini, et al.. Towards Foveated Rendering For Immersive Remote Telerobotics. The International Workshop on Virtual, Augmented, and Mixed-Reality for Human-Robot Interactions at HRI 2022, Mar 2022, Sapporo, Hokkaido, Japan. ⟨hal-03610377⟩
117 Consultations
66 Téléchargements

Partager

More