3D High Dynamic Range Dense Visual SLAM and Its Application to Real-time Object Re-lighting - Archive ouverte HAL Access content directly
Conference Papers Year : 2013

3D High Dynamic Range Dense Visual SLAM and Its Application to Real-time Object Re-lighting

Abstract

Acquiring High Dynamic Range (HDR) light-fields from several images with different exposures (sensor integration periods) has been widely considered for static camera positions. In this paper a new approach is proposed that enables 3D HDR environment maps to be acquired directly from a dynamic set of images in real-time. In particular a method will be proposed to use an RGB-D camera as a dynamic light-field sensor, based on a dense real-time 3D tracking and mapping approach, that avoids the need for a light-probe or the observation of reflective surfaces. The 6dof pose and dense scene structure will be estimated simultaneously with the observed dynamic range so as to compute the radiance map of the scene and fuse a stream of low dynamic range images (LDR) into an HDR image. This will then be used to create an arbitrary number of virtual omni-directional light-probes that will be placed at the positions where virtual augmented objects will be rendered. In addition, a solution is provided for the problem of automatic shutter variations in visual SLAM. Augmented reality results are provided which demonstrate real-time 3D HDR mapping, virtual light-probe synthesis and light source detection for rendering reflective objects with shadows seamlessly with the real video stream in real-time.
Fichier principal
Vignette du fichier
ismar2013.pdf (1.35 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01357357 , version 1 (27-03-2019)

Identifiers

Cite

Maxime Meilland, Christian Barat, Andrew I. Comport. 3D High Dynamic Range Dense Visual SLAM and Its Application to Real-time Object Re-lighting. International Symposium on Mixed and Augmented Reality, Oct 2013, Adelaide, Australia. ⟨10.1109/ISMAR.2013.6671774⟩. ⟨hal-01357357⟩
214 View
268 Download

Altmetric

Share

Gmail Facebook X LinkedIn More