RGB-D IBR: rendering indoor scenes using sparse RGB-D images with local alignments - Ecole Nationale du Génie de l'Eau et de l'Environnement de Strasbourg Accéder directement au contenu
Communication Dans Un Congrès Année : 2016

RGB-D IBR: rendering indoor scenes using sparse RGB-D images with local alignments

Résumé

This paper presents an image-based rendering (IBR) system based on RGB-D images. The input of our system consists of RGB-D images captured at sparse locations in the scene and can be expanded by adding new RGB-D images. The sparsity of RGB-D images increases the usability of our system as the user need not capture a RGB-D image stream in a single shot, which may require careful planning for a hand-held camera. Our system begins with a single RGB-D image and images are incrementally added one by one. For each newly added image, a batch process is performed to align it with previously added images. The process does not include a global alignment step, such as bundle adjustment, and can be completed quickly by computing only local alignments of RGB-D images. Aligned images are represented as a graph, where each node is an input image and an edge contains relative pose information between nodes. A novel view image is rendered by picking the nearest input as the reference image and then blending the neighboring images based on depth information in real time. Experimental results with indoor scenes using Microsoft Kinect demonstrate that our system can synthesize high quality novel view images from a sparse set of RGB-D images.
Fichier non déposé

Dates et versions

hal-03144898 , version 1 (17-02-2021)

Identifiants

Citer

Yeongyu Jeong, Haejoon Kim, Hyewon Seo, Frederic Cordier, Seungyong Lee. RGB-D IBR: rendering indoor scenes using sparse RGB-D images with local alignments. 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (2016-02-27, 2016-02-28: Redmond, Washington, US), Feb 2016, New-York, United States. pp.205-206, ⟨10.1145/2856400.2876006⟩. ⟨hal-03144898⟩
28 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More