Fine scale image registration in large-scale urban LIDAR point sets - Archive ouverte HAL Access content directly
Journal Articles Computer Vision and Image Understanding Year : 2017

Fine scale image registration in large-scale urban LIDAR point sets


Urban scenes acquisition is very often performed using laser scanners onboard a vehicle. In parallel, color information is also acquired through a set of coarsely aligned camera pictures. The question of combining both measures naturally arises for adding color to the 3D points or enhancing the geometry, but it faces important challenges. Indeed, 3D geometry acquisition is highly accurate while the images suffer from distortion and are only coarsely registered to the geometry. In this paper, we introduce a two-step method to register images to large-scale complex point clouds. Our method performs the image-to-geometry registration by iteratively registering the real image to a synthetic image obtained from the estimated camera pose and the point cloud, using either reflectance or normal information. First a coarse registration is performed by generating a wide-angle synthetic image and considering that small pitch and yaw rotations can be estimated as translations in the image plane. Then a fine registration is performed using a new image metric which is adapted to the difference of modality between the real and synthetic images. This new image metric is more resilient to missing data and large transformations than standard Mutual Information. In the process, we also introduce a method to generate synthetic images from a 3D point cloud that is adapted to large-scale urban scenes with occlusions and sparse areas. The efficiency of our algorithm is demonstrated both qualitatively and quantitatively on datasets of urban scans and associated images.
Fichier principal
Vignette du fichier
article.pdf (72.13 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01468091 , version 1 (28-06-2017)



Maximilien Guislain, Julie Digne, Raphaëlle Chaine, Gilles Monnier. Fine scale image registration in large-scale urban LIDAR point sets. Computer Vision and Image Understanding, 2017, Special Issue on Large-Scale 3D Modeling of Urban Indoor or Outdoor Scenes from Images and Range Scans, 157, pp.90-102. ⟨10.1016/j.cviu.2016.12.004⟩. ⟨hal-01468091⟩
417 View
171 Download



Gmail Facebook X LinkedIn More