Bi-objective Framework for Sensor Fusion in RGB-D Multi-View Systems: Applications in Calibration - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2021

Bi-objective Framework for Sensor Fusion in RGB-D Multi-View Systems: Applications in Calibration

Résumé

Complete and textured 3D reconstruction of dynamic scenes has been facilitated by mapped RGB and depth information acquired by RGB-D cameras based multi-view systems. One of the most critical steps in such multi-view systems is to determine the relative poses of all cameras via a process known as extrinsic calibration. In this work, we propose a sensor fusion framework based on a weighted bi-objective optimization for refinement of extrinsic calibration tailored for RGB-D multi-view systems. The weighted bi-objective cost function, which makes use of 2D information from RGB images and 3D information from depth images, is analytically derived via the Maximum Likelihood (ML) method. The weighting factor appears as a function of noise in 2D and 3D measurements and takes into account the affect of residual errors on the optimization. We propose an iterative scheme to estimate noise variances in 2D and 3D measurements, for simultaneously computing the weighting factor together with the camera poses. An extensive quantitative and qualitative evaluation of the proposed approach shows improved calibration performance as compared to refinement schemes which use only 2D or 3D measurement information.
Fichier principal
Vignette du fichier
1905.09939.pdf (4.52 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03132371 , version 1 (05-02-2021)

Identifiants

  • HAL Id : hal-03132371 , version 1

Citer

Hassan Afzal, Djamila Aouada, Michel Antunes, David Fofi, Bruno Mirbach, et al.. Bi-objective Framework for Sensor Fusion in RGB-D Multi-View Systems: Applications in Calibration. 2021. ⟨hal-03132371⟩
50 Consultations
26 Téléchargements

Partager

Gmail Facebook X LinkedIn More