Learning geometric soft constraints for multi-view instance matching across street-level panoramas - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Learning geometric soft constraints for multi-view instance matching across street-level panoramas

Résumé

We present a new approach for matching tree instances across multiple street-view panorama images for the ultimate goal of city-scale street-tree mapping with high positioning accuracy. What makes this task challenging is the strong change in viewpoint , different lighting conditions, high similarity of neighboring trees, and variability in scale. We propose to turn (tree) instance matching into a learning task, where image-appearance and geometric relationships between views fruitfully interact. Our approach constructs a siamese convolutional neural network that learns to match two views of the same tree given many candidate tree image cutouts and geographic information of the two panorama images. In addition to image features, we propose utilizing location information about the camera and the tree. Our method is compared to existing patch matching methods to prove its edge over state-of-the-art. This takes us one step closer to the ultimate goal of city-wide tree mapping based solely on panorama imagery to benefit city administration.
Fichier principal
Vignette du fichier
jurse2019ahmed.pdf (2.94 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02343907 , version 1 (13-11-2019)

Identifiants

Citer

Ahmed Samy Nassar, Nico Lang, Sébastien Lefèvre, Jan Wegner. Learning geometric soft constraints for multi-view instance matching across street-level panoramas. 2019 Joint Urban Remote Sensing Event (JURSE), May 2019, Vannes, France. pp.1-4, ⟨10.1109/JURSE.2019.8808935⟩. ⟨hal-02343907⟩
184 Consultations
92 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More