SIFT-AID: BOOSTING SIFT WITH AN AFFINE INVARIANT DESCRIPTOR BASED ON CONVOLUTIONAL NEURAL NETWORKS - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE International Conference on Image Processing Année : 2019

SIFT-AID: BOOSTING SIFT WITH AN AFFINE INVARIANT DESCRIPTOR BASED ON CONVOLUTIONAL NEURAL NETWORKS

Résumé

The classic approach to image matching consists in the detection , description and matching of keypoints. The descriptor encodes the local information around the keypoint. An advantage of local approaches is that viewpoint deformations are well approximated by affine maps. This motivated the quest for affine invariant local descriptors. Despite numerous efforts, such descriptors remained elusive, ultimately resulting in the compromise of using viewpoint simulations to attain affine invariance. In this work we propose a CNN-based patch descriptor which captures affine invariance without the need for viewpoint simulations. This is achieved by training a neural network to associate similar vectorial representations to patches related by affine transformations. During matching , these vectors are compared very efficiently. The invari-ance to translation, rotation and scale is still obtained by the first stages of SIFT, which produce the keypoints. The proposed descriptor outperforms the state-of-the-art in retaining affine invariant properties.
Fichier principal
Vignette du fichier
siftaid.pdf (1.6 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02016010 , version 1 (12-02-2019)
hal-02016010 , version 2 (22-05-2019)

Identifiants

  • HAL Id : hal-02016010 , version 2

Citer

Mariano Rodríguez, Gabriele Facciolo, Rafael Grompone von Gioi, Pablo Musé, Jean-Michel Morel, et al.. SIFT-AID: BOOSTING SIFT WITH AN AFFINE INVARIANT DESCRIPTOR BASED ON CONVOLUTIONAL NEURAL NETWORKS. IEEE International Conference on Image Processing, 2019, https://doi.org/10.1109/ICIP.2019.8803425. ⟨hal-02016010v2⟩
218 Consultations
534 Téléchargements

Partager

Gmail Facebook X LinkedIn More