Rotation and translation covariant match kernels for image retrieval - Archive ouverte HAL Access content directly
Journal Articles Computer Vision and Image Understanding Year : 2015

Rotation and translation covariant match kernels for image retrieval


Most image encodings achieve orientation invariance by aligning the patches to their dominant orientations and translation invariance by completely ignoring patch position or by max-pooling. Albeit successful, such choices introduce too much invariance because they do not guarantee that the patches are rotated or translated consistently. In this paper, we propose a geometric-aware aggregation strategy, which jointly encodes the local descriptors together with their patch dominant angle or location. The geometric attributes are encoded in a continuous manner by leveraging explicit feature maps. Our technique is compatible with generic match kernel formulation and can be employed along with several popular encoding methods, in particular Bag-of-Words, VLAD and the Fisher vector. The method is further combined with an efficient monomial embedding to provide a codebook-free method aggregating local descriptors into a single vector representation. Invariance is achieved by efficient similarity estimation of multiple rotations or translations, offered by a simple trigonometric polynomial. This strategy is effective for image search, as shown by experiments performed on standard benchmarks for image and particular object retrieval, namely Holidays and Oxford buildings.
Fichier principal
Vignette du fichier
ToliasBursucFuronJegou_CVIU2015_Rotation and translation covariant match kernels for image retrieval.pdf (1.69 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01168525 , version 1 (25-08-2015)



Giorgos Tolias, Andrei Bursuc, Teddy Furon, Hervé Jégou. Rotation and translation covariant match kernels for image retrieval. Computer Vision and Image Understanding, 2015, pp.15. ⟨10.1016/j.cviu.2015.06.007⟩. ⟨hal-01168525⟩
606 View
772 Download



Gmail Facebook Twitter LinkedIn More