Journal Articles International Journal of Computer Vision Year : 2022

Spatially-consistent Feature Matching and Learning for Heritage Image Analysis

Xi Shen
  • Function : Author
  • PersonId : 173126
  • IdHAL : xi-shen
Robin Champenois
  • Function : Author
  • PersonId : 1395013
  • IdHAL : rchampenois
Spyros Gidaris
  • Function : Author
Marie-Françoise Limon
  • Function : Author
  • PersonId : 1434318
  • IdRef : 07804846X
K Bender
  • Function : Author
Mathieu Aubry
Marc H. Smith
  • Function : Author
  • PersonId : 917541

Abstract

Progress in the digitization of cultural assets leads to online databases that become too large for a human to analyze. Moreover, some analyses might be challenging, even for experts. In this paper, we explore two applications of computer vision to analyze historical data: watermark recognition and one-shot repeated pattern detection in artwork collections. Both problems present computer vision challenges which we believe to be representative of the ones encountered in cultural heritage applications: limited supervision is available, the tasks are fine-grained recognition, and the data comes in several different modalities. Both applications are also highly practical, as recognizing watermarks makes it possible to date and locate documents, while detecting repeated patterns allows exploring visual links between artworks. We demonstrate on both tasks the benefits of relying on deep mid-level features. More precisely, we define an image similarity score based on geometric verification of mid-level features and show how spatial consistency can be used to fine-tune out-of-the-box features for the target dataset with weak or no supervision. This paper relates and extends our previous works. Our code and data are available at \url{http://imagine.enpc.fr/~shenx/HisImgAnalysis/}.
Fichier principal
Vignette du fichier
IJCV_HisImgAnalysis.pdf (12) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03620996 , version 1 (27-03-2022)
hal-03620996 , version 2 (30-03-2022)

Identifiers

Cite

Xi Shen, Robin Champenois, Shiry Ginosar, Ilaria Pastrolin, Morgane Rousselot, et al.. Spatially-consistent Feature Matching and Learning for Heritage Image Analysis. International Journal of Computer Vision, 2022, ⟨10.1007/s11263-022-01576-x⟩. ⟨hal-03620996v2⟩
357 View
178 Download

Altmetric

Share

More