Learning to rank approach for refining image retrieval in visual arts - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Learning to rank approach for refining image retrieval in visual arts

Résumé

Modern content-based image retrieval systems demonstrate rather good performance in identifying visually similar artworks. However, this task becomes more challenging when art history specialists aim to refine the list of similar artworks based on their criteria, thus we need to train the model to reproduce this refinement. In this paper, we propose an approach for improving the list of similar paintings according to specific simulated criteria. By this approach, we retrieve paintings similar to a request image using ResNet50 model and ANNOY algorithm. Then, we simulate re-ranking based on the two criteria, and use the re-ranked lists for training LambdaMART model. Finally, we demonstrate that the trained model reproduces the re-ranking for the query painting by the specific criteria. We plan to use the proposed approach for reproducing re-rankings made by art history specialists, when this data will be collected.
Fichier principal
Vignette du fichier
ICCV23_workshop (1).pdf (6.3 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04216811 , version 1 (25-09-2023)

Identifiants

  • HAL Id : hal-04216811 , version 1

Citer

Tetiana Yemelianenko, Iuliia Tkachenko, Tess Masclef, Mihaela Scuturici, Serge Miguet. Learning to rank approach for refining image retrieval in visual arts. 4th ICCV Workshop on e-Heritage, Oct 2023, Paris, France. ⟨hal-04216811⟩
65 Consultations
48 Téléchargements

Partager

Gmail Facebook X LinkedIn More