Communication Dans Un Congrès Année : 2025

A Multi-Criteria Approach for Gaze Analysis Similarity in Paintings

Résumé

In the fields of art history and visual semiotics, analysing gazes in paintings is important to understand the artwork, and to find semantic relationships between several paintings. Thanks to digitization and museum initiatives, the volume of datasets on artworks continues to expand, enabling new avenues for exploration and research. Artificial neural networks, trained on large datasets are able to extract complex features, and visually compare artworks. This comparison could be done by focusing on the objects present in the paintings, and matching paintings with high object co-occurrence. Our research takes this further by studying the way objects are viewed by characters in the scene. This study proposes a new approach that combines methods for gazebased and visual-based similarity, to encode and use gaze information for finding similar paintings, while maintaining a close visual aspect. Experimental results which integrate the opinions of domain experts, show that these methods complement each other. Quantitative and qualitative assessments confirm the results from the combination of gaze and visual analysis. Thus, this method improves existing visual similarity queries and opens up new possibilities to retrieve similar paintings according to user-specific criteria.

Fichier principal
Vignette du fichier
VISAPP_2025_145_CR-4.pdf (11.68 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05038588 , version 1 (17-04-2025)

Licence

Identifiants

Citer

Tess Masclef, Mihaela Scuturici, Tetiana Yemelianenko, Serge Miguet. A Multi-Criteria Approach for Gaze Analysis Similarity in Paintings. 20th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Feb 2025, Porto (Portugal), Portugal. pp.123-134, ⟨10.5220/0013152800003912⟩. ⟨hal-05038588⟩
158 Consultations
301 Téléchargements

Altmetric

Partager

  • More