Self-Supervised Deep Metric Learning for ancient papyrus fragments retrieval - Archive ouverte HAL Access content directly
Journal Articles International Journal on Document Analysis and Recognition Year : 2021

Self-Supervised Deep Metric Learning for ancient papyrus fragments retrieval

Abstract

This work focuses on document fragments association using Deep Metric Learning methods. More precisely, we are interested in ancient papyri fragments that need to be reconstructed prior to their analysis by papyrologists. This is a challenging task to automatize using machine learning algorithms because labeled data is rare, often incomplete, imbalanced and of inconsistent conservation states. However, there is a real need for such software in the papyrology community as the process of reconstructing the papyri by hand is extremely time consuming and tedious. In this paper, we explore ways in which papyrologists can obtain useful matching suggestion on new data using Deep Convolutional Siamese-Networks. We emphasize on low-to-no human intervention for annotating images. We show that the from-scratch self-supervised approach we propose is more effective than using knowledge transfer from a large dataset, the former achieving a top-1 accuracy score of 0.73 on a retrieval task involving 800 fragments. The research leading to this results has received funding from the European Research Council (ERC) under the European Union's Horizon 2020 research and innovation program under grant agreement No 758907 and is part of the GESHAEM project, hosted by the Ausonius Institute. The source code (upon request) and data used in this article is available at https://morphoboid.labri.fr/ self-supervised-papyrus.html
Fichier principal
Vignette du fichier
IJDAR2021.pdf (8.04 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03260782 , version 1 (15-06-2021)

Identifiers

  • HAL Id : hal-03260782 , version 1

Cite

Antoine Pirrone, Marie Beurton-Aimar, Nicholas Journet. Self-Supervised Deep Metric Learning for ancient papyrus fragments retrieval. International Journal on Document Analysis and Recognition, 2021. ⟨hal-03260782⟩

Collections

CNRS
101 View
81 Download

Share

Gmail Facebook X LinkedIn More