A transformer-based siamese network for word image retrieval in historical documents - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

A transformer-based siamese network for word image retrieval in historical documents

Résumé

The increasing availability of digitized historical documents has sparked a need for effective information processing tools to extract the valuable information contained within them. Word spotting, an area of focus in historical document analysis, involves identifying specific words within images of documents. In this paper, we propose a novel approach for word spotting in historical Arabic documents, utilizing improved feature representations for learning word images. More precisely, we put forward an end-to-end approach for generating word image descriptors, based on the Siamese vision transformer architectures. The model learning is guided by a contrastive loss objective. Additionally, we carry out transfer learning techniques by leveraging knowledge acquired from two distinct source domains to generalize model learning. The proposed approach utilizes the embedding space to evolve the word spotting system by projecting the query word image and all reference word images into the embedding space, where their similarity is determined based on their corresponding embedding vectors. Our method is evaluated on the historical Arabic VML-HD dataset and the results indicate that our approach significantly outperforms state-of-the-art methods.
Fichier principal
Vignette du fichier
2023 Fathallah et al. - Transformer-based Siamese Network for Word Image Retrieval In Historical Documents.pdf (836.02 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04655283 , version 1 (21-07-2024)

Identifiants

Citer

Abir Fathallah, Mounim El Yacoubi, Najoua Essoukri Ben Amara. A transformer-based siamese network for word image retrieval in historical documents. 2023 IEEE Smart World Congress (SWC), Aug 2023, Portsmouth, United Kingdom. pp.696-703, ⟨10.1109/SWC57546.2023.10449180⟩. ⟨hal-04655283⟩
25 Consultations
7 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More