A Light Transformer-Based Architecture for Handwritten Text Recognition - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

A Light Transformer-Based Architecture for Handwritten Text Recognition

Résumé

Transformer models have been showing groundbreaking results in the domain of natural language processing. More recently, they started to gain interest in many others fields as in computer vision. Traditional Transformer models typically require a significant amount of training data to achieve satisfactory results. However, in the domain of handwritten text recognition, annotated data acquisition remains costly resulting in small datasets compared to those commonly used to train a Transformer-based model. Hence, training Transformer models able to transcribe handwritten text from images remains challenging. We propose a light encoder-decoder Transformer-based architecture for handwriting text recognition, containing a small number of parameters compared to traditional Transformer architectures. We trained our architecture using a hybrid loss, combining the well-known connectionist temporal classification with the cross-entropy. Experiments are conducted on the well-known IAM dataset with and without the use of additional synthetic data. We show that our network reaches state-of-the-art results in both cases, compared with other larger Transformer-based models.
Fichier principal
Vignette du fichier
A_Light_Transformer_Based_Architecture_for_Handwritten_Text_Recognition.pdf (537.22 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03685976 , version 1 (02-06-2022)

Identifiants

Citer

Killian Barrere, Yann Soullard, Aurélie Lemaitre, Bertrand B. Coüasnon. A Light Transformer-Based Architecture for Handwritten Text Recognition. 15th IAPR International Workshop on Document Analysis Systems (DAS 2022), May 2022, La Rochelle, France. pp.275-290, ⟨10.1007/978-3-031-06555-2⟩. ⟨hal-03685976⟩
143 Consultations
1142 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More