A Light Transformer-Based Architecture for Handwritten Text Recognition - Archive ouverte HAL Access content directly
Conference Papers Year : 2022

A Light Transformer-Based Architecture for Handwritten Text Recognition


Transformer models have been showing groundbreaking results in the domain of natural language processing. More recently, they started to gain interest in many others fields as in computer vision. Traditional Transformer models typically require a significant amount of training data to achieve satisfactory results. However, in the domain of handwritten text recognition, annotated data acquisition remains costly resulting in small datasets compared to those commonly used to train a Transformer-based model. Hence, training Transformer models able to transcribe handwritten text from images remains challenging. We propose a light encoder-decoder Transformer-based architecture for handwriting text recognition, containing a small number of parameters compared to traditional Transformer architectures. We trained our architecture using a hybrid loss, combining the well-known connectionist temporal classification with the cross-entropy. Experiments are conducted on the well-known IAM dataset with and without the use of additional synthetic data. We show that our network reaches state-of-the-art results in both cases, compared with other larger Transformer-based models.
Fichier principal
Vignette du fichier
A_Light_Transformer_Based_Architecture_for_Handwritten_Text_Recognition.pdf (537.22 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03685976 , version 1 (02-06-2022)



Killian Barrere, Yann Soullard, Aurélie Lemaitre, Bertrand B. Coüasnon. A Light Transformer-Based Architecture for Handwritten Text Recognition. 15th IAPR International Workshop on Document Analysis Systems (DAS 2022), May 2022, La Rochelle, France. pp.275-290, ⟨10.1007/978-3-031-06555-2⟩. ⟨hal-03685976⟩
113 View
899 Download



Gmail Facebook X LinkedIn More