Transformers for Historical Handwritten Text Recognition - Archive ouverte HAL Access content directly
Conference Papers Year : 2021

Transformers for Historical Handwritten Text Recognition


Handwritten documents are recently getting more and more publicly available, but searching efficiently information through them is difficult. Handwritten Text Recognition systems automatically transcribe documents and offer excellent solutions to make the content of handwritten documents available. Neural networks are currently the state-of-the-art approaches for this task. Recently, Transformer architectures have gained in popularity in many fields. We present the works we have done so far toward an efficient architecture using transformer layers for the field of Handwritten Text Recognition. Architectures using Transformer for Handwritten Text Recognition are presented. Our architectures aim to replace recurrent layers with transformers, while combining optical recognition and language modeling in end-to-end model. We manage to obtain state-of-the-art results on the IAM dataset with one of our architecture.
Fichier principal
Vignette du fichier
Transformers_for_Historical_Handwritten_Text_Recognition.pdf (258.71 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03485262 , version 1 (17-12-2021)


  • HAL Id : hal-03485262 , version 1


Killian Barrere, Yann Soullard, Aurélie Lemaitre, Bertrand Coüasnon. Transformers for Historical Handwritten Text Recognition. Doctoral Consortium - ICDAR 2021, Nibal Nayef and Jean-Christophe Burie, Sep 2021, Lausanne, Switzerland. ⟨hal-03485262⟩
200 View
592 Download


Gmail Facebook X LinkedIn More