Faster DAN: Multi-target Queries with Document Positional Encoding for End-to-end Handwritten Document Recognition - Archive ouverte HAL Accéder directement au contenu
Chapitre D'ouvrage Année : 2023

Faster DAN: Multi-target Queries with Document Positional Encoding for End-to-end Handwritten Document Recognition

Résumé

Recent advances in handwritten text recognition enabled to recognize whole documents in an end-to-end way: the Document Attention Network (DAN) recognizes the characters one after the other through an attention-based prediction process until reaching the end of the document. However, this autoregressive process leads to inference that cannot benefit from any parallelization optimization. In this paper, we propose Faster DAN, a two-step strategy to speed up the recognition process at prediction time: the model predicts the first character of each text line in the document, and then completes all the text lines in parallel through multi-target queries and a specific document positional encoding scheme. Faster DAN reaches competitive results compared to standard DAN, while being at least 4 times faster on whole single-page and double-page images of the RIMES 2009, READ 2016 and MAURDOR datasets. Source code and trained model weights are available at https://github.com/FactoDeepLearning/FasterDAN.

Dates et versions

hal-03957156 , version 1 (26-01-2023)

Identifiants

Citer

Denis Coquenet, Clément Chatelain, Thierry Paquet. Faster DAN: Multi-target Queries with Document Positional Encoding for End-to-end Handwritten Document Recognition. Document Analysis and Recognition - ICDAR 2023, 14190, Springer Nature Switzerland, pp.182-199, 2023, Lecture Notes in Computer Science, ⟨10.1007/978-3-031-41685-9_12⟩. ⟨hal-03957156⟩
44 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More