Stroke-Level Graph Labeling with Edge-weighted Graph Attention Network for Handwritten Mathematical Expression Recognition - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

Stroke-Level Graph Labeling with Edge-weighted Graph Attention Network for Handwritten Mathematical Expression Recognition

Résumé

Handwritten Mathematic Expression Recognition (HMER) algorithms with deep learning approaches have developed rapidly in recent years, most algorithms are dependent on heavy pre-training and also complex network structures. Existing architectures are build on encoder-decoder from on-line or off-line inputs to produce LATEX markup strings, or stroke-level graphs to generate symbol-level graphs. They all remain on a latent space, which is not directly related to the input data: the strokes. Using the Stroke Label Graph modelisation allows a direct connection between the input data and the output labels. In this research, we proposed a novel stroke-level graph labeling method with edge-weighted graph attention network (EGAT). This lightweight model doesn't rely on any pre-training, abandons the laborious process of encoder-decoder, is totaly end-to-end, directly accomplishes stroke-to-stroke feature extraction, and produces strokes and relations classification. Experiments show that our proposed EGAT algorithm can effectively fuse the node features as well as the weighted edge features, and predict the node and edge attributes simultaneously.
Fichier principal
Vignette du fichier
0169.pdf (424.75 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04694726 , version 1 (11-09-2024)

Identifiants

Citer

Yejing Xie, Harold Mouchère. Stroke-Level Graph Labeling with Edge-weighted Graph Attention Network for Handwritten Mathematical Expression Recognition. International Conference on Document Analysis and Recognition, Sep 2024, Athenes, Grece, Greece. pp.38-55, ⟨10.1007/978-3-031-70549-6_3⟩. ⟨hal-04694726⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

Gmail Mastodon Facebook X LinkedIn More