Online Handwritten Mathematical Expressions Recognition by Merging Multiple 1D Interpretations - Archive ouverte HAL Access content directly
Conference Papers Year :

Online Handwritten Mathematical Expressions Recognition by Merging Multiple 1D Interpretations

Abstract

—In this work, we propose to recognize handwritten mathematical expressions by merging multiple 1D sequences of labels produced by a sequence labeler. The proposed solution aims at rebuilding a 2D expression from several 1D labeled paths. An online math expression is a sequence of strokes which is later used to build a graph considering both temporal and spatial orders among these strokes. In this graph, node corresponds to stroke and edge denotes the relationship between a pair of strokes. Next, we select 1D paths from the built graph with the expectation that these paths could catch all the strokes and the relationships between pairs of strokes. As an advanced and strong sequence classifier, BLSTM networks are adopted to label the selected 1D paths. We set different weights to these 1D labeled paths and then merge them to rebuild a label graph. After that, an additional post-process will be performed to complete the edges automatically. We test the proposed solution and compare the results to the state of art in online math expression recognition domain.
Not file

Dates and versions

hal-01374392 , version 1 (30-09-2016)

Identifiers

  • HAL Id : hal-01374392 , version 1

Cite

Ting Zhang, Harold Mouchère, Christian Viard-Gaudin. Online Handwritten Mathematical Expressions Recognition by Merging Multiple 1D Interpretations. International Conference on Frontiers in Handwriting Recognition (ICFHR), Oct 2016, Shenzhen, China. ⟨hal-01374392⟩
149 View
0 Download

Share

Gmail Facebook Twitter LinkedIn More