Layout- and Activity-based Textbook Modeling for Automatic PDF Textbook Extraction - Archive ouverte HAL
Conference Papers Year : 2023

Layout- and Activity-based Textbook Modeling for Automatic PDF Textbook Extraction

Abstract

Ensuring accessible textbooks for children with disabilities is essential for inclusive education. However, providing native accessibility for educational content remains a challenge. In the mean time, existing educational materials need to be adapted, for example by providing interactive versions to overcome difficulties caused by disabilities. In this context, our project aims to automatically adapt PDF textbooks to make them accessible to children with disabilities. The first step towards this adaptation involves extracting and structuring the content of textbooks. In this paper, we introduce textbook models, propose an automated extraction pipeline, and conduct preliminary experiments. Our textbook models are based on the various activities involved and provide layout and semantic information. They enable normalized and structured representations of educational content at both document and page levels, facilitating the automatic extraction process and the conversion to popular formats such as TEI and DocBook. In order to automatically extract PDF textbooks structure, our experiments, using a state-of-the-art multimodal transformer for a token classification task, demonstrate promising results. However, these experiments also highlight the difficulty of the task, especially cross-textbook collection generalization. Finally, we discuss the extraction pipeline and the directions of future work.
Fichier principal
Vignette du fichier
layout-and-activity-based-textbook-modeling-for-automatic-textbook-extraction.pdf (2.04 Mo) Télécharger le fichier
Origin Publisher files allowed on an open archive
Licence

Dates and versions

hal-04184895 , version 1 (22-08-2023)

Licence

Identifiers

  • HAL Id : hal-04184895 , version 1

Cite

Elise Lincker, Olivier Pons, Camille Guinaudeau, Isabelle Barbet, Jérôme Dupire, et al.. Layout- and Activity-based Textbook Modeling for Automatic PDF Textbook Extraction. Intelligent Textbooks 2023, Jul 2023, Tokyo, Japan. pp.37-53. ⟨hal-04184895⟩
183 View
124 Download

Share

More