Layout- and Activity-based Textbook Modeling for Automatic PDF Textbook Extraction - Archive ouverte HAL
Communication Dans Un Congrès Année : 2023

Layout- and Activity-based Textbook Modeling for Automatic PDF Textbook Extraction

Résumé

Ensuring accessible textbooks for children with disabilities is essential for inclusive education. However, providing native accessibility for educational content remains a challenge. In the mean time, existing educational materials need to be adapted, for example by providing interactive versions to overcome difficulties caused by disabilities. In this context, our project aims to automatically adapt PDF textbooks to make them accessible to children with disabilities. The first step towards this adaptation involves extracting and structuring the content of textbooks. In this paper, we introduce textbook models, propose an automated extraction pipeline, and conduct preliminary experiments. Our textbook models are based on the various activities involved and provide layout and semantic information. They enable normalized and structured representations of educational content at both document and page levels, facilitating the automatic extraction process and the conversion to popular formats such as TEI and DocBook. In order to automatically extract PDF textbooks structure, our experiments, using a state-of-the-art multimodal transformer for a token classification task, demonstrate promising results. However, these experiments also highlight the difficulty of the task, especially cross-textbook collection generalization. Finally, we discuss the extraction pipeline and the directions of future work.
Fichier principal
Vignette du fichier
layout-and-activity-based-textbook-modeling-for-automatic-textbook-extraction.pdf (2.04 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Licence

Dates et versions

hal-04184895 , version 1 (22-08-2023)

Licence

Identifiants

  • HAL Id : hal-04184895 , version 1

Citer

Elise Lincker, Olivier Pons, Camille Guinaudeau, Isabelle Barbet, Jérôme Dupire, et al.. Layout- and Activity-based Textbook Modeling for Automatic PDF Textbook Extraction. Intelligent Textbooks 2023, Jul 2023, Tokyo, Japan. pp.37-53. ⟨hal-04184895⟩
191 Consultations
130 Téléchargements

Partager

More