Setting up a Competition Framework for the Evaluation of Structure Extraction from OCR-ed Books
Résumé
This paper describes the setup of the Book Structure Ex- traction competition run at ICDAR 2009. The goal of the competition was to evaluate and compare automatic techniques for deriving struc- ture information from digitized books, which could then be used to aid navigation inside the books. More speci cally, the task that participants faced was to construct hyperlinked tables of contents for a collection of 1,000 digitized books. This paper describes the setup of the competition and its challenges. It introduces and discusses the book collection used in the task, the collaborative construction of the ground truth, the eval- uation measures and the evaluation results. The paper also introduces a data set to be used freely for research evaluation purposes.
Domaines
Traitement du texte et du document
Origine : Fichiers produits par l'(les) auteur(s)
Loading...