When to Use OCR Post-correction for Named Entity Recognition? - Archive ouverte HAL
Chapitre D'ouvrage Année : 2020

When to Use OCR Post-correction for Named Entity Recognition?

Résumé

In the last decades, a huge number of documents has been digitised, before undergoing optical character recognition (OCR) to extract their textual content. This step is crucial for indexing the documents and to make the resulting collections accessible. However, the fact that documents are indexed through their OCRed content is posing a number of problems, due to the varying performance of OCR methods over time. Indeed, OCR quality has a considerable impact on the indexing and therefore the accessibility of digital documents. Named entities are among the most adequate information to index documents, in particular in the case of digital libraries, for which log analysis studies have shown that around 80% of user queries include a named entity. Taking full advantage of the computational power of modern natural language processing (NLP) systems, named entity recognition (NER) can be operated over enormous OCR corpora efficiently. Despite progress in OCR, resulting text files still have misrecognised words (or noise for short) which are harming NER performance. In this paper, to handle this challenge, we apply a spelling correction method to noisy versions of a corpus with variable OCR error rates in order to quantitatively estimate the contribution of post-OCR correction to NER. Our main finding is that we can indeed consistently improve the performance of NER when the OCR quality is reasonable (error rates respectively between 2% and 10% for characters (CER) and between 10% and 25% for words (WER)). The noise correction algorithm we propose is both language-independent and with low complexity.
Fichier principal
Vignette du fichier
ICADL_2020__Contribution_of_post_ocr_correction_on_NER(1).pdf (534.04 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03034484 , version 1 (01-12-2020)

Identifiants

Citer

Vinh-Nam Huynh, Ahmed Hamdi, Antoine Doucet. When to Use OCR Post-correction for Named Entity Recognition?. 22nd International Conference on Asia-Pacific Digital Libraries, ICADL 2020, pp.33-42, 2020, ⟨10.1007/978-3-030-64452-9_3⟩. ⟨hal-03034484⟩

Collections

L3I UNIV-ROCHELLE
457 Consultations
1511 Téléchargements

Altmetric

Partager

More