Out-of-the-Box and Into the Ditch? Multilingual Evaluation of Generic Text Extraction Tools - Archive ouverte HAL
Journal Articles Language Resources and Evaluation Conference (LREC 2020) Year : 2020

Out-of-the-Box and Into the Ditch? Multilingual Evaluation of Generic Text Extraction Tools

Abstract

This article examines extraction methods designed to retain the main text content of web pages and discusses how the extraction could be oriented and evaluated: can and should it be as generic as possible to ensure opportunistic corpus construction? The evaluation grounds on a comparative benchmark of open-source tools used on pages in five different languages (Chinese, English, Greek, Polish and Russian), it features several metrics to obtain more fine-grained differentiations. Our experiments highlight the diversity of web page layouts across languages or publishing countries. These discrepancies are reflected by diverging performances so that the right tool has to be chosen accordingly.
Fichier principal
Vignette du fichier
2020.wac-1.2.pdf (276.01 Ko) Télécharger le fichier
Origin Publisher files allowed on an open archive
Loading...

Dates and versions

hal-02732851 , version 1 (02-06-2020)

Identifiers

  • HAL Id : hal-02732851 , version 1

Cite

Adrien Barbaresi, Gaël Lejeune. Out-of-the-Box and Into the Ditch? Multilingual Evaluation of Generic Text Extraction Tools. Language Resources and Evaluation Conference (LREC 2020), 2020, pp.5-13. ⟨hal-02732851⟩
123 View
312 Download

Share

More