Kitten: a tool for normalizing HTML and extracting its textual content. - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2012

Kitten: a tool for normalizing HTML and extracting its textual content.

Résumé

The web is composed of a gigantic amount of documents that can be very useful for information extraction systems. Most of them are written in HTML and have to be rendered by an HTML engine in order to display the data they contain on a screen. HTML file thus mix both informational and rendering content. Our goal is to design a tool for informational content extraction. A linear extraction with only a basic filtering of rendering content would not be enough as objects such as lists and tables are linearly coded but need to be read in a non-linear way to be well interpreted. Besides these HTML pages are often incorrectly coded from an HTML point of view and use a segmentation of blocks based on blank space that cannot be transposed in a text filewithout confusing syntactic parsers. For this purpose, we propose the Kitten tool that first normalizes HTML file into unicode XHTML file, then extracts the informational content into a text filewith a special processing for sentences, lists and tables.
Fichier non déposé

Dates et versions

hal-02951105 , version 1 (28-09-2020)

Identifiants

  • HAL Id : hal-02951105 , version 1

Citer

Mathieu-Henri Falco, Véronique Moriceau, Anne Vilnat. Kitten: a tool for normalizing HTML and extracting its textual content.. 8th International Conference on Language Resources and Evaluation - LREC 2012, May 2012, Istanbul, Turkey. ⟨hal-02951105⟩
24 Consultations
0 Téléchargements

Partager

Gmail Facebook X LinkedIn More