Document Structure Meets Page Layout: Loopy Random Fields for Web News Content Extraction - Archive ouverte HAL
Communication Dans Un Congrès Année : 2010

Document Structure Meets Page Layout: Loopy Random Fields for Web News Content Extraction

Résumé

Web content extraction is concerned with the automatic identification of semantically interesting web page regions. To generalize to pages from unknown sites, it is crucial to exploit not only the local characteristics of a particular web page region, but also the rich interdependencies that exist between the regions and their latent semantics. We therefore propose a loopy conditional random field which combines semantic intra-page dependencies derived from both document structure and page layout, uses a realistic set of local and relational features and is efficiently learnt in the tree-based reparameterization framework. The results of our empirical analysis on a corpus of real-world news web pages from 177 distinct sites with multiple annotations on DOM node level demonstrate that our combination of document structure and layout-driven interdependencies leads to a significant error reduction on the semantically interesting regions of a web page.
Fichier non déposé

Dates et versions

hal-00637719 , version 1 (02-11-2011)

Identifiants

Citer

Alexander A. Spengler, Patrick Gallinari. Document Structure Meets Page Layout: Loopy Random Fields for Web News Content Extraction. 10th ACM Symposium on Document Engineering (DocEng 2010), Sep 2010, Manchester, United Kingdom. pp.151-160, ⟨10.1145/1860559.1860590⟩. ⟨hal-00637719⟩
129 Consultations
0 Téléchargements

Altmetric

Partager

More