Document Structure Meets Page Layout: Loopy Random Fields for Web News Content Extraction - Archive ouverte HAL Access content directly
Conference Papers Year : 2010

Document Structure Meets Page Layout: Loopy Random Fields for Web News Content Extraction

Abstract

Web content extraction is concerned with the automatic identification of semantically interesting web page regions. To generalize to pages from unknown sites, it is crucial to exploit not only the local characteristics of a particular web page region, but also the rich interdependencies that exist between the regions and their latent semantics. We therefore propose a loopy conditional random field which combines semantic intra-page dependencies derived from both document structure and page layout, uses a realistic set of local and relational features and is efficiently learnt in the tree-based reparameterization framework. The results of our empirical analysis on a corpus of real-world news web pages from 177 distinct sites with multiple annotations on DOM node level demonstrate that our combination of document structure and layout-driven interdependencies leads to a significant error reduction on the semantically interesting regions of a web page.
No file

Dates and versions

hal-00637719 , version 1 (02-11-2011)

Identifiers

Cite

Alexander A. Spengler, Patrick Gallinari. Document Structure Meets Page Layout: Loopy Random Fields for Web News Content Extraction. 10th ACM Symposium on Document Engineering (DocEng 2010), Sep 2010, Manchester, United Kingdom. pp.151-160, ⟨10.1145/1860559.1860590⟩. ⟨hal-00637719⟩
109 View
0 Download

Altmetric

Share

Gmail Facebook Twitter LinkedIn More