Improving the Quality of Web Archives through the Importance of Changes - Archive ouverte HAL Access content directly
Book Sections Year : 2011

Improving the Quality of Web Archives through the Importance of Changes

Myriam Ben Saad
  • Function : Author
  • PersonId : 968945
Stéphane Gançarski

Abstract

Due to the growing importance of the Web, several archiving institutes (national libraries, Internet Archive, etc.) are harvesting sites to preserve (a part of) the Web for future generations. A major issue encountered by archivists is to preserve the quality of web archives. One way of assessing the quality of an archive is to quantify its completeness and the coherence of its page versions. Due to the large number of pages to be captured and the limitations of resources (storage space, bandwidth, etc.), it is impossible to have a complete archive (containing all the versions of all the pages). Also it is impossible to assure the coherence of all captured versions because pages are changing very frequently during the crawl of a site. Nonetheless, it is possible to maximize the quality of archives by adjusting web crawlers strategy. Our idea for that is (i) to improve the completeness of the archive by downloading the most important versions and (ii) to keep the most important versions as coherent as possible. Moreover, we introduce a pattern model which describes the behavior of the importance of pages changes over time. Based on patterns, we propose a crawl strategy to improve both the completeness and the coherence of web archives. Experiments based on real patterns show the usefulness and the effectiveness of our approach.

Dates and versions

hal-01287972 , version 1 (14-03-2016)

Identifiers

Cite

Myriam Ben Saad, Stéphane Gançarski. Improving the Quality of Web Archives through the Importance of Changes. Database and Expert Systems Applications, 6860, Springer Berlin / Heidelberg, pp.394-409, 2011, Lecture Notes in Computer Science, 978-3-642-23087-5. ⟨10.1007/978-3-642-23088-2_29⟩. ⟨hal-01287972⟩
34 View
0 Download

Altmetric

Share

Gmail Facebook X LinkedIn More