Profiling web archive coverage for top-level domain and content language. AlSum, A., Weigle, M. C., Nelson, M. L., & Van de Sompel, H. International Journal on Digital Libraries, 14(3-4):149–166, 2014. arXiv: 1309.4008 ISBN: 9783642405006
doi  abstract   bibtex   
The Memento aggregator currently polls every known public web archive when serving a request for an archived web page, even though some web archives focus on only specific domains and ignore the others. Similar to query routing in distributed search, we investigate the impact on aggregated Memento TimeMaps (lists of when and where a web page was archived) by only sending queries to archives likely to hold the archived page. We profile twelve public web archives using data from a variety of sources (the web, archives’ access logs, and full-text queries to archives) and discover that only sending queries to the top three web archives (i.e., a 75% reduction in the number of queries) for any request produces the full TimeMaps on 84% of the cases.
@article{AlSum2014,
	title = {Profiling web archive coverage for top-level domain and content language},
	volume = {14},
	issn = {14321300},
	doi = {10.1007/s00799-014-0118-y},
	abstract = {The Memento aggregator currently polls every known public web archive when serving a request for an archived web page, even though some web archives focus on only specific domains and ignore the others. Similar to query routing in distributed search, we investigate the impact on aggregated Memento TimeMaps (lists of when and where a web page was archived) by only sending queries to archives likely to hold the archived page. We profile twelve public web archives using data from a variety of sources (the web, archives’ access logs, and full-text queries to archives) and discover that only sending queries to the top three web archives (i.e., a 75\% reduction in the number of queries) for any request produces the full TimeMaps on 84\% of the cases.},
	number = {3-4},
	journal = {International Journal on Digital Libraries},
	author = {AlSum, Ahmed and Weigle, Michele C. and Nelson, Michael L. and Van de Sompel, Herbert},
	year = {2014},
	note = {arXiv: 1309.4008
ISBN: 9783642405006},
	keywords = {Federated search, Memento Aggregator, Web archive},
	pages = {149--166},
}

Downloads: 0