Weekly web archiving roundup: March 11, 2015

Weekly web archiving roundup for the week of March 11, 2015:

  • Crawling websites using RSS feeds“, from Kristinn Sigurdsson.  Post on the advantages of crawling websites using an RSS feed. Using Kris’ add-on for Heritrix, CrawlRSS, you can crawl sites (notably news sites) both more effectively (getting more good content) and efficiently (getting less redundant content) because the RSS feeds pull out the most critical data we need from the site.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s