Sniff, Scrape, Crawl (Prototyping)

From XPUB & Lens-Based wiki

In 2011, Sniff, Scrape, Crawl was a thematic project led by Aymeric Mansoux, Renee Turner, and Michael Murtaugh.

This prototyping module will in part revisit some of the themes of this thematic project and in particular focus on the tools and practices of scraping.

Elements

  • Spidering
  • Crawling
  • Indexing
  • Summarizing
  • Break up the steps of Whoosh's indexing

Examples

Links