Scraping

From XPUB & Lens-Based wiki

Scraping (also Screen Scraping) is the process of extracting data out of something.

In the course, we have used the library BeautifulSoup to manipulate HTML pages in Python.

Other interesting libraries to consider:

  • lxml which can apparently deal with "mal-formed" HTML and quickly convert them to xml trees
  • html5lib