User:Francg/expub/thesis/prototype

From XPUB & Lens-Based wiki
< User:Francg
Revision as of 01:52, 5 October 2017 by Francg (talk | contribs)


Prototype

Extracting data (in this case I scrap URL's / web links only) from: https://www.reddit.com/



Run Python (I did it from virtual environment)
from bs4 import BeautifulSoup
import requests
url = raw_input("https://www.reddit.com/: ")
r = requests.get("https://www.reddit.com/" +url)
data = r.text
soup = BeautifulSoup(data)
for link in soup.find_all('a'):

   print(link.get('href'))