User:Francg/expub/thesis/prototype: Difference between revisions
No edit summary |
No edit summary |
||
| Line 5: | Line 5: | ||
'''Prototype''' | '''Prototype''' | ||
Extracting data ( | Extracting data (scrapping URL's / web links from content only) | ||
<br>from: https://www.reddit.com/ | |||
<br> | <br> | ||
Revision as of 13:56, 5 October 2017
Prototype
Extracting data (scrapping URL's / web links from content only)
from: https://www.reddit.com/
Run Python (I did it from virtual environment)
from bs4 import BeautifulSoup
import requests
url = raw_input("https://www.reddit.com/: ")
r = requests.get("https://www.reddit.com/" +url)
data = r.text
soup = BeautifulSoup(data)
for link in soup.find_all('a'):
print(link.get('href'))
