Web Requests and Scrapping
Curl
curl https://example.com
Python
import requests
r = requests.get('https://example.com/')
print(r.text)
print(r.status_code)
Beautiful Soup
from bs4 import BeautifulSoup
soup = BeautifulSoup(html_doc, 'html.parser')
curl https://example.com
import requests
r = requests.get('https://example.com/')
print(r.text)
print(r.status_code)
from bs4 import BeautifulSoup
soup = BeautifulSoup(html_doc, 'html.parser')