More than 5 years have passed since last update.

Scraping

Python

Posted at 2018-10-03

SimpleなScraping

def getSoup(url, timeSleep=1):
    import requests
    import time
    import lxml
    from bs4 import BeautifulSoup
    
    time.sleep(timeSleep)
    session = requests.session()

    url_page1 = url
    res = session.get(url_page1)

    soup = BeautifulSoup(res.content, 'lxml')
    return soup

You get articles that match your needs
You can efficiently read back useful information
You can use dark theme

What you can do with signing up