Scrape Reddit utilising Smartproxy's Web Scraping API
BeautifulSoupOnce you have an active Web Scraping API subscription, you can try sending a request right from the dashboard Web Scraping API > API playground method tab simply by clicking on Send Request. You will also see an example of curl request generated on the right.
| Parser type | Example location | Download |
|---|---|---|
| HTML to JSON | reddit_python_scraper.py | curl https://raw.githubusercontent.com/Smartproxy/reddit-python-scraper/blob/main/reddit_python_scraper.py > reddit_python_scraper.py |
This Python script extracts Subreddit details, post data and comments straight from the HTML of Reddit post page and saves them to a JSON file.