This script I threw together saves me hours.

Finding out the best way to scrape data from a site is time consuming, this script uses selenium wire to view the network requests from a site and give you back a list of urls and json responses. # Proxies: https://nodemaven.com/?a_aid=JohnWatsonRooney # Patreon: https://www.patreon.com/johnwatsonrooney (NEW free tier) # Scraper API https://www.scrapingbee.com/?fpr=jhnwr # Donations: https://www.paypal.com/donate/?hosted_button_id=7HNSFPRR9N63Y # Hosting: Digital Ocean: https://m.do.co/c/c7c90f161ff6 # Gear I use: https://www.amazon.co.uk/shop/johnwatsonrooney