Learn how to perform web scraping with Python using the Beautiful Soup library.
✏️ Tutorial by JimShapedCoding. Check out his YouTube Channel:
https://www.youtube.com/channel/UCU8d7rcShA7MGuDyYH1aWGg
🔗 You can get code snippets here: https://github.com/jimdevops19/codesnippets/tree/main/Python%20Web%20Scraping
❤️ Try interactive Python courses we love, right in your browser: https://scrimba.com/freeCodeCamp-Python (Made possible by a grant from our friends at Scrimba)
⭐️ Course Contents ⭐️
Local HTML Scraping:
⌨️ (
00:00) Basic HTML Structure, HTML Tags Explanation
⌨️ (
05:35) Packages Installation
⌨️ (
07:23) Scraping Usage, Local files
⌨️ (
12:41) Beautiful Soup find & find_all() methods
⌨️ (
16:22) Web Browser Inspect tool
⌨️ (
18:30) Grab all Prices, Basic Scraping Project
Website Scraping:
⌨️ (
24:48) Using the Requests Library to see a Website's HTML
⌨️ (
30:10) Scraping a Production Website, Best practices for pulling info
⌨️ (
44:05) Looping through similar soup.find_all() objects
Features addition:
⌨️ (
48:26) Prettifying the Jobs paragraph
⌨️ (
54:05) Jobs Filtration by owned skills
⌨️ (
57:45) Setting up the Project to scrape every 10 minutes
⌨️ (
1:01:53) Storing the jobs paragraph in text files