AWS Glue Crawler [AWS Console 2023 Full Demo]

LINKS ℹ️ GitHub: https://github.com/johnny-chivers/aws-glue-crawlers ℹ️ AWS Docs: https://docs.aws.amazon.com/glue/latest/dg/crawler-running.html In this video we cover what an AWS Glue Crawler is and how you can use it to populate the AWS Glue Data Catalog. We cover the basics of the AWS Crawler before diving into a full demo where we register data in S3 with the AWS Glue Data Catlaog using a crawler we define on the AWS Console. All the resources required to follow long are provided for free at the GitHub link above. SUPPORT THE CHANNEL: ☕ Buy Me A Coffee: https://www.buymeacoffee.com/johnnychivers 🖥️ My VPN: https://go.nordvpn.net/aff_c?offer_id=612&aff_id=74288&url_id=14830 ▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬ 00:34 - What is a Glue Crawler 01:54 - Demo 02:02 - Download Data 02:25 - Table Schema 02:57 - Create S3 Bucket 03:41 - Upload Data To S3 04:25 - Create Crawler 04:56 - Create Data Source 05:36 - Create IAM Role 06:22 - Run Crawler 06:44 - crawler Output 08:03 - Outro OTHER USEFUL LINKS: ℹ️ My Website: https://johnnychivers.co.uk 🔗 Linkedin: https://www.linkedin.com/in/johnny-chivers/ Are you preparing for the AWS Certified Data Engineer - Associate (DEA-C01) exam? This comprehensive full course is designed to guide you through every aspect of the certification, from data modeling and storage solutions to ETL processes and data analysis on AWS. We'll dive deep into key AWS services like S3, Redshift, DynamoDB, and Glue, with hands-on examples and real-world scenarios to solidify your understanding. Whether you're new to AWS or looking to validate your data engineering skills, this course will equip you with the knowledge and confidence to ace the DEA-C01 exam. Don't forget to subscribe and hit the notification bell to stay updated with the latest content! DISCLAIMER This course, youtube video, revision/exam guide, and/or slide deck for the AWS Certified Data Engineer certification is intended as a supplementary resource to aid in your preparation for the certification exam. While it is designed to help you identify and address knowledge gaps, it does not guarantee a passing score. Success on the exam depends on your understanding of the material, practical experience, and familiarity with AWS services and best practices. We recommend using this guide alongside other study materials and hands-on practice to enhance your readiness for the certification exam. 😎 About me I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies.My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software