Welcome to part 2 of the new tutorial series on AWS Glue. This is the hands-on video on the basic end-to-end transformation using AWS Glue. In this video, we will use multiple components of AWS Glue like Crawlers, Data Catalog including Database, tables, and ETL jobs.
Slides - Get access to all slides used in the videos via membership: https://www.youtube.com/srcecde/join
Buy Me A Coffee: https://www.buymeacoffee.com/srcecde
---
Support my work:
---
Patreon: https://www.patreon.com/srcecde
PayPal: https://paypal.me/srcecde
Paytm | Gpay: 9023197426
---
Text version: https://medium.com/srcecde/aws-glue-tutorial-csv-to-parquet-transformation-end-to-end-6330d4ccc39f
---
---
Another channel:
---
Srce Cde in Hindi: https://www.youtube.com/channel/UCooUM00QHpzDEcfkNGRm0Ag
---
Connect with me
---
Twitter: https://twitter.com/srcecde
GitHub: https://github.com/srcecde
Facebook: https://www.facebook.com/SrceCde/
Instagram: https://www.instagram.com/srcecde/
LinkedIn: https://www.linkedin.com/company/srcecde/
Reddit: https://www.reddit.com/r/srcecde
Medium: https://medium.com/srcecde
00:00 Getting started with AWS Glue transformation
00:38 Architecture walkthrough
01:17 ETL Job stages
01:32 Terminologies used in the Architecture walkthrough
03:06 Implementation steps at high-level
03:42 Hands-On
03:49 Setting up IAM role for permissions
04:53 Create & configure S3 Bucket
08:22 Setup AWS Glue Database
09:30 Setup crawler to create table
13:31 Table schema
15:28 Create & configure ETL job
21:10 Run ETL job
21:55 Check transformed/Output file
#awsglue #awstraining #awsgluetutorial #awsome