Apache Airflow Tutorial for Data Engineers

Chapters: 2:57 Pre-requisites 4:15 Airflow UI tour 11:04 Write your first DAG (that copies data files from AWS S3 to a Postgres DB) 23:16 Write your own Custom Airflow Operator (using Python inheritance) 30:08 TriggerDagRun Operator (Learn how to trigger one DAG from another) 33:06 BranchPythonOperator (Learn how to create dynamic workflows) 37:54 Set up DAG failure Slack alerts and handle errors in Airflow 47:03 CICD pipeline for Airflow (Automatic code deployment from GitHub to AWS Airflow) All code in my Git repository https://github.com/souravtechie/apache_airflow Youtube API python code inspired by this video - https://www.youtube.com/watch?v=D56_Cx36oGY