Azure Data Factory Full Course (From Beginner to PRO) | ADF Real-Time Scenarios

Azure Data Factory Full Course (From Beginner to PRO) | ADF Real-Time Scenarios

39.349 Lượt nghe
Azure Data Factory Full Course (From Beginner to PRO) | ADF Real-Time Scenarios
Azure Data Factory Full Course | Azure Data Factory Interview Questions | Azure Data Factory Tutorial This 4-hour tutorial on Azure Data Factory, a leading technology in big data engineering! This video is designed for beginners and experienced users alike, covering everything you need to know to get started and excel in your data engineering career. 🔍 What You'll Learn: - Copy Activity: Understand how to efficiently copy data between various sources. - For Each Activity: Learn how to iterate through datasets and automate workflows. - If Condition: Implement conditional logic in your data pipelines. - Set Variable: Store the crucial information in your pipelines. - Triggers: Set up triggers (schedule, tumbling window, and storage event trigger) to automate your data workflows. - Pulling Data from APIs: Discover how to connect and extract data from external APIs. - Azure Data Factory Real-time Scenarios. - Azure Data Engineer Interview Questions Data Source Link : https://github.com/anshlambagit/Azure-Data-Factory/tree/main/Raw%20Data PySpark Full Course : https://youtu.be/94w6hPk7nkM?si=Y2EUnifXrZRK3MOj Data Engineering Masterclass : https://youtu.be/ZRz-7E-7X7c?si=bzl2xL1ngZodTx-M End-To-End Azure Data Engineering Project : https://youtu.be/0GTZ-12hYtU?si=_9Gyh6KvDt5HX_OT Timestamps: 0:00 Introduction 05:56 What is Azure Data Factory 13:02 Free Azure Account 15:41 Azure Data Fundamentals 19:10 Azure Data Lake 27:58 Create Azure Data Factory Workspace 30:18 Dataset and Linked Service in Azure Data Factory 39:07 Data Ingestion in Data Lake 40:05 Azure Data Factory Tutorial 46:02 Copy Activity in Azure Data Factory 1:01:11 Copy Data Using REST API in ADF 1:16:43 Get Metadata Activity in Azure Data Factory 1:24:12 IF Condition in ADF 1:26:42 For Each Activity in Azure Data Factory 1:37:34 Expression Builder in ADF 1:46:31 Parameterized Pipeline in Azure Data Factory 2:04:06 Data Flow in Azure Data Factory 2:13:03 Data Transformation in Azure Data factory using Data Flow 2:26:30 Schedule Trigger in Azure Data Factory 2:35:59 Set Variable Activity ADF 2:41:46 Storage Event Trigger in ADF 2:43:32 Real Time Scenarios in Azure Data Factory 2:51:40 Delete Activity in ADF 2:53:14 Debugging Pipeline in Azure Data Factory 3:01:22 Execute Pipeline Activity in Azure Data Factory 3:10:14 End-To-End Data Pipeline using ADF Connect with ME - https://www.linkedin.com/in/ansh-lamba-793681184/ Please Hit the SUBSCRIBE button❤️to support me and my hard work. ⭐Hashtags⭐ #azure #azuredatafactory #azuresynapseanalytics #azureinterviewquestions #dataengineering #databricks #pyspark #bigdata