Azure Data Factory Full Course | Azure Data Factory Interview Questions | Azure Data Factory Tutorial
This 4-hour tutorial on Azure Data Factory, a leading technology in big data engineering! This video is designed for beginners and experienced users alike, covering everything you need to know to get started and excel in your data engineering career.
🔍 What You'll Learn:
- Copy Activity: Understand how to efficiently copy data between various sources.
- For Each Activity: Learn how to iterate through datasets and automate workflows.
- If Condition: Implement conditional logic in your data pipelines.
- Set Variable: Store the crucial information in your pipelines.
- Triggers: Set up triggers (schedule, tumbling window, and storage event trigger) to automate your data workflows.
- Pulling Data from APIs: Discover how to connect and extract data from external APIs.
- Azure Data Factory Real-time Scenarios.
- Azure Data Engineer Interview Questions
Data Source Link : https://github.com/anshlambagit/Azure-Data-Factory/tree/main/Raw%20Data
PySpark Full Course :
https://youtu.be/94w6hPk7nkM?si=Y2EUnifXrZRK3MOj
Data Engineering Masterclass :
https://youtu.be/ZRz-7E-7X7c?si=bzl2xL1ngZodTx-M
End-To-End Azure Data Engineering Project :
https://youtu.be/0GTZ-12hYtU?si=_9Gyh6KvDt5HX_OT
Timestamps:
0:00 Introduction
05:56 What is Azure Data Factory
13:02 Free Azure Account
15:41 Azure Data Fundamentals
19:10 Azure Data Lake
27:58 Create Azure Data Factory Workspace
30:18 Dataset and Linked Service in Azure Data Factory
39:07 Data Ingestion in Data Lake
40:05 Azure Data Factory Tutorial
46:02 Copy Activity in Azure Data Factory
1:01:11 Copy Data Using REST API in ADF
1:16:43 Get Metadata Activity in Azure Data Factory
1:24:12 IF Condition in ADF
1:26:42 For Each Activity in Azure Data Factory
1:37:34 Expression Builder in ADF
1:46:31 Parameterized Pipeline in Azure Data Factory
2:04:06 Data Flow in Azure Data Factory
2:13:03 Data Transformation in Azure Data factory using Data Flow
2:26:30 Schedule Trigger in Azure Data Factory
2:35:59 Set Variable Activity ADF
2:41:46 Storage Event Trigger in ADF
2:43:32 Real Time Scenarios in Azure Data Factory
2:51:40 Delete Activity in ADF
2:53:14 Debugging Pipeline in Azure Data Factory
3:01:22 Execute Pipeline Activity in Azure Data Factory
3:10:14 End-To-End Data Pipeline using ADF
Connect with ME - https://www.linkedin.com/in/ansh-lamba-793681184/
Please Hit the SUBSCRIBE button❤️to support me and my hard work.
⭐Hashtags⭐
#azure #azuredatafactory #azuresynapseanalytics #azureinterviewquestions #dataengineering #databricks #pyspark #bigdata