Azure Synapse Analytics Tutorial (From Zero to Pro) | Azure Data Engineering

Azure Synapse Analytics Tutorial (From Zero to Pro) | Azure Data Engineering

28.809 Lượt nghe
Azure Synapse Analytics Tutorial (From Zero to Pro) | Azure Data Engineering
Azure Synapse Analytics Tutorial | Azure Synapse Analytics Full Course | Azure Data Engineering 🔍 What You'll Learn: You'll gain a deep understanding of key concepts such as Azure Synapse SQL Pools (both Dedicated and Serverless), Azure Data Lake integration, and how to utilize Openrowset for querying external data. You'll learn to manage Database Scoped Credentials and leverage Managed Identity for secure authentication. Additionally, we'll cover how to create External Data Sources, use CETAS (CREATE EXTERNAL TABLE AS SELECT), and compare Polybase with COPY INTO for data loading. Real-world scenarios and common interview questions will also be discussed to prepare you for practical applications in big data engineering. Data Source Link : https://github.com/anshlambagit/Azure-Synapse-Analytics-Course/tree/main/Raw%20Data Databricks Tutorial : https://youtu.be/7pee6_Sq3VY?si=R9RU3n_FXQFxbSem PySpark Full Course : https://youtu.be/94w6hPk7nkM?si=Y2EUnifXrZRK3MOj Azure Data Factory Full Course : https://youtu.be/8zIVOdKyoDA?si=XMgP7hLda_neTHWw End-To-End Azure Data Engineering Project : https://youtu.be/0GTZ-12hYtU?si=_9Gyh6KvDt5HX_OT Timestamps: 0:00 Introduction 08:02 Azure Synapse Analytics 17:26 Azure Synapse SQL Pool 21:01 Azure Synapse Architecture (Compute Node and Control Node) 23:51 Dedicated Sql Pool and Serverless Sql Pool 30:37 Azure Synapse Spark Pool 35:10 Azure Portal Free Account 39:11 Azure Portal tutorial 43:30 Azure Data Lake 48:40 Azure Synapse Analytics Workspace 1:00:59 Azure Data Factory in Azure Synapse 1:02:17 Azure Synapse Analytics Overview 1:07:16 Medallion Architecture 1:11:25 Distributed Tables in Azure Synapse Analytics 1:19:52 Azure Synapse Dedicated SQL Pool 1:28:22 Synapse Distribution Strategies - Hash, Round Robin, and Replictaed 1:36:14 Azure Synapse Serverless SQL Pool 1:54:21 Data Ingestion in Azure Synapse Analytics 1:59:30 Openrowset in Synapse 2:03:36 Create Database Scoped Credential and Managed Identity in Synapse 2:15:09 Create External Data Source and Linked Service for ADLS Gen2 2:38:02 Create External File Format 2:42:27 Create External Tables in Synapse 2:53:32 CETAS in Synapse 3:01:01 Create Views in Serverless SQL Pool 3:08:06 Polybase vs COPY INTO 3:17:47 Loading external data into synapse using COPY INTO 3:21:10 Polybase (CTAS) in Synapse Connect with ME - https://www.linkedin.com/in/ansh-lamba-793681184/ Please Hit the SUBSCRIBE button❤️to support me and my hard work. ⭐Hashtags⭐ #azure #azuredatafactory #azuredataengineer #azuresynapseanalytics #cloudcomputing #datawarehouse #datawarehousing #azureservices #azuretutorials