Learn Together: Use Apache Spark in Microsoft Fabric

Full series information: https://aka.ms/learnlive-microsoft-fabric-wave-1 More info here: https://aka.ms/learnlive-microsoft-fabric-wave-1-Ep202 Follow on Microsoft Learn: - Complete the Learn module: https://aka.ms/learnlive-20240124B Apache Spark is a core technology for large-scale data analytics. Microsoft Fabric provides support for Spark clusters, enabling you to analyze and process data in a Lakehouse at scale. --------------------- Learning objectives - Configure Spark in a Microsoft Fabric workspace - Identify suitable scenarios for Spark notebooks and Spark jobs - Use Spark dataframes to analyze and transform data - Use Spark SQL to query data in tables and views - Visualize data in a Spark notebook --------------------- Chapters -------- 00:00 - Introduction 06:07 - Learning objectives 11:56 - Prepare to use Apache Spark 15:11 - Demo - Spark configuration 24:33 - Run Spark code 30:46 - Load data into a Spark dataframe 36:21 - Transform data in a dataframe 59:43 - Save a dataframe 1:13:33 - Work with data using Spark SQL 1:17:02 - Demo - Use Spark SQL 1:26:29 - Summary and resources --------------------- Presenters Anupama Natarajan Data And Ai Consultant, Microsoft MVP Pearl Innovations Limited - LinkedIn: https://www.linkedin.com/in/anupamanatarajan/ Armando Lacerda Azure Data Architect And Engineer, Microsoft MVP, Microsoft Super User MC Tech - LinkedIn: https://www.linkedin.com/in/armando-lacerda Moderators Andrei Khaidarov Senior Bi Engineer, Microsoft Super User Velvetech LLC - LinkedIn: https://www.linkedin.com/in/andgenn/