Microsoft Fabric: Role of the Silver Lakehouse in the Medallion Architecture

The Silver layer is where we apply standardization to our source datasets. This standardization aligns field names across sources, applies common data cleaning operations and organizes the data into a well known structure. The Silver layer, which is generally stored at full-fidelity (i.e. the granularity of the data is the same in the Silver layer as it is in the Bronze layer) provides the foundation for the Gold layer, where we may have many projections of the Silver data in different forms and at different granularities, depending on the downstream need. In this video we're going to talk about the role the Silver Lakehouse plays in the Medallion architecture, including what it's used for and whom it benefits. 00:00 Intro 00:13 Architecture diagram recap 01:18 Silver Lakehouse principles 04:10 Why is the Silver Lakehouse useful? 04:38 Who is the Silver Lakehouse for? 05:48 Roundup & Outro Useful links: 📖 Microsoft Fabric Medallion Architecture official docs: https://learn.microsoft.com/en-us/fabric/onelake/onelake-medallion-lakehouse-architecture Series contents: 📺 Part 1 - Lakehouse & Medallion Architecture - https://www.youtube.com/watch?v=x_CvCwSbRZI&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=1&ab_channel=endjin 📺 Part 2 - Planning and Architecting a Data Project - https://www.youtube.com/watch?v=miDa4FZY7GU&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=2&ab_channel=endjin 📺 Part 3 - Ingest Data - https://www.youtube.com/watch?v=yptYlWLsVYk&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=3&ab_channel=endjin 📺 Part 4 - Creating a shortcut to ADLS Gen2 in Fabric - https://www.youtube.com/watch?v=11urrDAW-bU&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=4&ab_channel=endjin 📺 Part 5 - Navigating OneLake data locally - https://www.youtube.com/watch?v=DO779ZcAtTk&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=5&ab_channel=endjin 📺 Part 6 - Role of the Silver layer in the Medallion Architecture - THIS VIDEO! 📺 Part 7 - Processing Bronze to Silver - https://www.youtube.com/watch?v=s_mHaLBlA94 📺 Part 8 - Good Notebook Development Practices - https://www.youtube.com/watch?v=UyS6ZUgh-Wc&list=PLJt9xcgQpM61fxyB1aWzWCAEsHZHEZD6w&index=7&ab_channel=endjin If you want to learn more about Fabric, take a look at some of our other content: 🤖 [Course] Microsoft Fabric: from Descriptive to Predictive Analytics: https://www.youtube.com/watch?v=uaRePHeqvQU&list=PLJt9xcgQpM63xH0x9K-oQMFiE4D9pdl4W 👉 Perspectives on #MicrosoftFabric: https://endjin.com/what-we-think/talks/perspectives-on-microsoft-fabric 👉 A Tour Around #MicrosoftFabric: https://endjin.com/what-we-think/talks/a-tour-around-microsoft-fabric 👉 Introduction to #MicrosoftFabric: https://endjin.com/blog/2023/05/intro-to-microsoft-fabric and find all the rest of our content here: https://endjin.com/blog/2023/05/microsoft-fabric-announced #Microsoft #PowerBI #MicrosoftFabric #lakehouse #datalake #onelake #data #ai #analytics #medallion #bronze #silver #gold