Lakehouse Monitoring on databricks

In this video, we deep dive into Lakehouse Monitoring on the Databricks platform, where we show you how to profile, diagnose, and enforce quality directly on your Delta tables. Whether you're a data analyst, engineer, or scientist, this demonstration will help you understand how to effectively monitor your data to gain valuable insights. What to Expect: - Overview of Lakehouse Monitoring in GA - How to monitor Delta tables for data quality - Setting up time-series, snapshot, and inference monitors - Creating custom dashboards and alerts for proactive monitoring - Exploring upcoming features in Lakehouse Monitoring for enhanced data quality Key Moments: 0:08 - Introduction to Lakehouse Monitoring 1:15 - Overview and Use Case 2:26 - Understanding Different Monitor Types (Time Series, Snapshot, Inference) 4:07 - Creating Custom Dashboards and Metrics 7:13 - Exploring the Default Dashboard 10:28 - Using the UI for Monitor Setup 12:54 - Monitoring ML Models Using Inference Tables 15:28 - Upcoming Features in Lakehouse Monitoring Don’t forget to like, share, and subscribe for more insights on data quality management and monitoring!