Databricks CI/CD: Intro to Databricks Asset Bundles (DABs)

Databricks CI/CD: Intro to Databricks Asset Bundles (DABs)

22.618 Lượt nghe
Databricks CI/CD: Intro to Databricks Asset Bundles (DABs)
Databricks Asset Bundles provide a way to use the command line to deploy and run a set of Databricks assets - like notebooks, Python code, Delta Live Tables pipelines, and workflows. This is useful both for running jobs that are being developed locally and for automating CI/CD processes that will deploy and test code changes. In this video I explain why Databricks Asset Bundles are a good option for CI/CD and demo how to initialize a project and setup your first GitHub Action using DABs. Blog post with extra examples: https://dustinvannoy.com/2023/10/03/databricks-ci-cd-intro-to-asset-bundles-dabs * All thoughts and opinions are my own * References: Datakickstart DABs repo: https://github.com/datakickstart/datakickstart_dabs/blob/main/databricks.yml Data & AI Summit Presentation: https://www.databricks.com/dataaisummit/session/databricks-asset-bundles-standard-unified-approach-deploying-data-products/ Data & AI Summit Repo: https://github.com/databricks/databricks-asset-bundles-dais2023 DABs Advanced Examples: https://www.youtube.com/watch?v=ZuQzIbRoFC4 More from Dustin: Website: https://dustinvannoy.com LinkedIn: https://www.linkedin.com/in/dustinvannoy Github: https://github.com/datakickstart CHAPTERS 00:00 Intro 02:10 Why use Asset Bundles? 5:45 Get started with Bundle Init 10:58 GitHub Action deploy and run 19:09 Outro