DBT build a Datawarehouse using Kimball dimensional model | dbt models | Custom Schema | Macros | P2

DBT build a Datawarehouse using Kimball dimensional model | dbt models | Custom Schema | Macros | P2

5.038 Lượt nghe
DBT build a Datawarehouse using Kimball dimensional model | dbt models | Custom Schema | Macros | P2
This is part two of the dbt series. In the previous session, we gave an overview of dbt, created a dbt project, configured our environment and materialized the sample dbt models to the PostgreSQL database. In this session, we will replace the sample models with our own tables. We will work with tables that we ingest with Airbyte. Dbt is a SQL based transformation tool, it does not handle extract and load or EL part of the ETL. For EL part we use Airbyte to ingest data. We will use SQL Server as our source. During this video we will cover dbt models, source and schema Yamal files. In addition, we will explore dbt macros and how to use custom schemas using macros. Airbyte setup and configuration is covered in this video here: https://www.youtube.com/watch?v=2FvMa7vaxDY&t SQL Server set up and database restore video: https://www.youtube.com/watch?v=e5mvoKuV3xs&t PostgreSQL set up video: https://www.youtube.com/watch?v=fjYiWXHI7Mo&t=2s Link to GitHub repo: https://github.com/hnawaz007/dbt-dw dbt part one: https://www.youtube.com/watch?v=gH1w4OIgXj4&t AdventureWorks database link (restore following AdventureWorks2019.bak): https://learn.microsoft.com/en-us/sql/samples/adventureworks-install-configure?view=sql-server-ver16&tabs=ssms #dbt #datawarehouse #etl 💥Subscribe to our channel: https://www.youtube.com/c/HaqNawaz 📌 Links ----------------------------------------- #️⃣ Follow me on social media! #️⃣ 🔗 GitHub: https://github.com/hnawaz007 📸 Instagram: https://www.instagram.com/bi_insights_inc 📝 LinkedIn: https://www.linkedin.com/in/haq-nawaz/ 🔗 https://medium.com/@hnawaz100 ----------------------------------------- Topics covered in this video: ================================== 0:00 - Introduction to dbt 1:01 - Source Database 1:45 - Extract & Load with Airbyte 3:01 - Update dbt project to use our table(s) 7:19 - Materialize our model(s) 8:07 - Custom Schema 9:12 - dbt macro 11:33 - Materialize to Custom Schema 12:26 - Generate & Serve dbt docs 12:39 - Model DAG 12:50 - Recap and Coming Soon