Modern data stack project - dbt dimensions and facts
Creating fact table and dimension tables using dbt
This is a a video in a series where I build a modern data stack project that uses
* dlt to extract load (EL) data into a duckdb which acts as a data warehouse
* duckdb data warehouse is divided into staging layer, refined layer and marts layer
* a star schema is created using dbdiagram which will act as mental model for the transformations
* dbt is used to transform data from staging into refined layer and marts
* the marts layer is used to serve streamlit dashboard
* in the streamlit dashboard LLM will be connected as well as visualizations and KPIs
* then everything will be orchestrated using dagster
* docker will be used to dockerize the whole project
* the dockerized project is deployed into azure