DuckDB & dbt | End-To-End Data Engineering Project (2/3)

@mehdio is taking you to part 2 of this end-to-end data engineering project series: transform data using dbt and DuckDB! You will be leveraging all the in-memory capabilities of DuckDB to smooth your development process and deployment to the cloud. Part 3 : https://youtu.be/ta_Pzc2EEEo Part 2 : https://www.youtube.com/watch?v=3pLKTmdWDXk ☁️🦆 Start using DuckDB in the Cloud for FREE with MotherDuck : https://hubs.la/Q02QnFR40 📓 Resources * Github Repo of the tutorial : https://github.com/mehd-io/pypi-duck-flow * Part 1 of the series (Ingestion using Python & DuckDB) : https://www.youtube.com/watch?v=3pLKTmdWDXk&t * How to install DuckDB CLI : https://duckdb.org/docs/installation/index?version=latest&environment=cli&installer=binary&platform=macos * dbt unit testing package : https://github.com/EqualExperts/dbt-unit-testing * dbt-duckdb adapter : https://github.com/duckdb/dbt-duckdb ➡️ Follow Us LinkedIn: https://linkedin.com/company/motherduck Twitter : https://twitter.com/motherduck Blog: https://motherduck.com/blog/ 0:00 Intro 1:38 Architecture recap 3:32 Coding the transform pipeline using dbt & DuckDB 35:01 Wrapping up & what's next #duckdb #dataengineering #sql #python