DuckDB & Python | End-To-End Data Engineering Project (1/3)

In this video @mehdio goes over a fun end-to-end data engineering project : get usage insights from a python library using Python, SQL and DuckDB! This is the first part of the series. Check links below to learn about transformation and dashboarding using DuckDB ! 🎥 Part 2 of the end-to-end data engineering project : https://www.youtube.com/watch?v=SpfEQQXBGMQ 🎥 Part 3 : https://youtu.be/ta_Pzc2EEEo ☁️🦆 Start using DuckDB in the Cloud for FREE with MotherDuck : https://hubs.la/Q02QnFR40 📓 Resources * Github Repo of the tutorial : https://github.com/mehd-io/pypi-duck-flow * BigQuery performance issue with certain libraries: https://github.com/googleapis/python-bigquery/issues/1492 * DuckDB for beginner video : https://www.youtube.com/watch?v=ZX5FdqzGT1E&t ➡️ Follow Us LinkedIn: https://linkedin.com/company/motherduck Twitter : https://twitter.com/motherduck Blog: https://motherduck.com/blog/ 0:00 Intro 1:06 Architecture 3:13 Ingestion Pipeline Python & DuckDB 41:08 Wrapping up & what's next #duckdb #dataengineering #sql #python