"Building IoT Data Pipelines with Python" by Logan Wendholt

1.631 Lượt nghe
"Building IoT Data Pipelines with Python" by Logan Wendholt
Recorded at Launch Fishers in Fishers, IN on 10-12-18 PyData Indy 2018 So you've learned about the data analytics capabilities of Python, and now you're ready to start churning through data -- great! But do you know how to turn your snippet of code into a system capable of taking in streams of raw sensor data and spitting out insights? This presentation will lay out the basic components of a Python-based data pipeline built for Internet-of-Things (IoT) applications, and will highlight some of the common challenges associated with putting together an efficient data analytics and storage system. Key topics include: • An overview of cloud-based "serverless" data pipelines; • Pros and cons of locally-hosted or "edge computing" systems; • Tradeoffs between cost, scalability, complexity, and development time for different architectures By the end of this presentation, you will have gained a broad overview of the ecosystem needed to support a Python analytics solution: how to get data in and out, how to write and deploy scalable code, and how to manage system cost and complexity.