The evolution of Kami’s data infrastructure

🎤 Jordan Thoms, CTO and Co-Founder @ Kami Talk Title: The evolution of Kami’s data infrastructure Talk Summary: Kami's in-house analytics system collects clickstream data for 45 million users, reaching 300 GB per day and over 200 billion total data points. This data, ingested into the company’s data warehouse, informs key business decisions, such as product roadmaps, sales planning, and marketing. With Kami’s explosive growth, we have successively rearchitected our data infrastructure to allow for massive scale. In this talk, Jordan will explain how user activity data from Kami’s web app moves through Ruby on Rails, Sidekiq, Kafka, and an in-house Kafka consumer before real-time ingestion into ClickHouse. Speaker Bio: Jordan co-founded Kami in 2014 after working as a software engineer in San Francisco and seeing the potential for better software tools in education. Since then Jordan has successfully led the engineering team at Kami, earning a Forbes 30 Under 30 inclusion in 2022 for his impact in Kami’s drive for change.