Apache Kafka® Consumers and Consumer Group Protocol

https://cnfl.io/kafka-internals-101-module-5 | The consumer group protocol in Apache Kafka® enables elasticity, scalability, and fault tolerance for Kafka's compute layer, which is client side, allowing client applications like ksqlDB, Kafka Streams, or a microservice using Kafka's consumer to process data across multiple containers or machines in parallel and with fault tolerance. Jun Rao (Kafka Committer, PMC Member, VP of Kafka, and Co-Founder, Confluent) explains how Kafka decouples the processing of events from storage through consumer groups, how the elasticity of client applications is achieved with consumer groups, and key aspects and settings of a consumer group. Watch this video to find out how consumer groups function and automatically redistribute work as instances are added or removed to suit changing application processing loads. Use the promo code INTERNALS101 to get $25 of free Confluent Cloud usage: https://www.confluent.io/confluent-cloud/tryfree?utm_source=youtube&utm_medium=video&utm_campaign=tm.devx_ch.cd-apache-kafka-internals-101_content.apache-kafka Promo code details: https://www.confluent.io/confluent-cloud-promo-disclaimer/?utm_source=youtube&utm_medium=video&utm_campaign=tm.devx_ch.cd-apache-kafka-internals-101_content.apache-kafka LEARN MORE ► Apache Kafka Data Access Semantics: Consumers and Membership: https://www.confluent.io/blog/apache-kafka-data-access-semantics-consumers-and-membership/?utm_source=youtube&utm_medium=video&utm_campaign=tm.devx_ch.cd-apache-kafka-internals-101_content.apache-kafka ►From Eager to Smarter in Apache Kafka Consumer Rebalances: https://www.confluent.io/blog/cooperative-rebalancing-in-kafka-streams-consumer-ksqldb/?utm_source=youtube&utm_medium=video&utm_campaign=tm.devx_ch.cd-apache-kafka-internals-101_content.apache-kafka ► Apache Kafka 101 course—Consumers https://developer.confluent.io/learn-kafka/apache-kafka/consumers/?utm_source=youtube&utm_medium=video&utm_campaign=tm.devx_ch.cd-apache-kafka-internals-101_content.apache-kafka ► Streams and Tables in Apache Kafka: Elasticity, Fault Tolerance, and Other Advanced Concepts: https://www.confluent.io/blog/kafka-streams-tables-part-4-elasticity-fault-tolerance-advanced-concepts/?utm_source=youtube&utm_medium=video&utm_campaign=tm.devx_ch.cd-apache-kafka-internals-101_content.apache-kafka#elastic ABOUT CONFLUENT Confluent is pioneering a fundamentally new category of data infrastructure focused on data in motion. Confluent’s cloud-native offering is the foundational platform for data in motion – designed to be the intelligent connective tissue enabling real-time data, from multiple sources, to constantly stream across the organization. With Confluent, organizations can meet the new business imperative of delivering rich, digital front-end customer experiences and transitioning to sophisticated, real-time, software-driven backend operations. To learn more, please visit www.confluent.io. #streamprocessing #apachekafka #kafka #confluent