Kafka Transaction بالعربي With Mohamed Ragab & Ahmed Elemam - كافكا Tech Podcast بالعربي
Podcast with Mohamed Ragab
Tech Podcast بالعربي
هنتكلم مع رجب عن kafka transaction
و إزاي كافكا بيحقق ال distributed transaction
و ال exactly once idempotency
و إيه المشاكل اللي هتواجهك لو بتحاول تعمل ده
حتى لو مش هتستخدم كافكا، الحلقة مهمة لفهم ازاي بيتم تطبيق الكلام اللي بيتقال في ال distributed systems
We explained
- how Kafka transaction actually works and the design in details
- what are the limitations of transactions as low level and exactly once idempotency
- what are the limitations of isolation level read committed in consumer side
- how Kafka Prevent duplicates via idempotent producer due to leader failure and cons of this
- The transaction hanging problem
- what happen when you mark your consumer as read committed, How LSO and FUO impact the consumer side lagging but removed the out of order problem
and more ...
Agenda
Talk about Kafka Transaction and issues we face while using it.
1 - What is Kafka Transaction and why?
2 - When should / should not we use it?
3 - what is Exactly-Once Idempotency & how it happen in Kafka?
4 - What is Transaction hanging?
5 - Demo about Kafka transaction
هنا شرح لل
high water mark
https://ragab.blog/high%20water%20mark/