Comparing Kafka Streams, Akka Streams and Spark Streaming: what to use when | Rock the JVM

Written form to keep for later: https://blog.rockthejvm.com/kafka-akka-spark/ This article is for the Java/Scala programmer who wants to decide which framework to use for the streaming part of a massive application, or simply wants to know the fundamental differences between them, just in case. I'm going to write Scala, but all the frameworks I'm going to describe also have Java APIs. I'm going to discuss the main strengths and weaknesses of Akka Streams, Kafka Streams and Spark Streaming, and I'm going to give you a feel of how you would use them in a very simple word-counting application, which is one of the basic things to start with when one learns any distributed programming tool. Akka Streams: https://doc.akka.io/docs/akka/current/stream/index.html Kafka Streams: https://kafka.apache.org/documentation/streams/ Spark Streaming: https://spark.apache.org/docs/latest/streaming-programming-guide.html Contents: 0:00 intro 1:13 Kafka Streams 6:08 Akka Streams 11:31 Spark Streaming Follow Rock the JVM on: LinkedIn: https://linkedin.com/company/rockthejvm Twitter: https://twitter.com/rockthejvm Blog: https://rockthejvm.com/blog ------------------------------------------------------------------------- Home: https://rockthejvm.com -------------------------------------------------------------------------