Written version: https://blog.rockthejvm.com/spark-broadcast-joins/
This video is for the intermediate Spark programmer. We explore a simple but powerful Spark optimization technique for when we need to join a large dataset with a small one. We obtain a 30x performance increase on camera.
This is one of the many techniques we talk about in the Spark Optimization series at Rock the JVM. Check it out: https://rockthejvm.com/p/spark-optimization
Follow Rock the JVM on:
LinkedIn: https://linkedin.com/company/rockthejvm
Twitter: https://twitter.com/rockthejvm
Blog: https://blog.rockthejvm.com
-------------------------------------------------------------------------
Home: https://rockthejvm.com
-------------------------------------------------------------------------