Apache Spark Architecture - EXPLAINED!

Welcome to the introduction to Apache Spark Architecture, where we will discuss and see how the things really works. Including: * Driver and workers * Partitions * Jobs, stages, tasks * Transformations and actions * Data Shuffling * Optimizations mechanisms in Apache Spark .., and more :)