Run Spark Jobs On Amazon Athena [FULL TUTORIAL IN 12MINS]

Have you ever been in a situation where you want to run spark code to analyse data, but don’t want to manage the underlying resources? Then using Amazon Athena’s Spark engine could be the solution for you. Amazon Athena allows you to submit spark code via fully manned spark engine in the form of a notebook. This allows you to carryout data analytics and exploration using Apache Spark without the need to plan for, configure, or manage resources. Apache Spark on Amazon Athena is serverless and provides automatic, on-demand scaling that delivers instant-on compute to meet changing data volumes and processing requirements. In this tutorial I will show you how to set up Amazon Athena to run Spark jobs and using the resources I’ve provided for free on github. LINK TO GITHUB TUTORIAL RESOURCES: 💾 Code Repo: https://github.com/johnny-chivers/spark-athena SUPPORT THE CHANNEL: ☕ Buy Me A Coffee: https://www.buymeacoffee.com/johnnychivers 🖥️ My VPN: https://go.nordvpn.net/aff_c?offer_id=612&aff_id=74288&url_id=14830 ▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬ 00:00 - Intro 01:01 - Setup Work 05:48 - Create An Athena Workgroup 06:47 - Create A Notebook 08:08 - Run Spark Code From Github 10:40 - Clean Up - Delete Resources 11:53 - Outro OTHER USEFUL LINKS: ℹ️ My Website: https://johnnychivers.co.uk 🔗 Linkedin: https://www.linkedin.com/in/johnny-chivers/ 💻 Limitations: https://docs.aws.amazon.com/athena/latest/ug/notebooks-spark.html 😎 About me I have spent the last decade being immersed in the world of big data working as a consultant for some the globe's biggest companies.My journey into the world of data was not the most conventional. I started my career working as performance analyst in professional sport at the top level's of both rugby and football. I then transitioned into a career in data and computing. This journey culminated in the study of a Masters degree in Software Enjoy 🤘