Advancing Spark - Understanding the Spark UI

When we first started with Spark, the Spark UI pages were something of a mystery, an arcane source of mysterious, hidden knowledge. Looking back, it's something that is so, so useful for understanding your spark cluster, diagnosing user issues and deciding whether your cluster is correctly sized. In this video, Simon gives a quick tour of the Spark UI, talking through the various tabs and the kind of troubleshooting/information they can provide. As always, don't forget to like & subscribe for more Sparky news, and stop by our website if you need some deeper advice, help or training around Databricks & Azure Analytics: https://www.advancinganalytics.co.uk/databricks-services