How to light your 'Spark on a stick'

Spark Stages UI

Open a web browser window and go to http://localhost:4040. The Spark Stages User Interface should load:

This is the user interface for a Spark application named "Spark shell" as you can see in the top right hand corner of the above screenshot.

The scheduling mode for this "Spark shell" application is First In First Out (FIFO).

The Active, Completed and Failed stages should all show 0.

We will cover the UIs more later on in this lab document, but the next few sections of the GitBook will introduce you to the Storage, Environment and Executors section of the UI.