How to light your 'Spark on a stick'

Spark configuration files

There are 3 ways to change configuration options for Spark:

  • The spark-env.sh file
  • The spark-defaults.sh file
  • Changing java properties for the SparkConf()

To-do: point students to what the defaults are for the following Spark files