Ensure that driver memory setting is used.
Ensure that driver memory setting is used.

When a user sets spark.driver.memory this normally only applies to spark programs that are launched in cluster mode.  Since this is a pretty major gotcha it feels safer to just use this setting if specified by the user for the argument that ultimately becomes --driver-memory.

MaxPoint/spylon