Important change is the manual setting of the partitions in parallelize. This has significantly improved cluster performance.
Important change is the manual setting of the partitions in parallelize. This has significantly improved cluster performance.

magsol/PySpark-Affinities