Hl.maximal_independent_set - job 'cancelled because SparkContext was shut down'

Ah, sorry, I didn’t realize you were running on a single machine. Are you already setting PYSPARK_SUBMIT_ARGS?