Looks right. I don’t understand what the Spark cluster is doing. You’ll need to get more information about the hanging executors. AFAICT, your job is taking about 13 seconds for the vast majority of the work
Looks right. I don’t understand what the Spark cluster is doing. You’ll need to get more information about the hanging executors. AFAICT, your job is taking about 13 seconds for the vast majority of the work