Thanks Dan. Unfortunately that did not resolve my problem.
spark.jars /spark/spark-2.0.2/gcs-connector.jar,/hail/hail-hail-is-master-all-spark2.0.2-53e9d33.jar
spark.submit.pyFiles /hail/pyhail-hail-is-master-53e9d33.zip
spark.driver.extraClassPath /spark/spark-2.0.2/gcs-connector.jar,/hail/hail-hail-is-master-all-spark2.0.2-53e9d33.jar
spark.executor.extraClassPath /spark/spark-2.0.2/gcs-connector.jar,/hail/hail-hail-is-master-all-spark2.0.2-53e9d33.jar
spark.sql.files.maxPartitionBytes=100000000000
spark.sql.files.openCostInBytes=100000000000