Hi Wendy,
I think you’re spot on about the jar issue. Looks like the exact same one as this post: ClassNotFoundException: is.hail.asm4s.AsmFunction2
It seems as though I was wrong about the jar path configuration for the driver, but right about the configuration for the executor. Try this:
--conf "spark.driver.extraClassPath=build/libs/hail-all-spark.jar"
--conf "spark.executor.extraClassPath=./hail-all-spark.jar"