Connect hail to master spark server on kubernetes

I suspect the easiest thing to do is to run the install-on-cluster command in the Dockerfile that you use to generate the Docker image for your master pod.

To initialize Hail, I would just use hl.init(master='spark://...') If you need to pass special spark configuration, you can use spark_conf=.... You don’t need to set the class paths, the serializer, or the Kryo registration if you let hl.init create its own SparkContext.