I am trying to use Hail with Dataproc Serverless on GCP. Dataproc Serverless supports Spark 3.2 and 3.3. Is Hail compatible with Spark 3.2+? If yes, is there any documentation or guidance around the usage of Hail with Dataproc Serverless?
1 Like
You have to build Hail from source for Spark 3.2. We haven’t tried using Dataproc Serverless.