Dear Hail Team: I keep have this error about the region when I try to initiate dataproc cluster for hail. > hailctl dataproc start exome --autoscaling-policy=max-50 **OR:** (gcloud.dataproc.clusters.create) INVALID_ARGUMENT: 'us-east1' violates constraint 'constraints/gcp.resourceLocations'. …

I’m not sure compute/region controls dataproc. Try --region for hailctl.

Your project has restrictions on where VMs can be provisioned. You should talk to whoever manages the project to learn where to be deploying clusters.

thanks, it works, --region added to the end of the hailctl commandline. Thanks very much.

Very strange using --region for hailctl, it successfully created the dataproc, but when I use this dataproc to submit my job, I have the following errors. > Hail version: 0.2.95-513139587f57 > Error summary: GoogleJsonResponseException: 403 Forbidden > GET https://storage.googleapis.com/storage/v1/…

This project is actually created by myself, and owned by my account. I have just have the computing service account and my google cloud account added to the access of an AnVIL bucket that we we previously have issues with.

Looks like the compute service account doesn’t have read access to that object in gs://fc-secure-7e69c896-d6c0-4a4e-8490-42cb2d4fdebf/o/ccdg_exome_203k.vds%2Freference_data

I have already set the region to us-east4 and zone to us-east4-c, but still have issue in starting the issue of not be able to create the dataproc. hailctl dataproc: Creating a cluster with workers of machine type n1-standard-8. Allocating 14592 MB of memory per executor (4 cores), with at leas…

Hmm. Can you paste the hailctl command line you used? Something seems wrong. I think there’s a few places that region can be specified and something is conflicting with your zone specification. Can you share the output of this? gcloud config get-value dataproc/region gcloud config get-value datapr…

[image] danking: gcloud config get-value dataproc/region $ gcloud config set dataproc/zone us-east4-c ERROR: (gcloud.config.set) Section [dataproc] has no property [zone]. gcloud config get-value dataproc/zone ERROR: (gcloud.config.get-value) Section [dataproc] has no property [zone]. gcloud…

[image] zhouhufeng: hailctl dataproc submit exome10 CCDGF3MT2VCFEXOME Now I can start the hail dataproc, but I still have the following permission issue, but the AnVIL administrator Kate has informed me this service account has been added to the bucket access permission. Hail version: 0.2.95…

Hailctl dataproc failed to start

Hail Query & hailctl

tpoterba September 22, 2022, 7:26pm 6

Same issue as here: Permission Error - #2 by tpoterba

Topic		Replies	Views
I am unable to start a new Hail dataproc cluster Hail Query & hailctl	1	59	January 21, 2025
Hail cluster creation error Hail Query & hailctl	18	2039	May 14, 2020
I got an error trying to start a new Hail cluster Hail Query & hailctl	2	1358	February 3, 2020
Using Hail on the Google Cloud Platform Help [0.1]	17	14189	September 14, 2017
Best practices for setting up GCP billing for Hail for the first time Hail Batch & General Cloud	1	247	March 21, 2024

Hailctl dataproc failed to start

Related topics