Hi,
Received this message when trying to start a dataproc cluster with VEP support -
RuntimeError: The --vep argument is not currently provided in your region. Please contact the Hail team on https://discuss.hail.is for support
What would it take to set it up? Unfortunately we cannot move our data to one of the supported regions.
Cheers,
Simon
Won’t take much to set up I think, I’ll discuss with team on Monday. We just moved the VEP data recently to this region based system because we got a large data egress bill from some EU users pulling data from the US. I only replicated the data in regions I knew we had hail/vep/gcp users. So you’re in australia-southeast-1?
Yep - australia-southeast-1 would be perfect.
Completely understand about the egress bill. And I’m sure in the end performnce will never be good with people pulling data across regions (including myself).
Thanks for the followup and let me know if there is anything I can do to help (testing, etc).
Cheers,
Simon
There is a pull request fixing this for you now: https://github.com/hail-is/hail/pull/8340. Data is already replicated for Australia. So this will work in 0.2.35 when it releases, and once this PR goes in, you could install hail from source if needed.
Fantastic! Thanks for doing this so quickly. Will see if I can give the PR a try.
Cheers,
Simon
PR is merged, so master should be fine. If it would be helpful / if installing from source proves difficult, I can send you a python wheel to pip install that contains the right change. Not sure when we expect the release of 0.2.35.
Hail 0.2.35 has been released, which contains hailctl support for Australian Vep