Hi Hail team, I’ve encounter a issue using the following line to load the dataset in hail mt = hl.experimental.load_dataset(name=‘dbSNP_rsid’, reference_genome=‘GRCh38’, version=“154”, region=‘us’, cloud=‘gcp’) The error message is : Hail version: 0.2.126-ee77707f4fab Error summary: HailExc…

Thanks for the prompt response, @danielgoldstein Dan! I’m currently working within the AOU workspace environment and encountered restrictions preventing me from upgrading HAIL to version 0.2.128 on my end. Do you have any suggestions for alternative methods to access the dataset? Your input would b…

Hi @Wen_He , as a temporary measure, we can fix the URL that you’re trying to access and read it directly through hail’s normal methods. The only change that we made is moving the hail-datasets-us bucket to hail-datasets-us-central1. Can you try the following? ht = hl.read_table('gs://hail-datasets-…

I’m experiencing the exact same issue, but I can’t seem to find a way to launch a dataproc cluster using the latest version of Hail as is suggested above. I have Hail v0.2.130 installed on my local machine that I use to start a dataproc cluster. But then inside that cluster Hail v0.2.120 is being in…

Hi @Austin_Argentieri , sorry you’re running into issues! This sounds like a python environment problem, could you provide some diagnostic information to help us figure out what’s going on? In particular, The exact command you use to start the dataproc cluster The output of which pip pip show hail…

Hey @danielgoldstein . Thanks for your willingness to help out and for the helpful suggestion that it might be a python problem. It looks like I had python3.8 running in my venv and Hail v0.2.130 requires python > 3.9. I’ve created a new venv with python 3.10 and the problem is fixed!

Error in load_dataset()

Hail Query & hailctl

danielgoldstein April 10, 2024, 2:52pm 2

Hi @Wen_He, please see this post. Unfortunately due to Google pricing changes we had to move our datasets to regional buckets. Upgrading to 0.2.128 should fix the issue.

Topic		Replies	Views
Error 403 Forbidden when I try to load the hail experimental dataset '1000_Genomes_autosomes' Hail Query & hailctl	15	992	October 29, 2020
IOException: No FileSystem for scheme: gs Hail Batch & General Cloud	6	1828	November 2, 2021
Reading VDS from google bucket fires error Help [0.1]	9	3955	May 13, 2017
Incompatible file format ,supported version: 1.1.0, found 1.2.0 Hail Query & hailctl	2	661	December 11, 2019
Hail tutorial_data.tar download "disappears" on Google Cloud Help [0.1]	5	1099	March 6, 2018

Error in load_dataset()

Related topics