Hello, I am pretty new to hail, so please excuse if I might ask some basic questions. I would like to use existing CSQ annotations from a vcf which have been created before importing it to hail. Is there some script to smoothly extract the CSQ information in a row field, as hl.vep would do?

[image] johnnyr: Is there some script to smoothly extract the CSQ information in a row field, as hl.vep would do? I don’t know of one. Dealing with the VCF CSQ field is a nightmare. It’s probably worth it to re-vep in Hail, if you’re running on the cloud.

Thanks for the instant reply. Okay, will keep trying. So far I had some issues running it. It starts to create the respective row fields, but then it stops before adding any annotation. The last line of the log is: 2019-10-09 14:23:26 root: INFO: is/hail/codegen/generated/C_etypeEncode_78.ENCODE_o…

Just figured out that customized VEP runs (local) are probably an issue. Probably due to configuration of the vep_json_schema as I suppose. Maybe a solution is to import annotation (–tab output from VEP) as extra table and use the variant identifier like chrom_pos_ref_alt for merging.

Are you using Hail on GCP Dataproc? The hailctl utility handles all VEP configuration for you.

No, I want to (have to) use it locally. I’ve now imported output from local vep as table along with an import of the vcf. The tab output from vep only provides variant annotation but no genotypes, so this is why I have to also import the vcf. hl.import_vcf(‘VEP.vcf’,reference_genome=‘hg38’).write…

That doesn’t look like a min-repped, left aligned variant, which will create problems for joining against your dataset, if your dataset is min-repped and left aligned. What does mt.filter_rows(mt.locus == hl.locus("1", 1000)).alleles.show() print? Are you sure the VEP output doesn’t have a standar…

Same my problem. Did you find out some solutions @johnnyr ?

Unfortunately I had no time to work on it recently, but will look at it again. Will update you once I have found a solution. If you find a good one meanwhile, let me know.

Okay, here is what I can come up with so far. When performing GATK “LeftAlignAndTrimVariants” I include the option “–split-multi-allelics” to get one line each per alternate allele of a variant. Next, I have annotated a vcf using ensemble-VEP including “–pick” flag to restrict annotations to only …

Import existing VEP annotations from vcf or CSQ

Hail Query & hailctl

tpoterba October 9, 2019, 12:46pm 4

what is your pipeline?

Topic		Replies	Views
How to add annotation to a VCF file? Hail Query & hailctl	3	589	September 7, 2020
Best strategy for annotating and filtering VCF files using HAIL-VEP on UKB RAP? Hail Query & hailctl	3	1740	June 17, 2022
VEP custom annotation Help [0.1]	4	1904	January 24, 2018
Sample wise VEP annotation for Rare Variant Disease(Exome) vcf files through hail with my custom databases Hail Query & hailctl	9	475	June 12, 2023
What is the setup required to perform annotations using vep? Hail Query & hailctl	0	634	October 30, 2018

Import existing VEP annotations from vcf or CSQ

Related topics