Using the export VCF function seems to yield an empty VCF file but the logs look good – any idea why or what to try next? [Screen Shot 2020-03-02 at 9.29.06 AM]

My first guess is that your touch command made an empty one, and that the real one is written somewhere else that you don’t expect.

Try doing this again without doing the touch first and with a name of a file that doesn’t already exist. It’s possible that hail is just refusing to overwrite a file that already exists and not throwing an error message. If that’s the case, we should change it so it does throw an error message.

My guess here is that it’s actually writing to an HDFS filesystem - is this on Google Cloud?

@konradjk it is on Google Cloud – whats the best way to export in that case? @johnc1231 A different failure when I don’t have a touch statement: [Screen Shot 2020-03-03 at 3.22.31 PM]

You’ll see it if you !hdfs dfs -ls - since you’re on google cloud, you could also just put it on google cloud storage directly by specifying a gs:// path like: hl.export_vcf(mt, 'gs://bucket/path/to/file.vcf.bgz') - it will (b)gzip it for free if you add that extension so that you can move around le…

Export VCF empty output

Hail Query & hailctl

ruchim March 25, 2020, 7:50pm 7

@konradjk that makes perfect sense – will do thank you!

Topic		Replies	Views
Hail Exception crash during export step - how to diagnose Hail Query & hailctl	4	1054	June 3, 2019
VCF exporting issue Hail Query & hailctl	4	489	June 8, 2020
No space left on device - export_vcf Help [0.1]	3	1045	March 29, 2018
Hail export_vcf() extremely slow and stalls Hail Query & hailctl	4	661	February 2, 2023
Task failed while writing rows Hail Query & hailctl	2	1853	June 15, 2022

Export VCF empty output

Related topics