Data Node Error

Hail Query & hailctl
1

Hello, Im facing the following error while exporting my vcf with tabix=True;

FatalError: RemoteException: File /tmp/write-table-concatenated-jM0XsUURI63GCn4sszO4ay/_temporary/0/_temporary/attempt_20210106063220_0061_m_001842_19/part-01842.bgz could only be replicated to 0 nodes instead of minReplication (=1). There are 20 datanode(s) running and no node(s) are excluded in this operation.

2

This means that HDFS (which runs on non-preemptible nodes on Google Dataproc) is filling up as we write temporary files to concatenate later. Can you share the pipeline that triggered this?