I cannot use my /tmp
directory because it has too little space. Also, I think the file system sometimes cleans that directory while hail is running!
Set this environment variable with
export SPARK_LOCAL_DIRS=/path/to/myTmp
before running Hail. The user running hail must have write permission to this directory.