# Hail MT Directory Size

**URL:** <https://discuss.hail.is/t/hail-mt-directory-size/2964>\
**Category:** Hail Query & hailctl\
**Created:** [December 6, 2022, 8:42pm UTC](https://discuss.hail.is/t/hail-mt-directory-size/2964 "2022-12-06T20:42:43Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![hpatel96](https://avatars.discourse-cdn.com/v4/letter/h/8dc957/32.png) [@hpatel96](https://discuss.hail.is/u/hpatel96)\
**Post date:** [December 6, 2022, 8:42pm UTC](https://discuss.hail.is/t/hail-mt-directory-size/2964/1 "2022-12-06T20:42:43Z")

</div>

Recently, I have been to utilize Hail to perform some analyses on the 1000 genomes phase 3 dataset (found at [https://console.cloud.google.com/storage/browser/genomics-public-data/1000-genomes-phase-3/vcf;tab=objects?pageState=(%22StorageObjectListTable%22:(%22f%22:%22%255B%255D%22))&prefix=&forceOnObjectsSortingFiltering=false](https://console.cloud.google.com/storage/browser/genomics-public-data/1000-genomes-phase-3/vcf;tab=objects?pageState=(%22StorageObjectListTable%22:(%22f%22:%22%255B%255D%22))&prefix=&forceOnObjectsSortingFiltering=false)). I downloaded the entire dataset by chromosome and utilized bcftools to concat them into one large VCF. The file size for this is roughly 800GB. After reading this large VCF into Hail and then writing it out into one big MatrixTable file, I found the size of that directory was shockingly small (less than 50GB). How is this possible?

Is there any documentation that describes how Hail stores the sample and variant information in such a way that we can have a drastic reduction in file size? What compression is being used here?

Thanks!