# Problem loading multiple csv files for annotation on DNAnexus

**URL:** <https://discuss.hail.is/t/problem-loading-multiple-csv-files-for-annotation-on-dnanexus/3002>\
**Category:** Hail Query & hailctl\
**Created:** [December 20, 2022, 1:40pm UTC](https://discuss.hail.is/t/problem-loading-multiple-csv-files-for-annotation-on-dnanexus/3002 "2022-12-20T13:40:21Z")\
**Posts on this page:** 1\
**Showing post:** 3

<div class="post-metadata">

**Author:** ![jbchang](https://yyz2.discourse-cdn.com/flex036/user_avatar/discuss.hail.is/jbchang/32/818_2.png) [@jbchang](https://discuss.hail.is/u/jbchang)\
**Post date:** [December 20, 2022, 8:26pm UTC](https://discuss.hail.is/t/problem-loading-multiple-csv-files-for-annotation-on-dnanexus/3002/3 "2022-12-20T20:26:48Z")

</div>

Thank you @danking ! Everything is working today (!). I don’t know why, but the error using **`hl.import_table()`** is no longer reproducing when I `quote='"'`. I could have sworn it was yesterday… FWIW I am using a new cluster now, which sometimes fixes things.

I was able to import all the files very quickly with the glob pattern you suggested, too!

For **pandas import** , it actually works now too!

Table output:  
 ![image](https://canada1.discourse-cdn.com/flex036/uploads/hail/original/1X/868bd863048e3c5f76f88ab3b34dbb1654162c8c.png)

Annotated matrixtable output:  
 ![image](https://canada1.discourse-cdn.com/flex036/uploads/hail/original/1X/da6f83ef99d9bddf337d5274fab2d9936331e283.png)

And a `checkpoint()` command works too.

No idea what the reason is… new cluster, perhaps.

One additional question, though, is I’m not sure **how to annotate the matrixtable** after importing all the csv files into a single ht with `hl.import_table()`. I wanted to say `ht.group_by()`, but I don’t think I want to use an aggregator. I think a series of `ht.filter()’ commands could work, but this seems like it would require ~1500 passes (for ~1500 phenotypes) through the file. Any other suggestions?

Best,  
Jeremy

---

_[View the full topic](https://discuss.hail.is/t/problem-loading-multiple-csv-files-for-annotation-on-dnanexus/3002)._
