Hi @danielgoldstein , I will try with a much lower memory configuration first and will report back. I have 50’000 partitions, I’m following the tutorials from here: hgdp_tgp/tutorials at master · atgu/hgdp_tgp (github.com). I’ve ran into some performance issues and created a post a while back (if you want to check it out, it’s this one here Slow speed when using gnomadV3 callset - Hail Query & hailctl - Hail Discussion. Thanks for your help so far!
DBScan
7
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Ld_prune OutOfMemoryError: Java heap space | 5 | 719 | January 21, 2020 | |
| Hl.maximal_independent_set - job 'cancelled because SparkContext was shut down' | 28 | 8026 | February 4, 2021 | |
| Getting java heap error tried a bunch of things with the executor and memory settings | 2 | 3519 | October 5, 2022 | |
| Error summary: OutOfMemoryError: Java heap space | 15 | 2659 | August 18, 2022 | |
| PCA job aborted from SparkException | 46 | 2752 | July 28, 2020 |