# Slurm Jobs and Hail

**URL:** <https://discuss.hail.is/t/slurm-jobs-and-hail/132>\
**Category:** Help \[0.1\]\
**Created:** [February 22, 2017, 2:33pm UTC](https://discuss.hail.is/t/slurm-jobs-and-hail/132 "2017-02-22T14:33:27Z")\
**Posts on this page:** 5\
**Page:** 1

<div class="post-metadata">

**Author:** ![natestockham](https://avatars.discourse-cdn.com/v4/letter/n/e0b2c6/32.png) [@natestockham](https://discuss.hail.is/u/natestockham)\
**Post date:** [February 22, 2017, 2:33pm UTC](https://discuss.hail.is/t/slurm-jobs-and-hail/132/1 "2017-02-22T14:33:27Z")

</div>

Has anyone used Slurm as a submission system for hail to a local cluster? I’m in the middle of setting it up and wanted to make sure I understood how to let hail know it has X many cpus available with Y amount of memory. Thanks!

---

<div class="post-metadata">

**Author:** ![tpoterba](https://yyz2.discourse-cdn.com/flex036/user_avatar/discuss.hail.is/tpoterba/32/61_2.png) [@tpoterba](https://discuss.hail.is/u/tpoterba)\
**Post date:** [February 22, 2017, 4:10pm UTC](https://discuss.hail.is/t/slurm-jobs-and-hail/132/2 "2017-02-22T16:10:10Z")

</div>

Hi Nate,  
The real question is setting up Spark – running Hail is pretty easy when you’ve got a Spark cluster running.

I found a page here: [https://www.princeton.edu/researchcomputing/faq/spark-via-slurm/](https://www.princeton.edu/researchcomputing/faq/spark-via-slurm/)

Unfortunately, setting up Spark on top of HPC submission engines isn’t super simple, and I think this is going to be a problem for a lot of people.

---

<div class="post-metadata">

**Author:** ![natestockham](https://avatars.discourse-cdn.com/v4/letter/n/e0b2c6/32.png) [@natestockham](https://discuss.hail.is/u/natestockham)\
**Post date:** [February 22, 2017, 4:23pm UTC](https://discuss.hail.is/t/slurm-jobs-and-hail/132/3 "2017-02-22T16:23:15Z")

</div>

It seems like the approach would be to write a script in python importing hail, and submit that as described in the link. Or, use a jupyter notebook attached to a running spark instance. I don’t see any particular roadblock here, though I have yet to try it. If the cluster can run spark, what other roadblocks are you anticipating?

---

<div class="post-metadata">

**Author:** ![tpoterba](https://yyz2.discourse-cdn.com/flex036/user_avatar/discuss.hail.is/tpoterba/32/61_2.png) [@tpoterba](https://discuss.hail.is/u/tpoterba)\
**Post date:** [February 22, 2017, 4:26pm UTC](https://discuss.hail.is/t/slurm-jobs-and-hail/132/4 "2017-02-22T16:26:47Z")

</div>

Nope! Hail is really just a java jar and a python library. If you submit a Hail python script with `spark-submit` and supply the jar, everything should work. Let us know if things do go well! You’re not the first to have trouble with HPC systems.

---

<div class="post-metadata">

**Author:** ![natestockham](https://avatars.discourse-cdn.com/v4/letter/n/e0b2c6/32.png) [@natestockham](https://discuss.hail.is/u/natestockham)\
**Post date:** [February 22, 2017, 4:31pm UTC](https://discuss.hail.is/t/slurm-jobs-and-hail/132/5 "2017-02-22T16:31:50Z")

</div>

Great, thank you! I’ll try it out today and report back with what I find.