Deployment Changes - branching off for faster development

Late this week we made some organizational changes to the GitHub repository and the automatic build deployment system.

  1. Git branches. Use the 0.1 branch on the GitHub repository, not master! We’ve forked off 0.1 as a separate git branch, which we’ll continue to support with bug fixes but will not be receiving new features. All development is continuing on the master branch, which is not stable and has no guarantees about day-to-day interface or file format compatibility.

  2. Cloud build location changes. We’ve introduced better organization to the deployment system. Previously, jars and python zips were found here:

gs://hail-common/hail-hail-is-master-all-spark${SPARK}-${HASH}.jar
gs://hail-common/pyhail-hail-is-master-${HASH}.zip

Now, the various deployments can be found here:

$ gsutil ls -lhr gs://hail-common/builds                                                                  ✓  1274  10:12:29
gs://hail-common/builds/:

gs://hail-common/builds/0.1/:
       8 B  2017-07-28T00:44:55Z  gs://hail-common/builds/0.1/latest-hash-spark-2.0.2.txt
       8 B  2017-07-28T00:20:45Z  gs://hail-common/builds/0.1/latest-hash-spark-2.1.0.txt

gs://hail-common/builds/0.1/jars/:
 27.62 MiB  2017-07-28T20:32:06Z  gs://hail-common/builds/0.1/jars/hail-0.1-0320a61-Spark-2.0.2.jar
 27.62 MiB  2017-07-28T20:32:10Z  gs://hail-common/builds/0.1/jars/hail-0.1-0320a61-Spark-2.1.0.jar
 27.62 MiB  2017-07-27T22:16:15Z  gs://hail-common/builds/0.1/jars/hail-0.1-0d9d9fa-Spark-2.0.2.jar
 27.62 MiB  2017-07-27T22:16:20Z  gs://hail-common/builds/0.1/jars/hail-0.1-0d9d9fa-Spark-2.1.0.jar

gs://hail-common/builds/0.1/python/:
658.85 KiB  2017-07-28T20:32:12Z  gs://hail-common/builds/0.1/python/hail-0.1-0320a61.zip
658.93 KiB  2017-07-27T22:16:22Z  gs://hail-common/builds/0.1/python/hail-0.1-0d9d9fa.zip
658.96 KiB  2017-07-27T19:54:30Z  gs://hail-common/builds/0.1/python/hail-0.1-47e9887.zip

gs://hail-common/builds/devel/:
       8 B  2017-07-28T15:43:16Z  gs://hail-common/builds/devel/latest-hash-spark-2.0.2.txt
       8 B  2017-07-28T15:30:27Z  gs://hail-common/builds/devel/latest-hash-spark-2.1.0.txt

gs://hail-common/builds/devel/jars/:
 27.62 MiB  2017-07-28T00:26:17Z  gs://hail-common/builds/devel/jars/hail-devel-0320a61-Spark-2.0.2.jar
 27.62 MiB  2017-07-28T00:22:59Z  gs://hail-common/builds/devel/jars/hail-devel-0320a61-Spark-2.1.0.jar
 27.62 MiB  2017-07-28T20:32:21Z  gs://hail-common/builds/devel/jars/hail-devel-b1cc51e-Spark-2.0.2.jar
 27.62 MiB  2017-07-28T20:32:23Z  gs://hail-common/builds/devel/jars/hail-devel-b1cc51e-Spark-2.1.0.jar

gs://hail-common/builds/devel/python/:
658.55 KiB  2017-07-28T00:26:20Z  gs://hail-common/builds/devel/python/hail-devel-0320a61.zip
658.83 KiB  2017-07-28T20:32:25Z  gs://hail-common/builds/devel/python/hail-devel-b1cc51e.zip
TOTAL: 17 objects, 235050851 bytes (224.16 MiB)

We updated the cloud tools repository (https://github.com/Nealelab/cloud-tools) to reflect these changes.