2021-07-14 18:58:56 Hail: INFO: Running Hail version 0.2.69-6d2bd28a8849 2021-07-14 18:58:57 SparkContext: WARN: Using an existing SparkContext; some configuration may not take effect. 2021-07-14 18:59:19 root: INFO: RegionPool: initialized for thread 16: Thread-5 2021-07-14 18:59:28 root: INFO: RegionPool: FREE: 64.0K allocated (64.0K blocks / 0 chunks), regions.size = 1, 0 current java objects, thread 16: Thread-5 2021-07-14 18:59:28 root: INFO: timing SparkBackend.parse_value_ir total 8.878s self 8.878s children 0.000ms %children 0.00% 2021-07-14 18:59:28 root: INFO: RegionPool: initialized for thread 16: Thread-5 2021-07-14 18:59:29 root: INFO: starting execution of query hail_query_1 of initial size 330472 2021-07-14 18:59:35 root: ERROR: error while applying lowering 'optimize: relationalLowerer, initial IR' 2021-07-14 18:59:35 root: INFO: RegionPool: FREE: 64.0K allocated (64.0K blocks / 0 chunks), regions.size = 1, 0 current java objects, thread 16: Thread-5 2021-07-14 18:59:35 root: ERROR: OutOfMemoryError: Java heap space From java.lang.OutOfMemoryError: Java heap space at java.util.Arrays.copyOf(Arrays.java:3332) at java.lang.AbstractStringBuilder.ensureCapacityInternal(AbstractStringBuilder.java:124) at java.lang.AbstractStringBuilder.append(AbstractStringBuilder.java:448) at java.lang.StringBuffer.append(StringBuffer.java:270) at java.io.StringWriter.write(StringWriter.java:101) at is.hail.utils.prettyPrint.Doc$.printNode$1(PrettyPrintWriter.scala:94) at is.hail.utils.prettyPrint.Doc$.printNode$1(PrettyPrintWriter.scala:101) at is.hail.utils.prettyPrint.Doc$.scan$1(PrettyPrintWriter.scala:51) at is.hail.utils.prettyPrint.Doc$.render(PrettyPrintWriter.scala:138) at is.hail.utils.prettyPrint.Doc.render(PrettyPrintWriter.scala:163) at is.hail.utils.prettyPrint.Doc.render(PrettyPrintWriter.scala:167) at is.hail.expr.ir.Pretty$.apply(Pretty.scala:381) at is.hail.expr.ir.Optimize$.apply(Optimize.scala:9) at is.hail.expr.ir.lowering.OptimizePass.transform(LoweringPass.scala:28) at is.hail.expr.ir.lowering.LoweringPass.$anonfun$apply$3(LoweringPass.scala:15) at is.hail.expr.ir.lowering.LoweringPass$$Lambda$1572/434474181.apply(Unknown Source) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.lowering.LoweringPass.$anonfun$apply$1(LoweringPass.scala:15) at is.hail.expr.ir.lowering.LoweringPass$$Lambda$1568/17943002.apply(Unknown Source) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.lowering.LoweringPass.apply(LoweringPass.scala:13) at is.hail.expr.ir.lowering.LoweringPass.apply$(LoweringPass.scala:12) at is.hail.expr.ir.lowering.OptimizePass.apply(LoweringPass.scala:24) at is.hail.expr.ir.lowering.LoweringPipeline.$anonfun$apply$1(LoweringPipeline.scala:14) at is.hail.expr.ir.lowering.LoweringPipeline.$anonfun$apply$1$adapted(LoweringPipeline.scala:12) at is.hail.expr.ir.lowering.LoweringPipeline$$Lambda$1567/1599257071.apply(Unknown Source) at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36) at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33) at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:38) at is.hail.expr.ir.lowering.LoweringPipeline.apply(LoweringPipeline.scala:12) at is.hail.expr.ir.CompileAndEvaluate$._apply(CompileAndEvaluate.scala:29) at is.hail.backend.spark.SparkBackend._execute(SparkBackend.scala:381) 2021-07-14 18:59:42 SparkContext: INFO: Invoking stop() from shutdown hook 2021-07-14 18:59:42 AbstractConnector: INFO: Stopped Spark@3fd42676{HTTP/1.1, (http/1.1)}{0.0.0.0:4040} 2021-07-14 18:59:42 SparkUI: INFO: Stopped Spark web UI at http://192.168.8.102:4040 2021-07-14 18:59:42 MapOutputTrackerMasterEndpoint: INFO: MapOutputTrackerMasterEndpoint stopped! 2021-07-14 18:59:42 MemoryStore: INFO: MemoryStore cleared 2021-07-14 18:59:42 BlockManager: INFO: BlockManager stopped 2021-07-14 18:59:42 BlockManagerMaster: INFO: BlockManagerMaster stopped 2021-07-14 18:59:42 OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: INFO: OutputCommitCoordinator stopped! 2021-07-14 18:59:42 SparkContext: INFO: Successfully stopped SparkContext 2021-07-14 18:59:42 ShutdownHookManager: INFO: Shutdown hook called 2021-07-14 18:59:42 ShutdownHookManager: INFO: Deleting directory /tmp/spark-0e4b3a77-2da7-4539-a7c7-96b3d1e315b4 2021-07-14 18:59:42 ShutdownHookManager: INFO: Deleting directory /tmp/spark-7f4da2bf-a692-43c8-949f-b63e995404bc 2021-07-14 18:59:42 ShutdownHookManager: INFO: Deleting directory /tmp/spark-7f4da2bf-a692-43c8-949f-b63e995404bc/pyspark-4824e681-97fa-4352-bb05-6e5c086fdc07