2021-09-20 11:43:13 Hail: INFO: Running Hail version 0.2.61-3c86d3ba497a 2021-09-20 11:43:13 SharedState: INFO: loading hive config file: file:/cluster/spark/conf/hive-site.xml 2021-09-20 11:43:13 SharedState: INFO: Setting hive.metastore.warehouse.dir ('null') to the value of spark.sql.warehouse.dir ('/cluster/spark/spark-warehouse'). 2021-09-20 11:43:13 SharedState: INFO: Warehouse path is '/cluster/spark/spark-warehouse'. 2021-09-20 11:43:13 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@60d1f03f{/SQL,null,AVAILABLE,@Spark} 2021-09-20 11:43:13 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@52ffdbeb{/SQL/json,null,AVAILABLE,@Spark} 2021-09-20 11:43:13 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@30a897a{/SQL/execution,null,AVAILABLE,@Spark} 2021-09-20 11:43:13 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@27616538{/SQL/execution/json,null,AVAILABLE,@Spark} 2021-09-20 11:43:13 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@b9c9bb2{/static/sql,null,AVAILABLE,@Spark} 2021-09-20 11:43:13 CoarseGrainedSchedulerBackend$DriverEndpoint: INFO: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.0.3.1:43628) with ID 0 2021-09-20 11:43:14 BlockManagerMasterEndpoint: INFO: Registering block manager ip-10-60-2-89.eu-west-2.compute.internal:44000 with 11.5 GB RAM, BlockManagerId(0, ip-10-60-2-89.eu-west-2.compute.internal, 44000, None) 2021-09-20 11:43:14 StateStoreCoordinatorRef: INFO: Registered StateStoreCoordinator endpoint 2021-09-20 11:43:14 SparkSession$Builder: WARN: Using an existing SparkSession; some configuration may not take effect. 2021-09-20 11:43:14 root: INFO: RegionPool: initialized for thread 24: Thread-4 2021-09-20 11:43:14 MemoryStore: INFO: Block broadcast_0 stored as values in memory (estimated size 1699.1 KB, free 11.5 GB) 2021-09-20 11:43:14 MemoryStore: INFO: Block broadcast_0_piece0 stored as bytes in memory (estimated size 123.7 KB, free 11.5 GB) 2021-09-20 11:43:14 BlockManagerInfo: INFO: Added broadcast_0_piece0 in memory on ip-10-60-66-122.eu-west-2.compute.internal:43001 (size: 123.7 KB, free: 11.5 GB) 2021-09-20 11:43:14 SparkContext: INFO: Created broadcast 0 from broadcast at SparkBackend.scala:250 2021-09-20 11:43:15 root: INFO: timing SparkBackend.parse_matrix_ir total 605.168ms self 605.168ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.parse_value_ir total 3.288ms self 3.288ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: starting execution of query hail_query_1 of initial size 3 2021-09-20 11:43:15 root: INFO: optimize optimize: relationalLowerer, initial IR: before: IR size 3: (TableCount (MatrixColsTable (MatrixRead None False False "{\"path\":\"file:/opt/notebooks/GIPR.mt\",\"name\":\"MatrixNativeReader\"}"))) 2021-09-20 11:43:15 root: INFO: optimize optimize: relationalLowerer, initial IR: after: IR size 1: (I64 200643) 2021-09-20 11:43:15 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: before: IR size 1: (I64 200643) 2021-09-20 11:43:15 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: after: IR size 1: (I64 200643) 2021-09-20 11:43:15 root: INFO: optimize optimize: relationalLowerer, after InterpretNonCompilable: before: IR size 1: (I64 200643) 2021-09-20 11:43:15 root: INFO: optimize optimize: relationalLowerer, after InterpretNonCompilable: after: IR size 1: (I64 200643) 2021-09-20 11:43:15 root: INFO: optimize optimize: compileLowerer, initial IR: before: IR size 2: (MakeTuple (0) (I64 200643)) 2021-09-20 11:43:15 root: INFO: optimize optimize: compileLowerer, initial IR: after: IR size 1: (Literal Tuple[Int64] ) 2021-09-20 11:43:15 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: before: IR size 1: (Literal Tuple[Int64] ) 2021-09-20 11:43:15 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: after: IR size 1: (Literal Tuple[Int64] ) 2021-09-20 11:43:15 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: before: IR size 1: (Literal Tuple[Int64] ) 2021-09-20 11:43:15 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: after: IR size 1: (Literal Tuple[Int64] ) 2021-09-20 11:43:15 root: INFO: encoder cache miss (0 hits, 1 misses, 0.000) 2021-09-20 11:43:15 root: INFO: instruction count: 3: __C8etypeEncode. 2021-09-20 11:43:15 root: INFO: instruction count: 5: __C8etypeEncode.apply 2021-09-20 11:43:15 root: INFO: instruction count: 9: __C8etypeEncode.__m9ENCODE_r_tuple_of_r_tuple_of_r_int64ENDEND_TO_r_struct_of_r_struct_of_r_int64ENDEND 2021-09-20 11:43:15 root: INFO: instruction count: 13: __C8etypeEncode.__m10ENCODE_r_tuple_of_r_int64END_TO_r_struct_of_r_int64END 2021-09-20 11:43:15 root: INFO: instruction count: 4: __C8etypeEncode.__m11ENCODE_r_int64_TO_r_int64 2021-09-20 11:43:15 MemoryStore: INFO: Block broadcast_1 stored as values in memory (estimated size 80.0 B, free 11.5 GB) 2021-09-20 11:43:15 MemoryStore: INFO: Block broadcast_1_piece0 stored as bytes in memory (estimated size 67.0 B, free 11.5 GB) 2021-09-20 11:43:15 BlockManagerInfo: INFO: Added broadcast_1_piece0 in memory on ip-10-60-66-122.eu-west-2.compute.internal:43001 (size: 67.0 B, free: 11.5 GB) 2021-09-20 11:43:15 SparkContext: INFO: Created broadcast 1 from broadcast at SparkBackend.scala:250 2021-09-20 11:43:15 root: INFO: instruction count: 3: __C1Compiled. 2021-09-20 11:43:15 root: INFO: instruction count: 3: __C1Compiled.apply 2021-09-20 11:43:15 root: INFO: instruction count: 9: __C1Compiled.setPartitionIndex 2021-09-20 11:43:15 root: INFO: instruction count: 4: __C1Compiled.addPartitionRegion 2021-09-20 11:43:15 root: INFO: instruction count: 23: __C1Compiled.__m5DECODE_r_struct_of_r_struct_of_r_int64ENDEND_TO_r_tuple_of_r_tuple_of_r_int64ENDEND 2021-09-20 11:43:15 root: INFO: instruction count: 15: __C1Compiled.__m6INPLACE_DECODE_r_struct_of_r_int64END_TO_r_tuple_of_r_int64END 2021-09-20 11:43:15 root: INFO: instruction count: 8: __C1Compiled.__m7INPLACE_DECODE_r_int64_TO_r_int64 2021-09-20 11:43:15 root: INFO: instruction count: 32: __C1Compiled.addLiterals 2021-09-20 11:43:15 root: INFO: finished execution of query hail_query_1 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON total 301.093ms self 48.642ms children 252.451ms %children 83.84% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR total 70.306ms self 0.425ms children 69.881ms %children 99.40% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/Verify total 0.239ms self 0.239ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation total 69.624ms self 40.614ms children 29.009ms %children 41.67% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize total 29.009ms self 0.915ms children 28.095ms %children 96.85% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/FoldConstants total 2.536ms self 2.536ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ExtractIntervalFilters total 3.160ms self 3.160ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/Simplify total 8.826ms self 8.826ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardLets total 4.574ms self 4.574ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.904ms self 0.904ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/PruneDeadFields total 7.918ms self 7.918ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/FoldConstants total 0.041ms self 0.041ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.004ms self 0.004ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/Simplify total 0.013ms self 0.013ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardLets total 0.082ms self 0.082ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.012ms self 0.012ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/PruneDeadFields total 0.023ms self 0.023ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/Verify total 0.018ms self 0.018ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/LowerMatrixToTable total 4.804ms self 0.012ms children 4.792ms %children 99.76% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/LowerMatrixToTable/Verify total 0.003ms self 0.003ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/LowerMatrixToTable/LoweringTransformation total 4.774ms self 4.774ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/LowerMatrixToTable/Verify total 0.016ms self 0.016ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable total 0.511ms self 0.010ms children 0.501ms %children 98.03% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/Verify total 0.002ms self 0.002ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation total 0.495ms self 0.305ms children 0.191ms %children 38.50% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize total 0.191ms self 0.017ms children 0.174ms %children 91.10% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/FoldConstants total 0.034ms self 0.034ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.006ms self 0.006ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/Simplify total 0.013ms self 0.013ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ForwardLets total 0.084ms self 0.084ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ForwardRelationalLets total 0.014ms self 0.014ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/PruneDeadFields total 0.023ms self 0.023ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/Verify total 0.004ms self 0.004ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/InterpretNonCompilable total 0.955ms self 0.015ms children 0.940ms %children 98.48% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/InterpretNonCompilable/Verify total 0.004ms self 0.004ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/InterpretNonCompilable/LoweringTransformation total 0.817ms self 0.817ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/InterpretNonCompilable/Verify total 0.119ms self 0.119ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable total 0.448ms self 0.008ms children 0.440ms %children 98.27% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/Verify total 0.002ms self 0.002ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation total 0.435ms self 0.267ms children 0.168ms %children 38.56% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize total 0.168ms self 0.016ms children 0.152ms %children 90.69% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/FoldConstants total 0.033ms self 0.033ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.006ms self 0.006ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/Simplify total 0.012ms self 0.012ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ForwardLets total 0.068ms self 0.068ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ForwardRelationalLets total 0.011ms self 0.011ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/PruneDeadFields total 0.022ms self 0.022ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/Verify total 0.003ms self 0.003ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile total 167.284ms self 145.907ms children 21.378ms %children 12.78% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR total 12.318ms self 0.010ms children 12.307ms %children 99.92% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/Verify total 0.005ms self 0.005ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation total 12.298ms self 5.864ms children 6.434ms %children 52.32% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize total 6.434ms self 0.048ms children 6.386ms %children 99.25% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/FoldConstants total 6.076ms self 6.076ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.012ms self 0.012ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/Simplify total 0.013ms self 0.013ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ForwardLets total 0.072ms self 0.072ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.011ms self 0.011ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/PruneDeadFields total 0.056ms self 0.056ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/FoldConstants total 0.038ms self 0.038ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.004ms self 0.004ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/Simplify total 0.011ms self 0.011ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ForwardLets total 0.062ms self 0.062ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.010ms self 0.010ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/PruneDeadFields total 0.022ms self 0.022ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/Verify total 0.004ms self 0.004ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/InlineApplyIR total 0.192ms self 0.006ms children 0.186ms %children 96.74% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/InlineApplyIR/Verify total 0.004ms self 0.004ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/InlineApplyIR/LoweringTransformation total 0.175ms self 0.175ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/InlineApplyIR/Verify total 0.007ms self 0.007ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR total 0.467ms self 0.007ms children 0.459ms %children 98.46% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/Verify total 0.002ms self 0.002ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation total 0.455ms self 0.280ms children 0.174ms %children 38.35% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize total 0.174ms self 0.016ms children 0.159ms %children 91.04% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/FoldConstants total 0.030ms self 0.030ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.006ms self 0.006ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/Simplify total 0.012ms self 0.012ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/ForwardLets total 0.076ms self 0.076ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.011ms self 0.011ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/PruneDeadFields total 0.023ms self 0.023ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/Verify total 0.003ms self 0.003ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/LowerArrayAggsToRunAggs total 7.868ms self 0.011ms children 7.857ms %children 99.86% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/LowerArrayAggsToRunAggs/Verify total 0.004ms self 0.004ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/LowerArrayAggsToRunAggs/LoweringTransformation total 7.723ms self 7.723ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/LowerArrayAggsToRunAggs/Verify total 0.130ms self 0.130ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs total 0.533ms self 0.008ms children 0.526ms %children 98.59% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/Verify total 0.002ms self 0.002ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation total 0.521ms self 0.329ms children 0.192ms %children 36.87% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize total 0.192ms self 0.019ms children 0.173ms %children 90.36% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/FoldConstants total 0.044ms self 0.044ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.007ms self 0.007ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/Simplify total 0.012ms self 0.012ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/ForwardLets total 0.072ms self 0.072ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/ForwardRelationalLets total 0.015ms self 0.015ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/PruneDeadFields total 0.023ms self 0.023ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/Verify total 0.003ms self 0.003ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/InitializeCompiledFunction total 6.713ms self 6.713ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/RunCompiledFunction total 0.009ms self 0.009ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/convertRegionValueToAnnotation total 1.420ms self 1.420ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.parse_value_ir total 10.060ms self 10.060ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: starting execution of query hail_query_2 of initial size 28 2021-09-20 11:43:15 root: INFO: optimize optimize: relationalLowerer, initial IR: before: IR size 28: (ToArray (StreamMap __uid_4 (ToStream False (GetField rows (TableCollect (TableHead 0 (TableMapRows (MatrixColsTable (MatrixMapCols () (MatrixMapGlobals (MatrixMapCols None (MatrixRead None False False "{\"path\":\"file:/opt/notebooks/GIPR.mt\",\"name\":\"MatrixNativeReader\"}") (InsertFields (SelectFields (s) (SelectFields (s) (Ref sa))) None)) (InsertFields (SelectFields () (SelectFields () (Ref global))) None)) (SelectFields (s) (Ref sa)))) (InsertFields (SelectFields (s) (SelectFields (s) (Ref row))) None)))))) (GetField s (Ref __uid_4)))) 2021-09-20 11:43:15 root: INFO: optimize optimize: relationalLowerer, initial IR: after: IR size 12: (ToArray (StreamMap __iruid_2 (ToStream False (GetField rows (TableCollect (MatrixColsTable (MatrixMapCols () (MatrixColsHead 0 (MatrixRead Matrix{global:Struct{},col_key:[s],col:Struct{s:String},row_key:[[locus]],row:Struct{locus:Locus(GRCh38)},entry:Struct{}} False False "{\"path\":\"file:/opt/notebooks/GIPR.mt\",\"name\":\"MatrixNativeReader\"}")) (Ref sa)))))) (GetField s (Ref __iruid_2)))) 2021-09-20 11:43:15 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: before: IR size 59: (ToArray (StreamMap __iruid_2 (ToStream False (GetField rows (TableCollect (TableKeyBy () False (TableParallelize None (Let __cols_and_globals (TableGetGlobals (TableMapGlobals (TableMapRows (TableMapGlobals (TableMapGlobals (TableRead Table{global:Struct{},key:[locus],row:Struct{locus:Locus(GRCh38),`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{}]}} False "{\"name\":\"TableNativeZippedReader\",\"pathLeft\":\"file:/opt/notebooks/GIPR.mt/rows\",\"pathRight\":\"file:/opt/notebooks/GIPR.mt/entries\",\"specLeft\":{\"name\":\"TableSpec\",\"params\":{\"file_version\":66816,\"hail_version\":\"0.2.61-3c86d3ba497a\",\"references_rel_path\":\"../references\",\"table_type\":\"Table{global:Struct{},key:[locus],row:Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AF:Array[Float64],AQ:Array[Int32],AC:Array[Int32],AN:Int32}}}\",\"components\":{\"globals\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"../globals/rows\"},\"rows\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"rows\"},\"partition_counts\":{\"name\":\"PartitionCountsComponentSpec\",\"counts\":[828]}}},\"globalsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[],\"required\":true},\"_vType\":{\"fields\":[]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_partFiles\":[\"part-0\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}},\"rowsSpec\":{\"_key\":[\"locus\"],\"_codecSpec\":{\"_eType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0},{\"name\":\"alleles\",\"typ\":{\"elementType\":{},\"required\":true},\"index\":1},{\"name\":\"rsid\",\"typ\":{},\"index\":2},{\"name\":\"qual\",\"typ\":{},\"index\":3},{\"name\":\"filters\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":4},{\"name\":\"info\",\"typ\":{\"fields\":[{\"name\":\"AF\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":0},{\"name\":\"AQ\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":1},{\"name\":\"AC\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":2},{\"name\":\"AN\",\"typ\":{},\"index\":3}],\"required\":true},\"index\":5}],\"required\":true},\"_vType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0},{\"name\":\"alleles\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"rsid\",\"typ\":{},\"index\":2},{\"name\":\"qual\",\"typ\":{},\"index\":3},{\"name\":\"filters\",\"typ\":{\"elementType\":{}},\"index\":4},{\"name\":\"info\",\"typ\":{\"fields\":[{\"name\":\"AF\",\"typ\":{\"elementType\":{}},\"index\":0},{\"name\":\"AQ\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"AC\",\"typ\":{\"elementType\":{}},\"index\":2},{\"name\":\"AN\",\"typ\":{},\"index\":3}]},\"index\":5}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_indexSpec\":{\"_relPath\":\"../../index\",\"_leafCodec\":{\"_eType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":2}],\"required\":true},\"required\":true},\"index\":1}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":2}]}},\"index\":1}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_internalNodeCodec\":{\"_eType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":4}],\"required\":true},\"required\":true},\"index\":0}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":4}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_keyType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"_annotationType\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]}},\"_partFiles\":[\"part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7\"],\"_jRangeBounds\":[{\"start\":{\"locus\":{\"contig\":\"chr19\",\"position\":45668221}},\"end\":{\"locus\":{\"contig\":\"chr19\",\"position\":45683722}},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}}},\"specRight\":{\"name\":\"TableSpec\",\"params\":{\"file_version\":66816,\"hail_version\":\"0.2.61-3c86d3ba497a\",\"references_rel_path\":\"../references\",\"table_type\":\"Table{global:Struct{},key:[],row:Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{GT:Call,RNC:Array[String],DP:Int32,AD:Array[Int32],GQ:Int32,PL:Array[Int32]}]}}\",\"components\":{\"globals\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"../globals/rows\"},\"rows\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"rows\"},\"partition_counts\":{\"name\":\"PartitionCountsComponentSpec\",\"counts\":[828]}}},\"globalsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[],\"required\":true},\"_vType\":{\"fields\":[]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_partFiles\":[\"part-0\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}},\"rowsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[{\"name\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"GT\",\"typ\":{},\"index\":0},{\"name\":\"RNC\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":1},{\"name\":\"DP\",\"typ\":{},\"index\":2},{\"name\":\"AD\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":3},{\"name\":\"GQ\",\"typ\":{},\"index\":4},{\"name\":\"PL\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":5}],\"required\":true},\"required\":true},\"index\":0}],\"required\":true},\"_vType\":{\"fields\":[{\"name\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"GT\",\"typ\":{},\"index\":0},{\"name\":\"RNC\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"DP\",\"typ\":{},\"index\":2},{\"name\":\"AD\",\"typ\":{\"elementType\":{}},\"index\":3},{\"name\":\"GQ\",\"typ\":{},\"index\":4},{\"name\":\"PL\",\"typ\":{\"elementType\":{}},\"index\":5}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_indexSpec\":{\"_relPath\":\"../../index\",\"_leafCodec\":{\"_eType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":2}],\"required\":true},\"required\":true},\"index\":1}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":2}]}},\"index\":1}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_internalNodeCodec\":{\"_eType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":4}],\"required\":true},\"required\":true},\"index\":0}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":4}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_keyType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"_annotationType\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"_offsetField\":\"entries_offset\"},\"_partFiles\":[\"part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}}}}") (InsertFields (Ref global) None (__cols (ToArray (ReadPartition Struct{s:String} "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{s:+EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}}}" (Str "file:/opt/...")))))) (InsertFields (Ref global) None (__cols (ApplyIR sliceLeft () Array[Struct{s:String}] (GetField __cols (Ref global)) (I32 0))))) (InsertFields (Ref row) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (ApplyIR sliceLeft () Array[Struct{}] (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row)) (I32 0))))) (InsertFields (Ref global) None (__cols (ToArray (StreamMap __iruid_9 (ToStream False (ToArray (StreamRange False (I32 0) (ArrayLen (GetField __cols (Ref global))) (I32 1)))) (Let __cols_array (GetField __cols (Ref global)) (Let sa (ArrayRef (Ref __cols_array) (Ref __iruid_9) (Str "")) (Ref sa))))))))) (MakeStruct (rows (GetField __cols (Ref __cols_and_globals))) (global (SelectFields () (Ref __cols_and_globals)))))))))) (GetField s (Ref __iruid_2)))) 2021-09-20 11:43:15 root: INFO: Prune: MakeStruct: eliminating field 'global' 2021-09-20 11:43:15 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: after: IR size 24: (ToArray (StreamMap __iruid_79 (ToStream False (GetField rows (Let __iruid_80 (ApplyIR sliceLeft () Array[Struct{s:String}] (ToArray (ReadPartition Struct{s:String} "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{s:+EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}}}" (Str "file:/opt/..."))) (I32 0)) (MakeStruct (rows (ToArray (StreamMap __iruid_81 (StreamRange False (I32 0) (ArrayLen (Ref __iruid_80)) (I32 1)) (ArrayRef (Ref __iruid_80) (Ref __iruid_81) (Str ""))))))))) (GetField s (Ref __iruid_79)))) 2021-09-20 11:43:15 root: INFO: optimize optimize: relationalLowerer, after InterpretNonCompilable: before: IR size 24: (ToArray (StreamMap __iruid_79 (ToStream False (GetField rows (Let __iruid_80 (ApplyIR sliceLeft () Array[Struct{s:String}] (ToArray (ReadPartition Struct{s:String} "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{s:+EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}}}" (Str "file:/opt/..."))) (I32 0)) (MakeStruct (rows (ToArray (StreamMap __iruid_81 (StreamRange False (I32 0) (ArrayLen (Ref __iruid_80)) (I32 1)) (ArrayRef (Ref __iruid_80) (Ref __iruid_81) (Str ""))))))))) (GetField s (Ref __iruid_79)))) 2021-09-20 11:43:15 root: INFO: optimize optimize: relationalLowerer, after InterpretNonCompilable: after: IR size 24: (ToArray (StreamMap __iruid_124 (ToStream False (GetField rows (Let __iruid_125 (ApplyIR sliceLeft () Array[Struct{s:String}] (ToArray (ReadPartition Struct{s:String} "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{s:+EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}}}" (Str "file:/opt/..."))) (I32 0)) (MakeStruct (rows (ToArray (StreamMap __iruid_126 (StreamRange False (I32 0) (ArrayLen (Ref __iruid_125)) (I32 1)) (ArrayRef (Ref __iruid_125) (Ref __iruid_126) (Str ""))))))))) (GetField s (Ref __iruid_124)))) 2021-09-20 11:43:15 root: INFO: optimize optimize: compileLowerer, initial IR: before: IR size 25: (MakeTuple (0) (ToArray (StreamMap __iruid_124 (ToStream False (GetField rows (Let __iruid_125 (ApplyIR sliceLeft () Array[Struct{s:String}] (ToArray (ReadPartition Struct{s:String} "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{s:+EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}}}" (Str "file:/opt/..."))) (I32 0)) (MakeStruct (rows (ToArray (StreamMap __iruid_126 (StreamRange False (I32 0) (ArrayLen (Ref __iruid_125)) (I32 1)) (ArrayRef (Ref __iruid_125) (Ref __iruid_126) (Str ""))))))))) (GetField s (Ref __iruid_124))))) 2021-09-20 11:43:15 root: INFO: optimize optimize: compileLowerer, initial IR: after: IR size 25: (MakeTuple (0) (ToArray (StreamMap __iruid_169 (ToStream False (GetField rows (Let __iruid_170 (ApplyIR sliceLeft () Array[Struct{s:String}] (ToArray (ReadPartition Struct{s:String} "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{s:+EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}}}" (Str "file:/opt/..."))) (I32 0)) (MakeStruct (rows (ToArray (StreamMap __iruid_171 (StreamRange False (I32 0) (ArrayLen (Ref __iruid_170)) (I32 1)) (ArrayRef (Ref __iruid_170) (Ref __iruid_171) (Str ""))))))))) (GetField s (Ref __iruid_169))))) 2021-09-20 11:43:15 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: before: IR size 55: (MakeTuple (0) (ToArray (StreamMap __iruid_169 (ToStream False (GetField rows (Let __iruid_170 (Let __iruid_178 (ToArray (ReadPartition Struct{s:String} "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{s:+EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}}}" (Str "file:/opt/..."))) (Let __iruid_179 (I32 0) (If (IsNA (Ref __iruid_178)) (Ref __iruid_178) (ToArray (StreamMap __iruid_180 (StreamRange False (I32 0) (If (ApplyComparisonOp LT (Ref __iruid_179) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_178)) (Ref __iruid_179)) (If (ApplyComparisonOp LT (Ref __iruid_179) (ArrayLen (Ref __iruid_178))) (Ref __iruid_179) (ArrayLen (Ref __iruid_178)))) (I32 1)) (ArrayRef (Ref __iruid_178) (Ref __iruid_180) (Str ""))))))) (MakeStruct (rows (ToArray (StreamMap __iruid_171 (StreamRange False (I32 0) (ArrayLen (Ref __iruid_170)) (I32 1)) (ArrayRef (Ref __iruid_170) (Ref __iruid_171) (Str ""))))))))) (GetField s (Ref __iruid_169))))) 2021-09-20 11:43:15 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: after: IR size 45: (MakeTuple (0) (ToArray (StreamMap __iruid_192 (ToStream False (GetField rows (Let __iruid_193 (ToArray (ReadPartition Struct{s:String} "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{s:+EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}}}" (Str "file:/opt/..."))) (Let __iruid_194 (If (IsNA (Ref __iruid_193)) (Ref __iruid_193) (ToArray (StreamMap __iruid_195 (StreamRange False (I32 0) (If (ApplyComparisonOp LT (I32 0) (ArrayLen (Ref __iruid_193))) (I32 0) (ArrayLen (Ref __iruid_193))) (I32 1)) (ArrayRef (Ref __iruid_193) (Ref __iruid_195) (Str ""))))) (MakeStruct (rows (ToArray (StreamMap __iruid_196 (StreamRange False (I32 0) (ArrayLen (Ref __iruid_194)) (I32 1)) (ArrayRef (Ref __iruid_194) (Ref __iruid_196) (Str "")))))))))) (GetField s (Ref __iruid_192))))) 2021-09-20 11:43:15 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: before: IR size 45: (MakeTuple (0) (ToArray (StreamMap __iruid_192 (ToStream False (GetField rows (Let __iruid_193 (ToArray (ReadPartition Struct{s:String} "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{s:+EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}}}" (Str "file:/opt/..."))) (Let __iruid_194 (If (IsNA (Ref __iruid_193)) (Ref __iruid_193) (ToArray (StreamMap __iruid_195 (StreamRange False (I32 0) (If (ApplyComparisonOp LT (I32 0) (ArrayLen (Ref __iruid_193))) (I32 0) (ArrayLen (Ref __iruid_193))) (I32 1)) (ArrayRef (Ref __iruid_193) (Ref __iruid_195) (Str ""))))) (MakeStruct (rows (ToArray (StreamMap __iruid_196 (StreamRange False (I32 0) (ArrayLen (Ref __iruid_194)) (I32 1)) (ArrayRef (Ref __iruid_194) (Ref __iruid_196) (Str "")))))))))) (GetField s (Ref __iruid_192))))) 2021-09-20 11:43:15 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: after: IR size 45: (MakeTuple (0) (ToArray (StreamMap __iruid_207 (ToStream False (GetField rows (Let __iruid_208 (ToArray (ReadPartition Struct{s:String} "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{s:+EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}}}" (Str "file:/opt/..."))) (Let __iruid_209 (If (IsNA (Ref __iruid_208)) (Ref __iruid_208) (ToArray (StreamMap __iruid_210 (StreamRange False (I32 0) (If (ApplyComparisonOp LT (I32 0) (ArrayLen (Ref __iruid_208))) (I32 0) (ArrayLen (Ref __iruid_208))) (I32 1)) (ArrayRef (Ref __iruid_208) (Ref __iruid_210) (Str ""))))) (MakeStruct (rows (ToArray (StreamMap __iruid_211 (StreamRange False (I32 0) (ArrayLen (Ref __iruid_209)) (I32 1)) (ArrayRef (Ref __iruid_209) (Ref __iruid_211) (Str "")))))))))) (GetField s (Ref __iruid_207))))) 2021-09-20 11:43:15 root: INFO: encoder cache miss (0 hits, 2 misses, 0.000) 2021-09-20 11:43:15 root: INFO: instruction count: 3: __C82etypeEncode. 2021-09-20 11:43:15 root: INFO: instruction count: 5: __C82etypeEncode.apply 2021-09-20 11:43:15 root: INFO: instruction count: 13: __C82etypeEncode.__m83ENCODE_r_tuple_of_r_stringEND_TO_r_struct_of_r_binaryEND 2021-09-20 11:43:15 root: INFO: instruction count: 16: __C82etypeEncode.__m84ENCODE_r_binary_TO_r_binary 2021-09-20 11:43:15 MemoryStore: INFO: Block broadcast_2 stored as values in memory (estimated size 128.0 B, free 11.5 GB) 2021-09-20 11:43:15 MemoryStore: INFO: Block broadcast_2_piece0 stored as bytes in memory (estimated size 113.0 B, free 11.5 GB) 2021-09-20 11:43:15 BlockManagerInfo: INFO: Added broadcast_2_piece0 in memory on ip-10-60-66-122.eu-west-2.compute.internal:43001 (size: 113.0 B, free: 11.5 GB) 2021-09-20 11:43:15 SparkContext: INFO: Created broadcast 2 from broadcast at SparkBackend.scala:250 2021-09-20 11:43:15 root: INFO: instruction count: 3: __C12Compiled. 2021-09-20 11:43:15 root: INFO: instruction count: 743: __C12Compiled.apply 2021-09-20 11:43:15 root: INFO: instruction count: 23: __C12Compiled.__m19DECODE_r_struct_of_r_binaryEND_TO_r_tuple_of_r_stringEND 2021-09-20 11:43:15 root: INFO: instruction count: 31: __C12Compiled.__m20INPLACE_DECODE_r_binary_TO_r_binary 2021-09-20 11:43:15 root: INFO: instruction count: 12: __C12Compiled.__m27setup_jab 2021-09-20 11:43:15 root: INFO: instruction count: 10: __C12Compiled.__m30addIRIntermediate 2021-09-20 11:43:15 root: INFO: instruction count: 18: __C12Compiled.__m40cord 2021-09-20 11:43:15 root: INFO: instruction count: 5: __C12Compiled.__m66addIRIntermediate 2021-09-20 11:43:15 root: INFO: instruction count: 5: __C12Compiled.__m77addIRIntermediate 2021-09-20 11:43:15 root: INFO: instruction count: 5: __C12Compiled.__m78addIRIntermediate 2021-09-20 11:43:15 root: INFO: instruction count: 9: __C12Compiled.setPartitionIndex 2021-09-20 11:43:15 root: INFO: instruction count: 4: __C12Compiled.addPartitionRegion 2021-09-20 11:43:15 root: INFO: instruction count: 23: __C12Compiled.__m81DECODE_r_struct_of_r_binaryEND_TO_r_tuple_of_r_stringEND 2021-09-20 11:43:15 root: INFO: instruction count: 36: __C12Compiled.addLiterals 2021-09-20 11:43:15 root: INFO: instruction count: 487: __C12Compiled.applyregion57_84 2021-09-20 11:43:15 root: INFO: instruction count: 3: __C85applySpills. 2021-09-20 11:43:15 root: INFO: instruction count: 3: __C29FSContainer. 2021-09-20 11:43:15 root: INFO: instruction count: 28: __C29FSContainer.init_filesystem 2021-09-20 11:43:15 root: INFO: instruction count: 3: __C29FSContainer. 2021-09-20 11:43:15 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (256.0K blocks / 0 chunks), regions.size = 2, 0 current java objects, 0 max java objects, thread 24: Thread-4 2021-09-20 11:43:15 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 2, 0 current java objects, 0 max java objects, thread 24: Thread-4 2021-09-20 11:43:15 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (1.0M blocks / 0 chunks), regions.size = 2, 0 current java objects, 0 max java objects, thread 24: Thread-4 2021-09-20 11:43:15 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (2.0M blocks / 0 chunks), regions.size = 2, 0 current java objects, 0 max java objects, thread 24: Thread-4 2021-09-20 11:43:15 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (4.0M blocks / 0 chunks), regions.size = 2, 0 current java objects, 0 max java objects, thread 24: Thread-4 2021-09-20 11:43:15 root: INFO: finished execution of query hail_query_2 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON total 553.298ms self 5.283ms children 548.015ms %children 99.05% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR total 28.090ms self 0.013ms children 28.077ms %children 99.95% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/Verify total 0.039ms self 0.039ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation total 28.018ms self 8.005ms children 20.013ms %children 71.43% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize total 20.013ms self 0.162ms children 19.852ms %children 99.19% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/FoldConstants total 0.461ms self 0.461ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.690ms self 0.690ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/Simplify total 2.328ms self 2.328ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardLets total 2.993ms self 2.993ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.078ms self 0.078ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/PruneDeadFields total 8.482ms self 8.482ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/FoldConstants total 0.134ms self 0.134ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.049ms self 0.049ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/Simplify total 0.142ms self 0.142ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardLets total 0.966ms self 0.966ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.059ms self 0.059ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/PruneDeadFields total 0.898ms self 0.898ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/FoldConstants total 0.160ms self 0.160ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.053ms self 0.053ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/Simplify total 0.134ms self 0.134ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardLets total 1.201ms self 1.201ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.056ms self 0.056ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/PruneDeadFields total 0.970ms self 0.970ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, initial IR/Verify total 0.020ms self 0.020ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/LowerMatrixToTable total 101.760ms self 0.015ms children 101.745ms %children 99.99% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/LowerMatrixToTable/Verify total 0.015ms self 0.015ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/LowerMatrixToTable/LoweringTransformation total 101.327ms self 101.327ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/LowerMatrixToTable/Verify total 0.403ms self 0.403ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable total 105.338ms self 0.021ms children 105.317ms %children 99.98% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/Verify total 0.066ms self 0.066ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation total 105.216ms self 73.519ms children 31.697ms %children 30.13% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize total 31.697ms self 0.107ms children 31.589ms %children 99.66% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/FoldConstants total 2.922ms self 2.922ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ExtractIntervalFilters total 1.279ms self 1.279ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/Simplify total 16.210ms self 16.210ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ForwardLets total 2.104ms self 2.104ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ForwardRelationalLets total 0.311ms self 0.311ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/PruneDeadFields total 2.841ms self 2.841ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/FoldConstants total 0.293ms self 0.293ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.086ms self 0.086ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/Simplify total 0.379ms self 0.379ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ForwardLets total 1.250ms self 1.250ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ForwardRelationalLets total 0.090ms self 0.090ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/PruneDeadFields total 0.972ms self 0.972ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/FoldConstants total 0.270ms self 0.270ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.089ms self 0.089ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/Simplify total 0.333ms self 0.333ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ForwardLets total 1.195ms self 1.195ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ForwardRelationalLets total 0.088ms self 0.088ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/PruneDeadFields total 0.875ms self 0.875ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after LowerMatrixToTable/Verify total 0.035ms self 0.035ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/InterpretNonCompilable total 0.309ms self 0.008ms children 0.301ms %children 97.35% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/InterpretNonCompilable/Verify total 0.028ms self 0.028ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/InterpretNonCompilable/LoweringTransformation total 0.067ms self 0.067ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/InterpretNonCompilable/Verify total 0.206ms self 0.206ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable total 13.565ms self 0.009ms children 13.557ms %children 99.94% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/Verify total 0.018ms self 0.018ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation total 13.495ms self 2.349ms children 11.146ms %children 82.59% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize total 11.146ms self 0.077ms children 11.069ms %children 99.31% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/FoldConstants total 0.375ms self 0.375ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.072ms self 0.072ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/Simplify total 0.587ms self 0.587ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ForwardLets total 2.531ms self 2.531ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ForwardRelationalLets total 0.104ms self 0.104ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/PruneDeadFields total 0.984ms self 0.984ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/FoldConstants total 0.261ms self 0.261ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.073ms self 0.073ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/Simplify total 0.332ms self 0.332ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ForwardLets total 1.268ms self 1.268ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ForwardRelationalLets total 0.093ms self 0.093ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/PruneDeadFields total 1.492ms self 1.492ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/FoldConstants total 0.239ms self 0.239ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.087ms self 0.087ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/Simplify total 0.271ms self 0.271ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ForwardLets total 1.224ms self 1.224ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ForwardRelationalLets total 0.078ms self 0.078ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/PruneDeadFields total 0.997ms self 0.997ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/optimize: relationalLowerer, after InterpretNonCompilable/Verify total 0.043ms self 0.043ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile total 208.663ms self 144.314ms children 64.349ms %children 30.84% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR total 16.260ms self 0.010ms children 16.250ms %children 99.94% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/Verify total 0.015ms self 0.015ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation total 16.221ms self 2.271ms children 13.950ms %children 86.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize total 13.950ms self 0.086ms children 13.864ms %children 99.38% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/FoldConstants total 0.366ms self 0.366ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.082ms self 0.082ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/Simplify total 0.372ms self 0.372ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ForwardLets total 2.156ms self 2.156ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.100ms self 0.100ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/PruneDeadFields total 2.256ms self 2.256ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/FoldConstants total 0.256ms self 0.256ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.073ms self 0.073ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/Simplify total 0.274ms self 0.274ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ForwardLets total 3.348ms self 3.348ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.104ms self 0.104ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/PruneDeadFields total 1.028ms self 1.028ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/FoldConstants total 0.208ms self 0.208ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.094ms self 0.094ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/Simplify total 0.233ms self 0.233ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ForwardLets total 1.465ms self 1.465ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.113ms self 0.113ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/LoweringTransformation/Optimize/PruneDeadFields total 1.336ms self 1.336ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, initial IR/Verify total 0.015ms self 0.015ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/InlineApplyIR total 0.389ms self 0.009ms children 0.381ms %children 97.80% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/InlineApplyIR/Verify total 0.041ms self 0.041ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/InlineApplyIR/LoweringTransformation total 0.253ms self 0.253ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/InlineApplyIR/Verify total 0.087ms self 0.087ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR total 22.207ms self 0.010ms children 22.197ms %children 99.95% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/Verify total 0.036ms self 0.036ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation total 22.137ms self 3.044ms children 19.093ms %children 86.25% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize total 19.093ms self 0.075ms children 19.018ms %children 99.61% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/FoldConstants total 0.370ms self 0.370ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.130ms self 0.130ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/Simplify total 1.305ms self 1.305ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/ForwardLets total 3.641ms self 3.641ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.387ms self 0.387ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/PruneDeadFields total 1.495ms self 1.495ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/FoldConstants total 1.247ms self 1.247ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.144ms self 0.144ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/Simplify total 0.373ms self 0.373ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/ForwardLets total 5.376ms self 5.376ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.137ms self 0.137ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/PruneDeadFields total 0.963ms self 0.963ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/FoldConstants total 0.228ms self 0.228ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.156ms self 0.156ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/Simplify total 0.197ms self 0.197ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/ForwardLets total 1.763ms self 1.763ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.118ms self 0.118ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/LoweringTransformation/Optimize/PruneDeadFields total 0.987ms self 0.987ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after InlineApplyIR/Verify total 0.024ms self 0.024ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/LowerArrayAggsToRunAggs total 13.110ms self 0.010ms children 13.100ms %children 99.92% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/LowerArrayAggsToRunAggs/Verify total 0.097ms self 0.097ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/LowerArrayAggsToRunAggs/LoweringTransformation total 12.958ms self 12.958ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/LowerArrayAggsToRunAggs/Verify total 0.045ms self 0.045ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs total 12.383ms self 0.035ms children 12.348ms %children 99.72% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/Verify total 0.010ms self 0.010ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation total 12.322ms self 2.266ms children 10.056ms %children 81.61% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize total 10.056ms self 0.103ms children 9.953ms %children 98.98% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/FoldConstants total 0.154ms self 0.154ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.097ms self 0.097ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/Simplify total 0.291ms self 0.291ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/ForwardLets total 1.561ms self 1.561ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/ForwardRelationalLets total 0.154ms self 0.154ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/PruneDeadFields total 1.001ms self 1.001ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/FoldConstants total 0.259ms self 0.259ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.099ms self 0.099ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/Simplify total 0.202ms self 0.202ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/ForwardLets total 2.243ms self 2.243ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/ForwardRelationalLets total 0.115ms self 0.115ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/PruneDeadFields total 1.013ms self 1.013ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/FoldConstants total 0.194ms self 0.194ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.084ms self 0.084ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/Simplify total 0.204ms self 0.204ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/ForwardLets total 1.294ms self 1.294ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/ForwardRelationalLets total 0.111ms self 0.111ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/LoweringTransformation/Optimize/PruneDeadFields total 0.876ms self 0.876ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/Compile/optimize: compileLowerer, after LowerArrayAggsToRunAggs/Verify total 0.016ms self 0.016ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/InitializeCompiledFunction total 1.788ms self 1.788ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/RunCompiledFunction total 87.321ms self 87.321ms children 0.000ms %children 0.00% 2021-09-20 11:43:15 root: INFO: timing SparkBackend.executeJSON/convertRegionValueToAnnotation total 1.181ms self 1.181ms children 0.000ms %children 0.00% 2021-09-20 11:43:16 root: INFO: timing SparkBackend.parse_value_ir total 6.185ms self 6.185ms children 0.000ms %children 0.00% 2021-09-20 11:43:16 root: INFO: starting execution of query hail_query_3 of initial size 29 2021-09-20 11:43:16 root: INFO: optimize optimize: relationalLowerer, initial IR: before: IR size 29: (GetField rows (TableCollect (TableHead 11 (TableMapRows (TableMapRows (TableOrderBy () (TableMapRows (TableOrderBy (Alocus) (CastMatrixToTable "entries" "cols" (MatrixRead None False False "{\"path\":\"file:/opt/notebooks/GIPR.mt\",\"name\":\"MatrixNativeReader\"}"))) (InsertFields (SelectFields () (SelectFields (locus alleles rsid qual filters info entries) (Ref row))) None (locus (GetField locus (Ref row)))))) (InsertFields (SelectFields () (SelectFields (locus) (Ref row))) None (locus (GetField locus (Ref row))))) (InsertFields (SelectFields () (SelectFields (locus) (Ref row))) None (locus (ApplySpecial showStr () String (GetField locus (Ref row))))))))) 2021-09-20 11:43:16 root: INFO: optimize optimize: relationalLowerer, initial IR: after: IR size 22: (GetField rows (TableCollect (TableMapRows (TableHead 11 (TableOrderBy () (TableOrderBy (Alocus) (TableMapRows (CastMatrixToTable "entries" "cols" (MatrixRead Matrix{global:Struct{},col_key:[s],col:Struct{s:String},row_key:[[locus]],row:Struct{locus:Locus(GRCh38)},entry:Struct{}} False False "{\"path\":\"file:/opt/notebooks/GIPR.mt\",\"name\":\"MatrixNativeReader\"}")) (If (IsNA (Ref row)) (NA Struct{locus:Locus(GRCh38)}) (MakeStruct (locus (GetField locus (Ref row))))))))) (InsertFields (SelectFields () (Ref row)) None (locus (ApplySpecial showStr () String (GetField locus (Ref row)))))))) 2021-09-20 11:43:16 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: before: IR size 31: (GetField rows (TableCollect (TableMapRows (TableHead 11 (TableOrderBy () (TableOrderBy (Alocus) (TableMapRows (TableRename ( "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") ("entries") ("__cols") ("cols") (TableMapRows (TableMapGlobals (TableRead Table{global:Struct{},key:[locus],row:Struct{locus:Locus(GRCh38),`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{}]}} False "{\"name\":\"TableNativeZippedReader\",\"pathLeft\":\"file:/opt/notebooks/GIPR.mt/rows\",\"pathRight\":\"file:/opt/notebooks/GIPR.mt/entries\",\"specLeft\":{\"name\":\"TableSpec\",\"params\":{\"file_version\":66816,\"hail_version\":\"0.2.61-3c86d3ba497a\",\"references_rel_path\":\"../references\",\"table_type\":\"Table{global:Struct{},key:[locus],row:Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AF:Array[Float64],AQ:Array[Int32],AC:Array[Int32],AN:Int32}}}\",\"components\":{\"globals\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"../globals/rows\"},\"rows\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"rows\"},\"partition_counts\":{\"name\":\"PartitionCountsComponentSpec\",\"counts\":[828]}}},\"globalsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[],\"required\":true},\"_vType\":{\"fields\":[]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_partFiles\":[\"part-0\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}},\"rowsSpec\":{\"_key\":[\"locus\"],\"_codecSpec\":{\"_eType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0},{\"name\":\"alleles\",\"typ\":{\"elementType\":{},\"required\":true},\"index\":1},{\"name\":\"rsid\",\"typ\":{},\"index\":2},{\"name\":\"qual\",\"typ\":{},\"index\":3},{\"name\":\"filters\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":4},{\"name\":\"info\",\"typ\":{\"fields\":[{\"name\":\"AF\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":0},{\"name\":\"AQ\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":1},{\"name\":\"AC\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":2},{\"name\":\"AN\",\"typ\":{},\"index\":3}],\"required\":true},\"index\":5}],\"required\":true},\"_vType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0},{\"name\":\"alleles\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"rsid\",\"typ\":{},\"index\":2},{\"name\":\"qual\",\"typ\":{},\"index\":3},{\"name\":\"filters\",\"typ\":{\"elementType\":{}},\"index\":4},{\"name\":\"info\",\"typ\":{\"fields\":[{\"name\":\"AF\",\"typ\":{\"elementType\":{}},\"index\":0},{\"name\":\"AQ\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"AC\",\"typ\":{\"elementType\":{}},\"index\":2},{\"name\":\"AN\",\"typ\":{},\"index\":3}]},\"index\":5}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_indexSpec\":{\"_relPath\":\"../../index\",\"_leafCodec\":{\"_eType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":2}],\"required\":true},\"required\":true},\"index\":1}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":2}]}},\"index\":1}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_internalNodeCodec\":{\"_eType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":4}],\"required\":true},\"required\":true},\"index\":0}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":4}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_keyType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"_annotationType\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]}},\"_partFiles\":[\"part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7\"],\"_jRangeBounds\":[{\"start\":{\"locus\":{\"contig\":\"chr19\",\"position\":45668221}},\"end\":{\"locus\":{\"contig\":\"chr19\",\"position\":45683722}},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}}},\"specRight\":{\"name\":\"TableSpec\",\"params\":{\"file_version\":66816,\"hail_version\":\"0.2.61-3c86d3ba497a\",\"references_rel_path\":\"../references\",\"table_type\":\"Table{global:Struct{},key:[],row:Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{GT:Call,RNC:Array[String],DP:Int32,AD:Array[Int32],GQ:Int32,PL:Array[Int32]}]}}\",\"components\":{\"globals\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"../globals/rows\"},\"rows\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"rows\"},\"partition_counts\":{\"name\":\"PartitionCountsComponentSpec\",\"counts\":[828]}}},\"globalsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[],\"required\":true},\"_vType\":{\"fields\":[]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_partFiles\":[\"part-0\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}},\"rowsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[{\"name\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"GT\",\"typ\":{},\"index\":0},{\"name\":\"RNC\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":1},{\"name\":\"DP\",\"typ\":{},\"index\":2},{\"name\":\"AD\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":3},{\"name\":\"GQ\",\"typ\":{},\"index\":4},{\"name\":\"PL\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":5}],\"required\":true},\"required\":true},\"index\":0}],\"required\":true},\"_vType\":{\"fields\":[{\"name\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"GT\",\"typ\":{},\"index\":0},{\"name\":\"RNC\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"DP\",\"typ\":{},\"index\":2},{\"name\":\"AD\",\"typ\":{\"elementType\":{}},\"index\":3},{\"name\":\"GQ\",\"typ\":{},\"index\":4},{\"name\":\"PL\",\"typ\":{\"elementType\":{}},\"index\":5}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_indexSpec\":{\"_relPath\":\"../../index\",\"_leafCodec\":{\"_eType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":2}],\"required\":true},\"required\":true},\"index\":1}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":2}]}},\"index\":1}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_internalNodeCodec\":{\"_eType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":4}],\"required\":true},\"required\":true},\"index\":0}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":4}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_keyType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"_annotationType\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"_offsetField\":\"entries_offset\"},\"_partFiles\":[\"part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}}}}") (InsertFields (Ref global) None (__cols (ToArray (ReadPartition Struct{s:String} "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{s:+EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}}}" (Str "file:/opt/...")))))) (SelectFields (locus `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref row)))) (If (IsNA (Ref row)) (NA Struct{locus:Locus(GRCh38)}) (MakeStruct (locus (GetField locus (Ref row))))))))) (InsertFields (SelectFields () (Ref row)) None (locus (ApplySpecial showStr () String (GetField locus (Ref row)))))))) 2021-09-20 11:43:16 root: INFO: Prune: InsertFields: eliminating field '__cols' 2021-09-20 11:43:16 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: after: IR size 21: (GetField rows (TableCollect (TableMapRows (TableHead 11 (TableOrderBy () (TableOrderBy (Alocus) (TableMapRows (TableRead Table{global:Struct{},key:[locus],row:Struct{locus:Locus(GRCh38)}} False "{\"name\":\"TableNativeZippedReader\",\"pathLeft\":\"file:/opt/notebooks/GIPR.mt/rows\",\"pathRight\":\"file:/opt/notebooks/GIPR.mt/entries\",\"specLeft\":{\"name\":\"TableSpec\",\"params\":{\"file_version\":66816,\"hail_version\":\"0.2.61-3c86d3ba497a\",\"references_rel_path\":\"../references\",\"table_type\":\"Table{global:Struct{},key:[locus],row:Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AF:Array[Float64],AQ:Array[Int32],AC:Array[Int32],AN:Int32}}}\",\"components\":{\"globals\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"../globals/rows\"},\"rows\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"rows\"},\"partition_counts\":{\"name\":\"PartitionCountsComponentSpec\",\"counts\":[828]}}},\"globalsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[],\"required\":true},\"_vType\":{\"fields\":[]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_partFiles\":[\"part-0\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}},\"rowsSpec\":{\"_key\":[\"locus\"],\"_codecSpec\":{\"_eType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0},{\"name\":\"alleles\",\"typ\":{\"elementType\":{},\"required\":true},\"index\":1},{\"name\":\"rsid\",\"typ\":{},\"index\":2},{\"name\":\"qual\",\"typ\":{},\"index\":3},{\"name\":\"filters\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":4},{\"name\":\"info\",\"typ\":{\"fields\":[{\"name\":\"AF\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":0},{\"name\":\"AQ\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":1},{\"name\":\"AC\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":2},{\"name\":\"AN\",\"typ\":{},\"index\":3}],\"required\":true},\"index\":5}],\"required\":true},\"_vType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0},{\"name\":\"alleles\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"rsid\",\"typ\":{},\"index\":2},{\"name\":\"qual\",\"typ\":{},\"index\":3},{\"name\":\"filters\",\"typ\":{\"elementType\":{}},\"index\":4},{\"name\":\"info\",\"typ\":{\"fields\":[{\"name\":\"AF\",\"typ\":{\"elementType\":{}},\"index\":0},{\"name\":\"AQ\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"AC\",\"typ\":{\"elementType\":{}},\"index\":2},{\"name\":\"AN\",\"typ\":{},\"index\":3}]},\"index\":5}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_indexSpec\":{\"_relPath\":\"../../index\",\"_leafCodec\":{\"_eType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":2}],\"required\":true},\"required\":true},\"index\":1}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":2}]}},\"index\":1}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_internalNodeCodec\":{\"_eType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":4}],\"required\":true},\"required\":true},\"index\":0}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":4}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_keyType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"_annotationType\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]}},\"_partFiles\":[\"part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7\"],\"_jRangeBounds\":[{\"start\":{\"locus\":{\"contig\":\"chr19\",\"position\":45668221}},\"end\":{\"locus\":{\"contig\":\"chr19\",\"position\":45683722}},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}}},\"specRight\":{\"name\":\"TableSpec\",\"params\":{\"file_version\":66816,\"hail_version\":\"0.2.61-3c86d3ba497a\",\"references_rel_path\":\"../references\",\"table_type\":\"Table{global:Struct{},key:[],row:Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{GT:Call,RNC:Array[String],DP:Int32,AD:Array[Int32],GQ:Int32,PL:Array[Int32]}]}}\",\"components\":{\"globals\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"../globals/rows\"},\"rows\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"rows\"},\"partition_counts\":{\"name\":\"PartitionCountsComponentSpec\",\"counts\":[828]}}},\"globalsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[],\"required\":true},\"_vType\":{\"fields\":[]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_partFiles\":[\"part-0\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}},\"rowsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[{\"name\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"GT\",\"typ\":{},\"index\":0},{\"name\":\"RNC\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":1},{\"name\":\"DP\",\"typ\":{},\"index\":2},{\"name\":\"AD\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":3},{\"name\":\"GQ\",\"typ\":{},\"index\":4},{\"name\":\"PL\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":5}],\"required\":true},\"required\":true},\"index\":0}],\"required\":true},\"_vType\":{\"fields\":[{\"name\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"GT\",\"typ\":{},\"index\":0},{\"name\":\"RNC\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"DP\",\"typ\":{},\"index\":2},{\"name\":\"AD\",\"typ\":{\"elementType\":{}},\"index\":3},{\"name\":\"GQ\",\"typ\":{},\"index\":4},{\"name\":\"PL\",\"typ\":{\"elementType\":{}},\"index\":5}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_indexSpec\":{\"_relPath\":\"../../index\",\"_leafCodec\":{\"_eType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":2}],\"required\":true},\"required\":true},\"index\":1}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":2}]}},\"index\":1}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_internalNodeCodec\":{\"_eType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":4}],\"required\":true},\"required\":true},\"index\":0}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":4}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_keyType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"_annotationType\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"_offsetField\":\"entries_offset\"},\"_partFiles\":[\"part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}}}}") (If (IsNA (Ref row)) (NA Struct{locus:Locus(GRCh38)}) (MakeStruct (locus (GetField locus (Ref row))))))))) (InsertFields (SelectFields () (Ref row)) None (locus (ApplySpecial showStr () String (GetField locus (Ref row)))))))) 2021-09-20 11:43:16 root: INFO: interpreting non compilable node: TableCollect 2021-09-20 11:43:16 root: INFO: decoder cache miss (0 hits, 1 misses, 0.000 2021-09-20 11:43:16 root: INFO: instruction count: 3: __C91etypeDecode. 2021-09-20 11:43:16 root: INFO: instruction count: 5: __C91etypeDecode.apply 2021-09-20 11:43:16 root: INFO: instruction count: 16: __C91etypeDecode.__m92DECODE_r_struct_of_END_TO_r_tuple_of_END 2021-09-20 11:43:16 root: INFO: decoder cache miss (0 hits, 2 misses, 0.000 2021-09-20 11:43:16 root: INFO: instruction count: 3: __C93etypeDecode. 2021-09-20 11:43:16 root: INFO: instruction count: 5: __C93etypeDecode.apply 2021-09-20 11:43:16 root: INFO: instruction count: 83: __C93etypeDecode.__m94DECODE_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryANDo_binaryANDo_float64ANDo_array_of_r_binaryANDr_struct_of_o_array_of_o_float64ANDo_array_of_o_int32ANDo_array_of_o_int32ANDo_int32ENDEND_TO_r_tuple_of_r_locusEND 2021-09-20 11:43:16 root: INFO: instruction count: 22: __C93etypeDecode.__m95INPLACE_DECODE_r_struct_of_r_binaryANDr_int32END_TO_r_tuple_of_r_binaryANDr_int32END 2021-09-20 11:43:16 root: INFO: instruction count: 31: __C93etypeDecode.__m96INPLACE_DECODE_r_binary_TO_r_binary 2021-09-20 11:43:16 root: INFO: instruction count: 8: __C93etypeDecode.__m97INPLACE_DECODE_r_int32_TO_r_int32 2021-09-20 11:43:16 root: INFO: instruction count: 22: __C93etypeDecode.__m98SKIP_r_array_of_r_binary 2021-09-20 11:43:16 root: INFO: instruction count: 7: __C93etypeDecode.__m99SKIP_r_binary 2021-09-20 11:43:16 root: INFO: instruction count: 7: __C93etypeDecode.__m100SKIP_o_binary 2021-09-20 11:43:16 root: INFO: instruction count: 3: __C93etypeDecode.__m101SKIP_o_float64 2021-09-20 11:43:16 root: INFO: instruction count: 22: __C93etypeDecode.__m102SKIP_o_array_of_r_binary 2021-09-20 11:43:16 root: INFO: instruction count: 73: __C93etypeDecode.__m103SKIP_r_struct_of_o_array_of_o_float64ANDo_array_of_o_int32ANDo_array_of_o_int32ANDo_int32END 2021-09-20 11:43:16 root: INFO: instruction count: 51: __C93etypeDecode.__m104SKIP_o_array_of_o_float64 2021-09-20 11:43:16 root: INFO: instruction count: 51: __C93etypeDecode.__m105SKIP_o_array_of_o_int32 2021-09-20 11:43:16 root: INFO: instruction count: 3: __C93etypeDecode.__m106SKIP_o_int32 2021-09-20 11:43:16 MemoryStore: INFO: Block broadcast_3 stored as values in memory (estimated size 253.7 KB, free 11.5 GB) 2021-09-20 11:43:16 MemoryStore: INFO: Block broadcast_3_piece0 stored as bytes in memory (estimated size 24.3 KB, free 11.5 GB) 2021-09-20 11:43:16 BlockManagerInfo: INFO: Added broadcast_3_piece0 in memory on ip-10-60-66-122.eu-west-2.compute.internal:43001 (size: 24.3 KB, free: 11.5 GB) 2021-09-20 11:43:16 SparkContext: INFO: Created broadcast 3 from broadcast at SparkBackend.scala:250 2021-09-20 11:43:16 root: INFO: optimize optimize: compileLowerer, initial IR: before: IR size 2: (InsertFields (In +PCStruct{locus:+PCLocus(GRCh38)} 0) None) 2021-09-20 11:43:16 root: INFO: optimize optimize: compileLowerer, initial IR: after: IR size 1: (In +PCStruct{locus:+PCLocus(GRCh38)} 0) 2021-09-20 11:43:16 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: before: IR size 1: (In +PCStruct{locus:+PCLocus(GRCh38)} 0) 2021-09-20 11:43:16 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: after: IR size 1: (In +PCStruct{locus:+PCLocus(GRCh38)} 0) 2021-09-20 11:43:16 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: before: IR size 1: (In +PCStruct{locus:+PCLocus(GRCh38)} 0) 2021-09-20 11:43:16 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: after: IR size 1: (In +PCStruct{locus:+PCLocus(GRCh38)} 0) 2021-09-20 11:43:16 root: INFO: instruction count: 3: __C107Compiled. 2021-09-20 11:43:16 root: INFO: instruction count: 2: __C107Compiled.apply 2021-09-20 11:43:16 root: INFO: instruction count: 9: __C107Compiled.setPartitionIndex 2021-09-20 11:43:16 root: INFO: instruction count: 4: __C107Compiled.addPartitionRegion 2021-09-20 11:43:16 root: INFO: optimize optimize: compileLowerer, initial IR: before: IR size 10: (Coalesce (If (IsNA (In +PCStruct{locus:+PCLocus(GRCh38)} 1)) (NA Struct{locus:Locus(GRCh38)}) (MakeStruct (locus (GetField locus (In +PCStruct{locus:+PCLocus(GRCh38)} 1))))) (Die Struct{locus:Locus(GRCh38)} -1 (Str "Internal e..."))) 2021-09-20 11:43:16 root: INFO: optimize optimize: compileLowerer, initial IR: after: IR size 10: (Coalesce (If (IsNA (In +PCStruct{locus:+PCLocus(GRCh38)} 1)) (NA Struct{locus:Locus(GRCh38)}) (MakeStruct (locus (GetField locus (In +PCStruct{locus:+PCLocus(GRCh38)} 1))))) (Die Struct{locus:Locus(GRCh38)} -1 (Str "Internal e..."))) 2021-09-20 11:43:16 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: before: IR size 10: (Coalesce (If (IsNA (In +PCStruct{locus:+PCLocus(GRCh38)} 1)) (NA Struct{locus:Locus(GRCh38)}) (MakeStruct (locus (GetField locus (In +PCStruct{locus:+PCLocus(GRCh38)} 1))))) (Die Struct{locus:Locus(GRCh38)} -1 (Str "Internal e..."))) 2021-09-20 11:43:16 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: after: IR size 10: (Coalesce (If (IsNA (In +PCStruct{locus:+PCLocus(GRCh38)} 1)) (NA Struct{locus:Locus(GRCh38)}) (MakeStruct (locus (GetField locus (In +PCStruct{locus:+PCLocus(GRCh38)} 1))))) (Die Struct{locus:Locus(GRCh38)} -1 (Str "Internal e..."))) 2021-09-20 11:43:16 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: before: IR size 10: (Coalesce (If (IsNA (In +PCStruct{locus:+PCLocus(GRCh38)} 1)) (NA Struct{locus:Locus(GRCh38)}) (MakeStruct (locus (GetField locus (In +PCStruct{locus:+PCLocus(GRCh38)} 1))))) (Die Struct{locus:Locus(GRCh38)} -1 (Str "Internal e..."))) 2021-09-20 11:43:16 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: after: IR size 10: (Coalesce (If (IsNA (In +PCStruct{locus:+PCLocus(GRCh38)} 1)) (NA Struct{locus:Locus(GRCh38)}) (MakeStruct (locus (GetField locus (In +PCStruct{locus:+PCLocus(GRCh38)} 1))))) (Die Struct{locus:Locus(GRCh38)} -1 (Str "Internal e..."))) 2021-09-20 11:43:16 root: INFO: encoder cache hit 2021-09-20 11:43:16 MemoryStore: INFO: Block broadcast_4 stored as values in memory (estimated size 128.0 B, free 11.5 GB) 2021-09-20 11:43:16 MemoryStore: INFO: Block broadcast_4_piece0 stored as bytes in memory (estimated size 115.0 B, free 11.5 GB) 2021-09-20 11:43:16 BlockManagerInfo: INFO: Added broadcast_4_piece0 in memory on ip-10-60-66-122.eu-west-2.compute.internal:43001 (size: 115.0 B, free: 11.5 GB) 2021-09-20 11:43:16 SparkContext: INFO: Created broadcast 4 from broadcast at SparkBackend.scala:250 2021-09-20 11:43:16 root: INFO: instruction count: 3: __C110Compiled. 2021-09-20 11:43:16 root: INFO: instruction count: 98: __C110Compiled.apply 2021-09-20 11:43:16 root: INFO: instruction count: 10: __C110Compiled.__m113addIRIntermediate 2021-09-20 11:43:16 root: INFO: instruction count: 9: __C110Compiled.setPartitionIndex 2021-09-20 11:43:16 root: INFO: instruction count: 4: __C110Compiled.addPartitionRegion 2021-09-20 11:43:16 root: INFO: instruction count: 23: __C110Compiled.__m117DECODE_r_struct_of_r_binaryEND_TO_r_tuple_of_r_stringEND 2021-09-20 11:43:16 root: INFO: instruction count: 31: __C110Compiled.__m118INPLACE_DECODE_r_binary_TO_r_binary 2021-09-20 11:43:16 root: INFO: instruction count: 36: __C110Compiled.addLiterals 2021-09-20 11:43:16 SparkContext: INFO: Starting job: runJob at ContextRDD.scala:351 2021-09-20 11:43:16 DAGScheduler: INFO: [DNAX] Setting local property com.dnanexus.auth 2021-09-20 11:43:16 DAGScheduler: INFO: Unable to extract and set 'user' or 'containsPHI' in SparkSession 2021-09-20 11:43:16 DAGScheduler: INFO: Got job 0 (runJob at ContextRDD.scala:351) with 1 output partitions 2021-09-20 11:43:16 DAGScheduler: INFO: Final stage: ResultStage 0 (runJob at ContextRDD.scala:351) 2021-09-20 11:43:16 DAGScheduler: INFO: Parents of final stage: List() 2021-09-20 11:43:16 DAGScheduler: INFO: Missing parents: List() 2021-09-20 11:43:16 DAGScheduler: INFO: Submitting ResultStage 0 (MapPartitionsRDD[4] at mapPartitions at ContextRDD.scala:239), which has no missing parents 2021-09-20 11:43:16 MemoryStore: INFO: Block broadcast_5 stored as values in memory (estimated size 136.3 KB, free 11.5 GB) 2021-09-20 11:43:16 MemoryStore: INFO: Block broadcast_5_piece0 stored as bytes in memory (estimated size 46.3 KB, free 11.5 GB) 2021-09-20 11:43:16 BlockManagerInfo: INFO: Added broadcast_5_piece0 in memory on ip-10-60-66-122.eu-west-2.compute.internal:43001 (size: 46.3 KB, free: 11.5 GB) 2021-09-20 11:43:16 SparkContext: INFO: Created broadcast 5 from broadcast at DAGScheduler.scala:1268 2021-09-20 11:43:16 DAGScheduler: INFO: Submitting 1 missing tasks from ResultStage 0 (MapPartitionsRDD[4] at mapPartitions at ContextRDD.scala:239) (first 15 tasks are for partitions Vector(0)) 2021-09-20 11:43:16 TaskSchedulerImpl: INFO: Adding task set 0.0 with 1 tasks 2021-09-20 11:43:16 TaskSetManager: INFO: Starting task 0.0 in stage 0.0 (TID 0, ip-10-60-2-89.eu-west-2.compute.internal, executor 0, partition 0, PROCESS_LOCAL, 7900 bytes) 2021-09-20 11:43:16 BlockManagerInfo: INFO: Added broadcast_5_piece0 in memory on ip-10-60-2-89.eu-west-2.compute.internal:44000 (size: 46.3 KB, free: 11.5 GB) 2021-09-20 11:43:17 BlockManagerInfo: INFO: Added broadcast_3_piece0 in memory on ip-10-60-2-89.eu-west-2.compute.internal:44000 (size: 24.3 KB, free: 11.5 GB) 2021-09-20 11:43:17 TaskSetManager: WARN: Lost task 0.0 in stage 0.0 (TID 0, ip-10-60-2-89.eu-west-2.compute.internal, executor 0): java.io.FileNotFoundException: File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:142) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769) at is.hail.io.fs.HadoopFS.openNoCompression(HadoopFS.scala:83) at is.hail.io.fs.FS$class.open(FS.scala:139) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.io.fs.FS$class.open(FS.scala:148) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.HailContext$$anon$1.compute(HailContext.scala:276) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:123) at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-09-20 11:43:17 TaskSetManager: INFO: Starting task 0.1 in stage 0.0 (TID 1, ip-10-60-2-89.eu-west-2.compute.internal, executor 0, partition 0, PROCESS_LOCAL, 7900 bytes) 2021-09-20 11:43:17 TaskSetManager: INFO: Lost task 0.1 in stage 0.0 (TID 1) on ip-10-60-2-89.eu-west-2.compute.internal, executor 0: java.io.FileNotFoundException (File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist) [duplicate 1] 2021-09-20 11:43:17 TaskSetManager: INFO: Starting task 0.2 in stage 0.0 (TID 2, ip-10-60-2-89.eu-west-2.compute.internal, executor 0, partition 0, PROCESS_LOCAL, 7900 bytes) 2021-09-20 11:43:17 TaskSetManager: INFO: Lost task 0.2 in stage 0.0 (TID 2) on ip-10-60-2-89.eu-west-2.compute.internal, executor 0: java.io.FileNotFoundException (File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist) [duplicate 2] 2021-09-20 11:43:17 TaskSetManager: INFO: Starting task 0.3 in stage 0.0 (TID 3, ip-10-60-2-89.eu-west-2.compute.internal, executor 0, partition 0, PROCESS_LOCAL, 7900 bytes) 2021-09-20 11:43:17 TaskSetManager: INFO: Lost task 0.3 in stage 0.0 (TID 3) on ip-10-60-2-89.eu-west-2.compute.internal, executor 0: java.io.FileNotFoundException (File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist) [duplicate 3] 2021-09-20 11:43:17 TaskSetManager: ERROR: Task 0 in stage 0.0 failed 4 times; aborting job 2021-09-20 11:43:17 TaskSchedulerImpl: INFO: Removed TaskSet 0.0, whose tasks have all completed, from pool 2021-09-20 11:43:17 TaskSchedulerImpl: INFO: Cancelling stage 0 2021-09-20 11:43:17 TaskSchedulerImpl: INFO: Killing all running tasks in stage 0: Stage cancelled 2021-09-20 11:43:17 DAGScheduler: INFO: ResultStage 0 (runJob at ContextRDD.scala:351) failed in 1.200 s due to Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 3, ip-10-60-2-89.eu-west-2.compute.internal, executor 0): java.io.FileNotFoundException: File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:142) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769) at is.hail.io.fs.HadoopFS.openNoCompression(HadoopFS.scala:83) at is.hail.io.fs.FS$class.open(FS.scala:139) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.io.fs.FS$class.open(FS.scala:148) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.HailContext$$anon$1.compute(HailContext.scala:276) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:123) at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Driver stacktrace: 2021-09-20 11:43:17 DAGScheduler: INFO: Job 0 failed: runJob at ContextRDD.scala:351, took 1.238561 s 2021-09-20 11:43:17 root: ERROR: error while applying lowering 'InterpretNonCompilable' 2021-09-20 11:43:17 root: INFO: The exact same exception object, org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 3, ip-10-60-2-89.eu-west-2.compute.internal, executor 0): java.io.FileNotFoundException: File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:142) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769) at is.hail.io.fs.HadoopFS.openNoCompression(HadoopFS.scala:83) at is.hail.io.fs.FS$class.open(FS.scala:139) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.io.fs.FS$class.open(FS.scala:148) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.HailContext$$anon$1.compute(HailContext.scala:276) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:123) at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Driver stacktrace:, was thrown by both the consumer and the close method. I will throw the original. 2021-09-20 11:43:17 root: ERROR: FileNotFoundException: File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist From org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 4 times, most recent failure: Lost task 0.3 in stage 0.0 (TID 3, ip-10-60-2-89.eu-west-2.compute.internal, executor 0): java.io.FileNotFoundException: File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:142) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769) at is.hail.io.fs.HadoopFS.openNoCompression(HadoopFS.scala:83) at is.hail.io.fs.FS$class.open(FS.scala:139) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.io.fs.FS$class.open(FS.scala:148) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.HailContext$$anon$1.compute(HailContext.scala:276) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:123) at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Driver stacktrace: at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:2001) at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1984) at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1983) at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1983) at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:1033) at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:1033) at scala.Option.foreach(Option.scala:257) at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:1033) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:2223) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2172) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2161) at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:49) at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:823) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2061) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2082) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2101) at is.hail.sparkextras.ContextRDD.runJob(ContextRDD.scala:351) at is.hail.rvd.RVD$$anonfun$13.apply(RVD.scala:526) at is.hail.rvd.RVD$$anonfun$13.apply(RVD.scala:526) at is.hail.utils.PartitionCounts$.incrementalPCSubsetOffset(PartitionCounts.scala:73) at is.hail.rvd.RVD.head(RVD.scala:525) at is.hail.expr.ir.TableSubset$class.execute(TableIR.scala:1326) at is.hail.expr.ir.TableHead.execute(TableIR.scala:1332) at is.hail.expr.ir.TableMapRows.execute(TableIR.scala:1845) at is.hail.expr.ir.Interpret$.run(Interpret.scala:819) at is.hail.expr.ir.Interpret$.alreadyLowered(Interpret.scala:53) at is.hail.expr.ir.InterpretNonCompilable$.interpretAndCoerce$1(InterpretNonCompilable.scala:16) at is.hail.expr.ir.InterpretNonCompilable$.is$hail$expr$ir$InterpretNonCompilable$$rewrite$1(InterpretNonCompilable.scala:53) at is.hail.expr.ir.InterpretNonCompilable$$anonfun$1.apply(InterpretNonCompilable.scala:25) at is.hail.expr.ir.InterpretNonCompilable$$anonfun$1.apply(InterpretNonCompilable.scala:25) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:35) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.AbstractTraversable.map(Traversable.scala:104) at is.hail.expr.ir.InterpretNonCompilable$.rewriteChildren$1(InterpretNonCompilable.scala:25) at is.hail.expr.ir.InterpretNonCompilable$.is$hail$expr$ir$InterpretNonCompilable$$rewrite$1(InterpretNonCompilable.scala:54) at is.hail.expr.ir.InterpretNonCompilable$.apply(InterpretNonCompilable.scala:58) at is.hail.expr.ir.lowering.InterpretNonCompilablePass$.transform(LoweringPass.scala:67) at is.hail.expr.ir.lowering.LoweringPass$$anonfun$apply$3$$anonfun$1.apply(LoweringPass.scala:15) at is.hail.expr.ir.lowering.LoweringPass$$anonfun$apply$3$$anonfun$1.apply(LoweringPass.scala:15) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.lowering.LoweringPass$$anonfun$apply$3.apply(LoweringPass.scala:15) at is.hail.expr.ir.lowering.LoweringPass$$anonfun$apply$3.apply(LoweringPass.scala:13) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.lowering.LoweringPass$class.apply(LoweringPass.scala:13) at is.hail.expr.ir.lowering.InterpretNonCompilablePass$.apply(LoweringPass.scala:62) at is.hail.expr.ir.lowering.LoweringPipeline$$anonfun$apply$1.apply(LoweringPipeline.scala:14) at is.hail.expr.ir.lowering.LoweringPipeline$$anonfun$apply$1.apply(LoweringPipeline.scala:12) at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:35) at is.hail.expr.ir.lowering.LoweringPipeline.apply(LoweringPipeline.scala:12) at is.hail.expr.ir.CompileAndEvaluate$._apply(CompileAndEvaluate.scala:28) at is.hail.backend.spark.SparkBackend.is$hail$backend$spark$SparkBackend$$_execute(SparkBackend.scala:354) at is.hail.backend.spark.SparkBackend$$anonfun$execute$1.apply(SparkBackend.scala:338) at is.hail.backend.spark.SparkBackend$$anonfun$execute$1.apply(SparkBackend.scala:335) at is.hail.expr.ir.ExecuteContext$$anonfun$scoped$1.apply(ExecuteContext.scala:25) at is.hail.expr.ir.ExecuteContext$$anonfun$scoped$1.apply(ExecuteContext.scala:23) at is.hail.utils.package$.using(package.scala:618) at is.hail.annotations.Region$.scoped(Region.scala:18) at is.hail.expr.ir.ExecuteContext$.scoped(ExecuteContext.scala:23) at is.hail.backend.spark.SparkBackend.withExecuteContext(SparkBackend.scala:247) at is.hail.backend.spark.SparkBackend.execute(SparkBackend.scala:335) at is.hail.backend.spark.SparkBackend$$anonfun$7.apply(SparkBackend.scala:379) at is.hail.backend.spark.SparkBackend$$anonfun$7.apply(SparkBackend.scala:377) at is.hail.utils.ExecutionTimer$.time(ExecutionTimer.scala:52) at is.hail.backend.spark.SparkBackend.executeJSON(SparkBackend.scala:377) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244) at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357) at py4j.Gateway.invoke(Gateway.java:282) at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132) at py4j.commands.CallCommand.execute(CallCommand.java:79) at py4j.GatewayConnection.run(GatewayConnection.java:238) at java.lang.Thread.run(Thread.java:748) java.io.FileNotFoundException: File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:142) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769) at is.hail.io.fs.HadoopFS.openNoCompression(HadoopFS.scala:83) at is.hail.io.fs.FS$class.open(FS.scala:139) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.io.fs.FS$class.open(FS.scala:148) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.HailContext$$anon$1.compute(HailContext.scala:276) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:123) at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-09-20 11:43:17 root: INFO: timing SparkBackend.parse_value_ir total 1.310ms self 1.310ms children 0.000ms %children 0.00% 2021-09-20 11:43:17 root: INFO: starting execution of query hail_query_4 of initial size 29 2021-09-20 11:43:17 root: INFO: optimize optimize: relationalLowerer, initial IR: before: IR size 29: (GetField rows (TableCollect (TableHead 11 (TableMapRows (TableMapRows (TableOrderBy () (TableMapRows (TableOrderBy (Alocus) (CastMatrixToTable "entries" "cols" (MatrixRead None False False "{\"path\":\"file:/opt/notebooks/GIPR.mt\",\"name\":\"MatrixNativeReader\"}"))) (InsertFields (SelectFields () (SelectFields (locus alleles rsid qual filters info entries) (Ref row))) None (locus (GetField locus (Ref row)))))) (InsertFields (SelectFields () (SelectFields (locus) (Ref row))) None (locus (GetField locus (Ref row))))) (InsertFields (SelectFields () (SelectFields (locus) (Ref row))) None (locus (ApplySpecial showStr () String (GetField locus (Ref row))))))))) 2021-09-20 11:43:17 root: INFO: optimize optimize: relationalLowerer, initial IR: after: IR size 22: (GetField rows (TableCollect (TableMapRows (TableHead 11 (TableOrderBy () (TableOrderBy (Alocus) (TableMapRows (CastMatrixToTable "entries" "cols" (MatrixRead Matrix{global:Struct{},col_key:[s],col:Struct{s:String},row_key:[[locus]],row:Struct{locus:Locus(GRCh38)},entry:Struct{}} False False "{\"path\":\"file:/opt/notebooks/GIPR.mt\",\"name\":\"MatrixNativeReader\"}")) (If (IsNA (Ref row)) (NA Struct{locus:Locus(GRCh38)}) (MakeStruct (locus (GetField locus (Ref row))))))))) (InsertFields (SelectFields () (Ref row)) None (locus (ApplySpecial showStr () String (GetField locus (Ref row)))))))) 2021-09-20 11:43:17 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: before: IR size 31: (GetField rows (TableCollect (TableMapRows (TableHead 11 (TableOrderBy () (TableOrderBy (Alocus) (TableMapRows (TableRename ( "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") ("entries") ("__cols") ("cols") (TableMapRows (TableMapGlobals (TableRead Table{global:Struct{},key:[locus],row:Struct{locus:Locus(GRCh38),`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{}]}} False "{\"name\":\"TableNativeZippedReader\",\"pathLeft\":\"file:/opt/notebooks/GIPR.mt/rows\",\"pathRight\":\"file:/opt/notebooks/GIPR.mt/entries\",\"specLeft\":{\"name\":\"TableSpec\",\"params\":{\"file_version\":66816,\"hail_version\":\"0.2.61-3c86d3ba497a\",\"references_rel_path\":\"../references\",\"table_type\":\"Table{global:Struct{},key:[locus],row:Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AF:Array[Float64],AQ:Array[Int32],AC:Array[Int32],AN:Int32}}}\",\"components\":{\"globals\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"../globals/rows\"},\"rows\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"rows\"},\"partition_counts\":{\"name\":\"PartitionCountsComponentSpec\",\"counts\":[828]}}},\"globalsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[],\"required\":true},\"_vType\":{\"fields\":[]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_partFiles\":[\"part-0\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}},\"rowsSpec\":{\"_key\":[\"locus\"],\"_codecSpec\":{\"_eType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0},{\"name\":\"alleles\",\"typ\":{\"elementType\":{},\"required\":true},\"index\":1},{\"name\":\"rsid\",\"typ\":{},\"index\":2},{\"name\":\"qual\",\"typ\":{},\"index\":3},{\"name\":\"filters\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":4},{\"name\":\"info\",\"typ\":{\"fields\":[{\"name\":\"AF\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":0},{\"name\":\"AQ\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":1},{\"name\":\"AC\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":2},{\"name\":\"AN\",\"typ\":{},\"index\":3}],\"required\":true},\"index\":5}],\"required\":true},\"_vType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0},{\"name\":\"alleles\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"rsid\",\"typ\":{},\"index\":2},{\"name\":\"qual\",\"typ\":{},\"index\":3},{\"name\":\"filters\",\"typ\":{\"elementType\":{}},\"index\":4},{\"name\":\"info\",\"typ\":{\"fields\":[{\"name\":\"AF\",\"typ\":{\"elementType\":{}},\"index\":0},{\"name\":\"AQ\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"AC\",\"typ\":{\"elementType\":{}},\"index\":2},{\"name\":\"AN\",\"typ\":{},\"index\":3}]},\"index\":5}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_indexSpec\":{\"_relPath\":\"../../index\",\"_leafCodec\":{\"_eType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":2}],\"required\":true},\"required\":true},\"index\":1}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":2}]}},\"index\":1}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_internalNodeCodec\":{\"_eType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":4}],\"required\":true},\"required\":true},\"index\":0}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":4}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_keyType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"_annotationType\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]}},\"_partFiles\":[\"part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7\"],\"_jRangeBounds\":[{\"start\":{\"locus\":{\"contig\":\"chr19\",\"position\":45668221}},\"end\":{\"locus\":{\"contig\":\"chr19\",\"position\":45683722}},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}}},\"specRight\":{\"name\":\"TableSpec\",\"params\":{\"file_version\":66816,\"hail_version\":\"0.2.61-3c86d3ba497a\",\"references_rel_path\":\"../references\",\"table_type\":\"Table{global:Struct{},key:[],row:Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{GT:Call,RNC:Array[String],DP:Int32,AD:Array[Int32],GQ:Int32,PL:Array[Int32]}]}}\",\"components\":{\"globals\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"../globals/rows\"},\"rows\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"rows\"},\"partition_counts\":{\"name\":\"PartitionCountsComponentSpec\",\"counts\":[828]}}},\"globalsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[],\"required\":true},\"_vType\":{\"fields\":[]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_partFiles\":[\"part-0\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}},\"rowsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[{\"name\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"GT\",\"typ\":{},\"index\":0},{\"name\":\"RNC\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":1},{\"name\":\"DP\",\"typ\":{},\"index\":2},{\"name\":\"AD\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":3},{\"name\":\"GQ\",\"typ\":{},\"index\":4},{\"name\":\"PL\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":5}],\"required\":true},\"required\":true},\"index\":0}],\"required\":true},\"_vType\":{\"fields\":[{\"name\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"GT\",\"typ\":{},\"index\":0},{\"name\":\"RNC\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"DP\",\"typ\":{},\"index\":2},{\"name\":\"AD\",\"typ\":{\"elementType\":{}},\"index\":3},{\"name\":\"GQ\",\"typ\":{},\"index\":4},{\"name\":\"PL\",\"typ\":{\"elementType\":{}},\"index\":5}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_indexSpec\":{\"_relPath\":\"../../index\",\"_leafCodec\":{\"_eType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":2}],\"required\":true},\"required\":true},\"index\":1}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":2}]}},\"index\":1}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_internalNodeCodec\":{\"_eType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":4}],\"required\":true},\"required\":true},\"index\":0}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":4}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_keyType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"_annotationType\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"_offsetField\":\"entries_offset\"},\"_partFiles\":[\"part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}}}}") (InsertFields (Ref global) None (__cols (ToArray (ReadPartition Struct{s:String} "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{s:+EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}}}" (Str "file:/opt/...")))))) (SelectFields (locus `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref row)))) (If (IsNA (Ref row)) (NA Struct{locus:Locus(GRCh38)}) (MakeStruct (locus (GetField locus (Ref row))))))))) (InsertFields (SelectFields () (Ref row)) None (locus (ApplySpecial showStr () String (GetField locus (Ref row)))))))) 2021-09-20 11:43:17 root: INFO: Prune: InsertFields: eliminating field '__cols' 2021-09-20 11:43:17 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: after: IR size 21: (GetField rows (TableCollect (TableMapRows (TableHead 11 (TableOrderBy () (TableOrderBy (Alocus) (TableMapRows (TableRead Table{global:Struct{},key:[locus],row:Struct{locus:Locus(GRCh38)}} False "{\"name\":\"TableNativeZippedReader\",\"pathLeft\":\"file:/opt/notebooks/GIPR.mt/rows\",\"pathRight\":\"file:/opt/notebooks/GIPR.mt/entries\",\"specLeft\":{\"name\":\"TableSpec\",\"params\":{\"file_version\":66816,\"hail_version\":\"0.2.61-3c86d3ba497a\",\"references_rel_path\":\"../references\",\"table_type\":\"Table{global:Struct{},key:[locus],row:Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AF:Array[Float64],AQ:Array[Int32],AC:Array[Int32],AN:Int32}}}\",\"components\":{\"globals\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"../globals/rows\"},\"rows\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"rows\"},\"partition_counts\":{\"name\":\"PartitionCountsComponentSpec\",\"counts\":[828]}}},\"globalsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[],\"required\":true},\"_vType\":{\"fields\":[]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_partFiles\":[\"part-0\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}},\"rowsSpec\":{\"_key\":[\"locus\"],\"_codecSpec\":{\"_eType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0},{\"name\":\"alleles\",\"typ\":{\"elementType\":{},\"required\":true},\"index\":1},{\"name\":\"rsid\",\"typ\":{},\"index\":2},{\"name\":\"qual\",\"typ\":{},\"index\":3},{\"name\":\"filters\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":4},{\"name\":\"info\",\"typ\":{\"fields\":[{\"name\":\"AF\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":0},{\"name\":\"AQ\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":1},{\"name\":\"AC\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":2},{\"name\":\"AN\",\"typ\":{},\"index\":3}],\"required\":true},\"index\":5}],\"required\":true},\"_vType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0},{\"name\":\"alleles\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"rsid\",\"typ\":{},\"index\":2},{\"name\":\"qual\",\"typ\":{},\"index\":3},{\"name\":\"filters\",\"typ\":{\"elementType\":{}},\"index\":4},{\"name\":\"info\",\"typ\":{\"fields\":[{\"name\":\"AF\",\"typ\":{\"elementType\":{}},\"index\":0},{\"name\":\"AQ\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"AC\",\"typ\":{\"elementType\":{}},\"index\":2},{\"name\":\"AN\",\"typ\":{},\"index\":3}]},\"index\":5}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_indexSpec\":{\"_relPath\":\"../../index\",\"_leafCodec\":{\"_eType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":2}],\"required\":true},\"required\":true},\"index\":1}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":2}]}},\"index\":1}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_internalNodeCodec\":{\"_eType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":4}],\"required\":true},\"required\":true},\"index\":0}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":4}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_keyType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"_annotationType\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]}},\"_partFiles\":[\"part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7\"],\"_jRangeBounds\":[{\"start\":{\"locus\":{\"contig\":\"chr19\",\"position\":45668221}},\"end\":{\"locus\":{\"contig\":\"chr19\",\"position\":45683722}},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}}},\"specRight\":{\"name\":\"TableSpec\",\"params\":{\"file_version\":66816,\"hail_version\":\"0.2.61-3c86d3ba497a\",\"references_rel_path\":\"../references\",\"table_type\":\"Table{global:Struct{},key:[],row:Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{GT:Call,RNC:Array[String],DP:Int32,AD:Array[Int32],GQ:Int32,PL:Array[Int32]}]}}\",\"components\":{\"globals\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"../globals/rows\"},\"rows\":{\"name\":\"RVDComponentSpec\",\"rel_path\":\"rows\"},\"partition_counts\":{\"name\":\"PartitionCountsComponentSpec\",\"counts\":[828]}}},\"globalsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[],\"required\":true},\"_vType\":{\"fields\":[]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_partFiles\":[\"part-0\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}},\"rowsSpec\":{\"_key\":[],\"_codecSpec\":{\"_eType\":{\"fields\":[{\"name\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"GT\",\"typ\":{},\"index\":0},{\"name\":\"RNC\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":1},{\"name\":\"DP\",\"typ\":{},\"index\":2},{\"name\":\"AD\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":3},{\"name\":\"GQ\",\"typ\":{},\"index\":4},{\"name\":\"PL\",\"typ\":{\"elementType\":{},\"required\":false},\"index\":5}],\"required\":true},\"required\":true},\"index\":0}],\"required\":true},\"_vType\":{\"fields\":[{\"name\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"GT\",\"typ\":{},\"index\":0},{\"name\":\"RNC\",\"typ\":{\"elementType\":{}},\"index\":1},{\"name\":\"DP\",\"typ\":{},\"index\":2},{\"name\":\"AD\",\"typ\":{\"elementType\":{}},\"index\":3},{\"name\":\"GQ\",\"typ\":{},\"index\":4},{\"name\":\"PL\",\"typ\":{\"elementType\":{}},\"index\":5}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_indexSpec\":{\"_relPath\":\"../../index\",\"_leafCodec\":{\"_eType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":2}],\"required\":true},\"required\":true},\"index\":1}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"first_idx\",\"typ\":{},\"index\":0},{\"name\":\"keys\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":0},{\"name\":\"offset\",\"typ\":{},\"index\":1},{\"name\":\"annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":2}]}},\"index\":1}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_internalNodeCodec\":{\"_eType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"fields\":[{\"name\":\"contig\",\"typ\":{},\"index\":0},{\"name\":\"position\",\"typ\":{},\"index\":1}],\"required\":true},\"index\":0}],\"required\":true},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}],\"required\":true},\"index\":4}],\"required\":true},\"required\":true},\"index\":0}],\"required\":false},\"_vType\":{\"fields\":[{\"name\":\"children\",\"typ\":{\"elementType\":{\"fields\":[{\"name\":\"index_file_offset\",\"typ\":{},\"index\":0},{\"name\":\"first_idx\",\"typ\":{},\"index\":1},{\"name\":\"first_key\",\"typ\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"index\":2},{\"name\":\"first_record_offset\",\"typ\":{},\"index\":3},{\"name\":\"first_annotation\",\"typ\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"index\":4}]}},\"index\":0}]},\"_bufferSpec\":{\"child\":{\"blockSize\":32768,\"child\":{\"blockSize\":32768,\"child\":{}}}}},\"_keyType\":{\"fields\":[{\"name\":\"locus\",\"typ\":{\"rgBc\":{}},\"index\":0}]},\"_annotationType\":{\"fields\":[{\"name\":\"entries_offset\",\"typ\":{},\"index\":0}]},\"_offsetField\":\"entries_offset\"},\"_partFiles\":[\"part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7\"],\"_jRangeBounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"_attrs\":{}}}}") (If (IsNA (Ref row)) (NA Struct{locus:Locus(GRCh38)}) (MakeStruct (locus (GetField locus (Ref row))))))))) (InsertFields (SelectFields () (Ref row)) None (locus (ApplySpecial showStr () String (GetField locus (Ref row)))))))) 2021-09-20 11:43:17 root: INFO: interpreting non compilable node: TableCollect 2021-09-20 11:43:17 root: INFO: decoder cache hit 2021-09-20 11:43:17 root: INFO: decoder cache hit 2021-09-20 11:43:17 SparkContext: INFO: Starting job: runJob at ContextRDD.scala:351 2021-09-20 11:43:17 DAGScheduler: INFO: [DNAX] Setting local property com.dnanexus.auth 2021-09-20 11:43:17 DAGScheduler: INFO: Unable to extract and set 'user' or 'containsPHI' in SparkSession 2021-09-20 11:43:17 DAGScheduler: INFO: Got job 1 (runJob at ContextRDD.scala:351) with 1 output partitions 2021-09-20 11:43:17 DAGScheduler: INFO: Final stage: ResultStage 1 (runJob at ContextRDD.scala:351) 2021-09-20 11:43:17 DAGScheduler: INFO: Parents of final stage: List() 2021-09-20 11:43:17 DAGScheduler: INFO: Missing parents: List() 2021-09-20 11:43:17 DAGScheduler: INFO: Submitting ResultStage 1 (MapPartitionsRDD[9] at mapPartitions at ContextRDD.scala:239), which has no missing parents 2021-09-20 11:43:17 MemoryStore: INFO: Block broadcast_6 stored as values in memory (estimated size 136.3 KB, free 11.5 GB) 2021-09-20 11:43:17 MemoryStore: INFO: Block broadcast_6_piece0 stored as bytes in memory (estimated size 46.3 KB, free 11.5 GB) 2021-09-20 11:43:17 BlockManagerInfo: INFO: Added broadcast_6_piece0 in memory on ip-10-60-66-122.eu-west-2.compute.internal:43001 (size: 46.3 KB, free: 11.5 GB) 2021-09-20 11:43:17 SparkContext: INFO: Created broadcast 6 from broadcast at DAGScheduler.scala:1268 2021-09-20 11:43:17 DAGScheduler: INFO: Submitting 1 missing tasks from ResultStage 1 (MapPartitionsRDD[9] at mapPartitions at ContextRDD.scala:239) (first 15 tasks are for partitions Vector(0)) 2021-09-20 11:43:17 TaskSchedulerImpl: INFO: Adding task set 1.0 with 1 tasks 2021-09-20 11:43:17 TaskSetManager: INFO: Starting task 0.0 in stage 1.0 (TID 4, ip-10-60-2-89.eu-west-2.compute.internal, executor 0, partition 0, PROCESS_LOCAL, 7900 bytes) 2021-09-20 11:43:17 BlockManagerInfo: INFO: Added broadcast_6_piece0 in memory on ip-10-60-2-89.eu-west-2.compute.internal:44000 (size: 46.3 KB, free: 11.5 GB) 2021-09-20 11:43:17 TaskSetManager: WARN: Lost task 0.0 in stage 1.0 (TID 4, ip-10-60-2-89.eu-west-2.compute.internal, executor 0): java.io.FileNotFoundException: File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:142) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769) at is.hail.io.fs.HadoopFS.openNoCompression(HadoopFS.scala:83) at is.hail.io.fs.FS$class.open(FS.scala:139) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.io.fs.FS$class.open(FS.scala:148) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.HailContext$$anon$1.compute(HailContext.scala:276) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:123) at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2021-09-20 11:43:17 TaskSetManager: INFO: Starting task 0.1 in stage 1.0 (TID 5, ip-10-60-2-89.eu-west-2.compute.internal, executor 0, partition 0, PROCESS_LOCAL, 7900 bytes) 2021-09-20 11:43:17 TaskSetManager: INFO: Lost task 0.1 in stage 1.0 (TID 5) on ip-10-60-2-89.eu-west-2.compute.internal, executor 0: java.io.FileNotFoundException (File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist) [duplicate 1] 2021-09-20 11:43:17 TaskSetManager: INFO: Starting task 0.2 in stage 1.0 (TID 6, ip-10-60-2-89.eu-west-2.compute.internal, executor 0, partition 0, PROCESS_LOCAL, 7900 bytes) 2021-09-20 11:43:17 TaskSetManager: INFO: Lost task 0.2 in stage 1.0 (TID 6) on ip-10-60-2-89.eu-west-2.compute.internal, executor 0: java.io.FileNotFoundException (File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist) [duplicate 2] 2021-09-20 11:43:17 TaskSetManager: INFO: Starting task 0.3 in stage 1.0 (TID 7, ip-10-60-2-89.eu-west-2.compute.internal, executor 0, partition 0, PROCESS_LOCAL, 7900 bytes) 2021-09-20 11:43:17 TaskSetManager: INFO: Lost task 0.3 in stage 1.0 (TID 7) on ip-10-60-2-89.eu-west-2.compute.internal, executor 0: java.io.FileNotFoundException (File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist) [duplicate 3] 2021-09-20 11:43:17 TaskSetManager: ERROR: Task 0 in stage 1.0 failed 4 times; aborting job 2021-09-20 11:43:17 TaskSchedulerImpl: INFO: Removed TaskSet 1.0, whose tasks have all completed, from pool 2021-09-20 11:43:17 TaskSchedulerImpl: INFO: Cancelling stage 1 2021-09-20 11:43:17 TaskSchedulerImpl: INFO: Killing all running tasks in stage 1: Stage cancelled 2021-09-20 11:43:17 DAGScheduler: INFO: ResultStage 1 (runJob at ContextRDD.scala:351) failed in 0.061 s due to Job aborted due to stage failure: Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in stage 1.0 (TID 7, ip-10-60-2-89.eu-west-2.compute.internal, executor 0): java.io.FileNotFoundException: File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:142) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769) at is.hail.io.fs.HadoopFS.openNoCompression(HadoopFS.scala:83) at is.hail.io.fs.FS$class.open(FS.scala:139) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.io.fs.FS$class.open(FS.scala:148) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.HailContext$$anon$1.compute(HailContext.scala:276) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:123) at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Driver stacktrace: 2021-09-20 11:43:17 DAGScheduler: INFO: Job 1 failed: runJob at ContextRDD.scala:351, took 0.064123 s 2021-09-20 11:43:17 root: ERROR: error while applying lowering 'InterpretNonCompilable' 2021-09-20 11:43:17 root: INFO: The exact same exception object, org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in stage 1.0 (TID 7, ip-10-60-2-89.eu-west-2.compute.internal, executor 0): java.io.FileNotFoundException: File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:142) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769) at is.hail.io.fs.HadoopFS.openNoCompression(HadoopFS.scala:83) at is.hail.io.fs.FS$class.open(FS.scala:139) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.io.fs.FS$class.open(FS.scala:148) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.HailContext$$anon$1.compute(HailContext.scala:276) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:123) at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Driver stacktrace:, was thrown by both the consumer and the close method. I will throw the original. 2021-09-20 11:43:17 root: ERROR: FileNotFoundException: File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist From org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in stage 1.0 (TID 7, ip-10-60-2-89.eu-west-2.compute.internal, executor 0): java.io.FileNotFoundException: File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:142) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769) at is.hail.io.fs.HadoopFS.openNoCompression(HadoopFS.scala:83) at is.hail.io.fs.FS$class.open(FS.scala:139) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.io.fs.FS$class.open(FS.scala:148) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.HailContext$$anon$1.compute(HailContext.scala:276) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:123) at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Driver stacktrace: at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:2001) at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1984) at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1983) at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48) at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1983) at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:1033) at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:1033) at scala.Option.foreach(Option.scala:257) at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:1033) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:2223) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2172) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2161) at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:49) at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:823) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2061) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2082) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2101) at is.hail.sparkextras.ContextRDD.runJob(ContextRDD.scala:351) at is.hail.rvd.RVD$$anonfun$13.apply(RVD.scala:526) at is.hail.rvd.RVD$$anonfun$13.apply(RVD.scala:526) at is.hail.utils.PartitionCounts$.incrementalPCSubsetOffset(PartitionCounts.scala:73) at is.hail.rvd.RVD.head(RVD.scala:525) at is.hail.expr.ir.TableSubset$class.execute(TableIR.scala:1326) at is.hail.expr.ir.TableHead.execute(TableIR.scala:1332) at is.hail.expr.ir.TableMapRows.execute(TableIR.scala:1845) at is.hail.expr.ir.Interpret$.run(Interpret.scala:819) at is.hail.expr.ir.Interpret$.alreadyLowered(Interpret.scala:53) at is.hail.expr.ir.InterpretNonCompilable$.interpretAndCoerce$1(InterpretNonCompilable.scala:16) at is.hail.expr.ir.InterpretNonCompilable$.is$hail$expr$ir$InterpretNonCompilable$$rewrite$1(InterpretNonCompilable.scala:53) at is.hail.expr.ir.InterpretNonCompilable$$anonfun$1.apply(InterpretNonCompilable.scala:25) at is.hail.expr.ir.InterpretNonCompilable$$anonfun$1.apply(InterpretNonCompilable.scala:25) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234) at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:35) at scala.collection.TraversableLike$class.map(TraversableLike.scala:234) at scala.collection.AbstractTraversable.map(Traversable.scala:104) at is.hail.expr.ir.InterpretNonCompilable$.rewriteChildren$1(InterpretNonCompilable.scala:25) at is.hail.expr.ir.InterpretNonCompilable$.is$hail$expr$ir$InterpretNonCompilable$$rewrite$1(InterpretNonCompilable.scala:54) at is.hail.expr.ir.InterpretNonCompilable$.apply(InterpretNonCompilable.scala:58) at is.hail.expr.ir.lowering.InterpretNonCompilablePass$.transform(LoweringPass.scala:67) at is.hail.expr.ir.lowering.LoweringPass$$anonfun$apply$3$$anonfun$1.apply(LoweringPass.scala:15) at is.hail.expr.ir.lowering.LoweringPass$$anonfun$apply$3$$anonfun$1.apply(LoweringPass.scala:15) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.lowering.LoweringPass$$anonfun$apply$3.apply(LoweringPass.scala:15) at is.hail.expr.ir.lowering.LoweringPass$$anonfun$apply$3.apply(LoweringPass.scala:13) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.lowering.LoweringPass$class.apply(LoweringPass.scala:13) at is.hail.expr.ir.lowering.InterpretNonCompilablePass$.apply(LoweringPass.scala:62) at is.hail.expr.ir.lowering.LoweringPipeline$$anonfun$apply$1.apply(LoweringPipeline.scala:14) at is.hail.expr.ir.lowering.LoweringPipeline$$anonfun$apply$1.apply(LoweringPipeline.scala:12) at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:35) at is.hail.expr.ir.lowering.LoweringPipeline.apply(LoweringPipeline.scala:12) at is.hail.expr.ir.CompileAndEvaluate$._apply(CompileAndEvaluate.scala:28) at is.hail.backend.spark.SparkBackend.is$hail$backend$spark$SparkBackend$$_execute(SparkBackend.scala:354) at is.hail.backend.spark.SparkBackend$$anonfun$execute$1.apply(SparkBackend.scala:338) at is.hail.backend.spark.SparkBackend$$anonfun$execute$1.apply(SparkBackend.scala:335) at is.hail.expr.ir.ExecuteContext$$anonfun$scoped$1.apply(ExecuteContext.scala:25) at is.hail.expr.ir.ExecuteContext$$anonfun$scoped$1.apply(ExecuteContext.scala:23) at is.hail.utils.package$.using(package.scala:618) at is.hail.annotations.Region$.scoped(Region.scala:18) at is.hail.expr.ir.ExecuteContext$.scoped(ExecuteContext.scala:23) at is.hail.backend.spark.SparkBackend.withExecuteContext(SparkBackend.scala:247) at is.hail.backend.spark.SparkBackend.execute(SparkBackend.scala:335) at is.hail.backend.spark.SparkBackend$$anonfun$7.apply(SparkBackend.scala:379) at is.hail.backend.spark.SparkBackend$$anonfun$7.apply(SparkBackend.scala:377) at is.hail.utils.ExecutionTimer$.time(ExecutionTimer.scala:52) at is.hail.backend.spark.SparkBackend.executeJSON(SparkBackend.scala:377) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244) at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357) at py4j.Gateway.invoke(Gateway.java:282) at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132) at py4j.commands.CallCommand.execute(CallCommand.java:79) at py4j.GatewayConnection.run(GatewayConnection.java:238) at java.lang.Thread.run(Thread.java:748) java.io.FileNotFoundException: File file:/opt/notebooks/GIPR.mt/rows/rows/parts/part-0-2-0-0-ba507024-1211-ab56-179a-832d6e98beb7 does not exist at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:611) at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:824) at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:601) at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:142) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:346) at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:769) at is.hail.io.fs.HadoopFS.openNoCompression(HadoopFS.scala:83) at is.hail.io.fs.FS$class.open(FS.scala:139) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.io.fs.FS$class.open(FS.scala:148) at is.hail.io.fs.HadoopFS.open(HadoopFS.scala:70) at is.hail.HailContext$$anon$1.compute(HailContext.scala:276) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324) at org.apache.spark.rdd.RDD.iterator(RDD.scala:288) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:123) at org.apache.spark.executor.Executor$TaskRunner$$anonfun$10.apply(Executor.scala:408) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1360) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:414) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)