2023-02-10 11:11:04 Hail: INFO: Running Hail version 0.2.91-44b441376f9a 2023-02-10 11:11:05 SparkContext: WARN: Using an existing SparkContext; some configuration may not take effect. 2023-02-10 11:11:09 root: INFO: RegionPool: initialized for thread 28: Thread-5 2023-02-10 11:11:10 root: INFO: globbing path /home/hj7968/Hail/Inputs/dragen-joint-test.vcf.gz returned 1 files: dragen-joint-test.vcf.gz 2023-02-10 11:11:10 root: INFO: globbing path file:/home/hj7968/Hail/Inputs/dragen-joint-test.vcf.gz returned 1 files: dragen-joint-test.vcf.gz 2023-02-10 11:11:10 MemoryStore: INFO: Block broadcast_0 stored as values in memory (estimated size 2.3 MiB, free 79.8 GiB) 2023-02-10 11:11:10 MemoryStore: INFO: Block broadcast_0_piece0 stored as bytes in memory (estimated size 123.7 KiB, free 79.8 GiB) 2023-02-10 11:11:10 BlockManagerInfo: INFO: Added broadcast_0_piece0 in memory on 163.152.180.157:46313 (size: 123.7 KiB, free: 79.8 GiB) 2023-02-10 11:11:10 SparkContext: INFO: Created broadcast 0 from broadcast at SparkBackend.scala:280 2023-02-10 11:11:10 root: INFO: RegionPool: FREE: 64.0K allocated (64.0K blocks / 0 chunks), regions.size = 1, 0 current java objects, thread 28: Thread-5 2023-02-10 11:11:10 root: INFO: timing SparkBackend.parse_matrix_ir total 1.100s self 1.100s children 0.000ms %children 0.00% 2023-02-10 11:11:32 root: INFO: RegionPool: initialized for thread 28: Thread-5 2023-02-10 11:11:33 root: INFO: RegionPool: FREE: 64.0K allocated (64.0K blocks / 0 chunks), regions.size = 1, 0 current java objects, thread 28: Thread-5 2023-02-10 11:11:33 root: INFO: timing SparkBackend.parse_value_ir total 308.409ms self 308.409ms children 0.000ms %children 0.00% 2023-02-10 11:11:33 root: INFO: RegionPool: initialized for thread 28: Thread-5 2023-02-10 11:11:33 root: INFO: starting execution of query hail_query_1 of initial size 331 2023-02-10 11:11:33 root: INFO: optimize optimize: relationalLowerer, initial IR: before: IR size 331: (MatrixWrite "{\"name\":\"MatrixNativeWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"stageLocally\":false,\"codecSpecJSONStr\":null,\"partitions\":null,\"partitionsTypeStr\":null,\"checkpointFile\":null}" (MatrixMapRows (MatrixMapEntries (MatrixMapRows (MatrixUnionRows (MatrixKeyRowsBy (locus alleles) True (MatrixMapRows (MatrixKeyRowsBy (locus) False (MatrixExplodeRows (__uid_3) (MatrixMapRows (MatrixRead None False False {\"files\":[\"/home/hj7968/Hail/Inputs/dragen-joint-test.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"nPartitions\":144,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":true,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"}) (Let __cse_1 (GetField alleles (Ref va)) (Let __cse_2 (GetField locus (Ref va)) (InsertFields (SelectFields (locus alleles rsid qual filters info) (Ref va)) None (__uid_3 (ArraySort __uid_9 __uid_10 (ToStream False (ToArray (StreamFlatMap __uid_7 (ToStream False (ToArray (StreamFilter __uid_4 (ToStream False (ToArray (StreamRange 1 False (I32 1) (ArrayLen (CastToArray (Ref __cse_1))) (I32 1)))) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __cse_1) (Ref __uid_4)) (Str "*"))))) (ToStream False (Let __uid_8 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __cse_2) (MakeArray Array[String] (ApplyIR 6 indexArray () String (Ref __cse_1) (I32 0)) (ApplyIR 7 indexArray () String (Ref __cse_1) (Ref __uid_7)))) (If (ApplyComparisonOp EQ (GetField locus (Ref __uid_8)) (Ref __cse_2)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __uid_8))) (locus (GetField locus (Ref __uid_8))) (a_index (Ref __uid_7)) (was_split (ApplyComparisonOp GT (ArrayLen (CastToArray (GetField alleles (Ref va)))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))))) (If (IsNA (Ref __uid_9)) (False) (If (IsNA (Ref __uid_10)) (True) (If (False) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __uid_10) (Ref __uid_9)) (I32 0)) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __uid_9) (Ref __uid_10)) (I32 0))))))))))))) (SelectFields (locus alleles rsid qual filters info a_index was_split old_locus old_alleles) (Let __uid_11 (GetField __uid_3 (Ref va)) (InsertFields (SelectFields (locus alleles rsid qual filters info __uid_3) (Ref va)) None (locus (GetField locus (Ref __uid_11))) (alleles (GetField alleles (Ref __uid_11))) (a_index (GetField a_index (Ref __uid_11))) (was_split (GetField was_split (Ref __uid_11))) (old_locus (GetField locus (Ref va))) (old_alleles (GetField alleles (Ref va)))))))) (MatrixKeyRowsBy (locus alleles) False (MatrixMapRows (MatrixKeyRowsBy () False (MatrixExplodeRows (__uid_3) (MatrixMapRows (MatrixRead None False False {\"files\":[\"/home/hj7968/Hail/Inputs/dragen-joint-test.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"nPartitions\":144,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":true,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"}) (Let __cse_3 (GetField alleles (Ref va)) (Let __cse_4 (GetField locus (Ref va)) (InsertFields (SelectFields (locus alleles rsid qual filters info) (Ref va)) None (__uid_3 (ArraySort __uid_16 __uid_17 (ToStream False (ToArray (StreamFlatMap __uid_14 (ToStream False (ToArray (StreamFilter __uid_4 (ToStream False (ToArray (StreamRange 1 False (I32 1) (ArrayLen (CastToArray (Ref __cse_3))) (I32 1)))) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __cse_3) (Ref __uid_4)) (Str "*"))))) (ToStream False (Let __uid_15 (Apply 14 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __cse_4) (MakeArray Array[String] (ApplyIR 12 indexArray () String (Ref __cse_3) (I32 0)) (ApplyIR 13 indexArray () String (Ref __cse_3) (Ref __uid_14)))) (If (ApplyComparisonOp NEQ (GetField locus (Ref __uid_15)) (Ref __cse_4)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __uid_15))) (locus (GetField locus (Ref __uid_15))) (a_index (Ref __uid_14)) (was_split (ApplyComparisonOp GT (ArrayLen (CastToArray (GetField alleles (Ref va)))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))))) (If (IsNA (Ref __uid_16)) (False) (If (IsNA (Ref __uid_17)) (True) (If (False) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __uid_17) (Ref __uid_16)) (I32 0)) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __uid_16) (Ref __uid_17)) (I32 0))))))))))))) (SelectFields (locus alleles rsid qual filters info a_index was_split old_locus old_alleles) (Let __uid_18 (GetField __uid_3 (Ref va)) (InsertFields (SelectFields (locus alleles rsid qual filters info __uid_3) (Ref va)) None (locus (GetField locus (Ref __uid_18))) (alleles (GetField alleles (Ref __uid_18))) (a_index (GetField a_index (Ref __uid_18))) (was_split (GetField was_split (Ref __uid_18))) (old_locus (GetField locus (Ref va))) (old_alleles (GetField alleles (Ref va))))))))) (InsertFields (SelectFields (locus alleles rsid qual filters info a_index was_split old_locus old_alleles) (Ref va)) None)) (Let __cse_7 (If (ApplyUnaryPrimOp Bang (IsNA (GetField PL (Ref g)))) (ToArray (StreamMap __uid_20 (ToStream False (ToArray (StreamRange 19 False (I32 0) (I32 3) (I32 1)))) (ApplyIR 26 min () Int32 (ToArray (StreamFilter __uid_23 (ToStream False (ToArray (StreamMap __uid_22 (ToStream False (ToArray (StreamFilter __uid_21 (ToStream False (ToArray (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (CastToArray (GetField old_alleles (Ref va))))) (I32 1)))) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __uid_21)) (GetField a_index (Ref va)))) (Ref __uid_20))))) (ApplyIR 25 indexArray () Int32 (GetField PL (Ref g)) (Ref __uid_22))))) (ApplyUnaryPrimOp Bang (IsNA (Ref __uid_23)))))))) (NA Array[Int32])) (InsertFields (SelectFields (AD AF DP F1R2 F2R1 FT GP GQ GT MIN_DP PL PS SQ) (Ref g)) None (GT (Apply 15 downcode () Call (GetField GT (Ref g)) (GetField a_index (Ref va)))) (DP (GetField DP (Ref g))) (AD (If (ApplyUnaryPrimOp Bang (IsNA (GetField AD (Ref g)))) (Let __cse_5 (GetField AD (Ref g)) (Let __cse_6 (GetField a_index (Ref va)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (ApplyIR 16 sum () Int32 (ToArray (StreamFilter __uid_19 (ToStream False (Ref __cse_5)) (ApplyUnaryPrimOp Bang (IsNA (Ref __uid_19)))))) (ApplyIR 17 indexArray () Int32 (Ref __cse_5) (Ref __cse_6))) (ApplyIR 18 indexArray () Int32 (Ref __cse_5) (Ref __cse_6))))) (NA Array[Int32]))) (PL (Ref __cse_7)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __cse_7)) (GetField GQ (Ref g))))))) (SelectFields (locus alleles rsid qual filters info a_index was_split) (MakeStruct (locus (GetField locus (Ref va))) (alleles (GetField alleles (Ref va))) (rsid (GetField rsid (Ref va))) (qual (GetField qual (Ref va))) (filters (GetField filters (Ref va))) (info (GetField info (Ref va))) (a_index (GetField a_index (Ref va))) (was_split (GetField was_split (Ref va))) (old_locus (GetField old_locus (Ref va))) (old_alleles (GetField old_alleles (Ref va))))))) 2023-02-10 11:11:33 root: INFO: Prune: InsertFields: eliminating field 'old_locus' 2023-02-10 11:11:33 root: INFO: Prune: InsertFields: eliminating field 'old_locus' 2023-02-10 11:11:33 root: INFO: optimize optimize: relationalLowerer, initial IR: after: IR size 287: (MatrixWrite "{\"name\":\"MatrixNativeWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"stageLocally\":false,\"codecSpecJSONStr\":null,\"partitions\":null,\"partitionsTypeStr\":null,\"checkpointFile\":null}" (MatrixMapRows (MatrixMapEntries (MatrixUnionRows (MatrixKeyRowsBy (locus alleles) True (MatrixMapRows (MatrixKeyRowsBy (locus) False (MatrixExplodeRows (__uid_3) (MatrixMapRows (MatrixRead None False False {\"files\":[\"/home/hj7968/Hail/Inputs/dragen-joint-test.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"nPartitions\":144,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":true,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"}) (Let __iruid_214 (GetField alleles (Ref va)) (Let __iruid_215 (GetField locus (Ref va)) (InsertFields (Ref va) None (__uid_3 (ArraySort __iruid_216 __iruid_217 (StreamFlatMap __iruid_218 (StreamFilter __iruid_219 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_214)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_214) (Ref __iruid_219)) (Str "*"))) (ToStream False (Let __iruid_220 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_215) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_214) (I32 0)) (ApplyIR 7 indexArray () String (Ref __iruid_214) (Ref __iruid_218)))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_220)) (Ref __iruid_215)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_220))) (locus (GetField locus (Ref __iruid_220))) (a_index (Ref __iruid_218)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref va))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_216)) (False) (If (IsNA (Ref __iruid_217)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_216) (Ref __iruid_217)) (I32 0)))))))))))) (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Let __iruid_222 (GetField __uid_3 (Ref va)) (InsertFields (Ref va) None (locus (GetField locus (Ref __iruid_222))) (alleles (GetField alleles (Ref __iruid_222))) (a_index (GetField a_index (Ref __iruid_222))) (was_split (GetField was_split (Ref __iruid_222))) (old_alleles (GetField alleles (Ref va)))))))) (MatrixKeyRowsBy (locus alleles) False (MatrixMapRows (MatrixKeyRowsBy () False (MatrixExplodeRows (__uid_3) (MatrixMapRows (MatrixRead None False False {\"files\":[\"/home/hj7968/Hail/Inputs/dragen-joint-test.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"nPartitions\":144,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":true,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"}) (Let __iruid_223 (GetField alleles (Ref va)) (Let __iruid_224 (GetField locus (Ref va)) (InsertFields (Ref va) None (__uid_3 (ArraySort __iruid_225 __iruid_226 (StreamFlatMap __iruid_227 (StreamFilter __iruid_228 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_223)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_223) (Ref __iruid_228)) (Str "*"))) (ToStream False (Let __iruid_229 (Apply 14 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_224) (MakeArray Array[String] (ArrayRef 12 (Ref __iruid_223) (I32 0)) (ApplyIR 13 indexArray () String (Ref __iruid_223) (Ref __iruid_227)))) (If (ApplyComparisonOp NEQ (GetField locus (Ref __iruid_229)) (Ref __iruid_224)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_229))) (locus (GetField locus (Ref __iruid_229))) (a_index (Ref __iruid_227)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref va))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_225)) (False) (If (IsNA (Ref __iruid_226)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_225) (Ref __iruid_226)) (I32 0)))))))))))) (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Let __iruid_231 (GetField __uid_3 (Ref va)) (InsertFields (Ref va) None (locus (GetField locus (Ref __iruid_231))) (alleles (GetField alleles (Ref __iruid_231))) (a_index (GetField a_index (Ref __iruid_231))) (was_split (GetField was_split (Ref __iruid_231))) (old_alleles (GetField alleles (Ref va))))))))) (Let __iruid_232 (If (IsNA (GetField PL (Ref g))) (NA Array[Int32]) (ToArray (StreamMap __iruid_233 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_238 __iruid_239) __iruid_234 (StreamFilter __iruid_235 (StreamMap __iruid_236 (StreamFilter __iruid_237 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref va)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_237)) (GetField a_index (Ref va)))) (Ref __iruid_233))) (ApplyIR 25 indexArray () Int32 (GetField PL (Ref g)) (Ref __iruid_236))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_235)))) (NA Int32) (True) (If (Ref __iruid_239) (Ref __iruid_234) (If (ApplyComparisonOp LT (Ref __iruid_238) (Ref __iruid_234)) (Ref __iruid_238) (Ref __iruid_234))) (False) (Ref __iruid_238))))) (InsertFields (Ref g) None (GT (Apply 15 downcode () Call (GetField GT (Ref g)) (GetField a_index (Ref va)))) (DP (GetField DP (Ref g))) (AD (If (IsNA (GetField AD (Ref g))) (NA Array[Int32]) (Let __iruid_240 (GetField AD (Ref g)) (Let __iruid_241 (GetField a_index (Ref va)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_242 __iruid_243 (StreamFilter __iruid_244 (ToStream False (Ref __iruid_240)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_244)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_242) (Ref __iruid_243))) (ApplyIR 17 indexArray () Int32 (Ref __iruid_240) (Ref __iruid_241))) (ApplyIR 18 indexArray () Int32 (Ref __iruid_240) (Ref __iruid_241))))))) (PL (Ref __iruid_232)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_232)) (GetField GQ (Ref g))))))) (MakeStruct (locus (GetField locus (Ref va))) (alleles (GetField alleles (Ref va))) (rsid (GetField rsid (Ref va))) (qual (GetField qual (Ref va))) (filters (GetField filters (Ref va))) (info (GetField info (Ref va))) (a_index (GetField a_index (Ref va))) (was_split (GetField was_split (Ref va)))))) 2023-02-10 11:11:33 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: before: IR size 371: (TableWrite "{\"writer\":{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"stageLocally\":false,\"codecSpecJSONStr\":null,\"partitions\":null,\"partitionsTypeStr\":null,\"checkpointFile\":null},\"colsFieldName\":\"__cols\",\"entriesFieldName\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"colKey\":[\"s\"]}" (TableMapRows (TableMapRows (TableUnion (TableKeyBy (locus alleles) True (TableMapRows (TableKeyBy (locus) False (TableExplode ("__uid_3") (TableMapRows (TableRead None False {\"files\":[\"/home/hj7968/Hail/Inputs/dragen-joint-test.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"nPartitions\":144,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":true,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"}) (Let n_cols (ArrayLen (GetField __cols (Ref global))) (InsertFields (Let __iruid_275 (MakeStruct) (Let __iruid_214 (GetField alleles (SelectFields (locus alleles rsid qual filters info) (Ref row))) (Let __iruid_215 (GetField locus (SelectFields (locus alleles rsid qual filters info) (Ref row))) (InsertFields (SelectFields (locus alleles rsid qual filters info) (Ref row)) None (__uid_3 (ArraySort __iruid_216 __iruid_217 (StreamFlatMap __iruid_218 (StreamFilter __iruid_219 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_214)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_214) (Ref __iruid_219)) (Str "*"))) (ToStream False (Let __iruid_220 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_215) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_214) (I32 0)) (ApplyIR 7 indexArray () String (Ref __iruid_214) (Ref __iruid_218)))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_220)) (Ref __iruid_215)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_220))) (locus (GetField locus (Ref __iruid_220))) (a_index (Ref __iruid_218)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (SelectFields (locus alleles rsid qual filters info) (Ref row)))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_216)) (False) (If (IsNA (Ref __iruid_217)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_216) (Ref __iruid_217)) (I32 0)))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row)))))))) (Let n_cols (ArrayLen (GetField __cols (Ref global))) (InsertFields (Let __iruid_277 (MakeStruct) (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Let __iruid_222 (GetField __uid_3 (SelectFields (locus alleles rsid qual filters info __uid_3) (Ref row))) (InsertFields (SelectFields (locus alleles rsid qual filters info __uid_3) (Ref row)) None (locus (GetField locus (Ref __iruid_222))) (alleles (GetField alleles (Ref __iruid_222))) (a_index (GetField a_index (Ref __iruid_222))) (was_split (GetField was_split (Ref __iruid_222))) (old_alleles (GetField alleles (SelectFields (locus alleles rsid qual filters info __uid_3) (Ref row)))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row))))))) (TableMapRows (TableKeyBy (locus alleles) False (TableMapRows (TableKeyBy () False (TableExplode ("__uid_3") (TableMapRows (TableRead None False {\"files\":[\"/home/hj7968/Hail/Inputs/dragen-joint-test.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"nPartitions\":144,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":true,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"}) (Let n_cols (ArrayLen (GetField __cols (Ref global))) (InsertFields (Let __iruid_278 (MakeStruct) (Let __iruid_223 (GetField alleles (SelectFields (locus alleles rsid qual filters info) (Ref row))) (Let __iruid_224 (GetField locus (SelectFields (locus alleles rsid qual filters info) (Ref row))) (InsertFields (SelectFields (locus alleles rsid qual filters info) (Ref row)) None (__uid_3 (ArraySort __iruid_225 __iruid_226 (StreamFlatMap __iruid_227 (StreamFilter __iruid_228 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_223)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_223) (Ref __iruid_228)) (Str "*"))) (ToStream False (Let __iruid_229 (Apply 14 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_224) (MakeArray Array[String] (ArrayRef 12 (Ref __iruid_223) (I32 0)) (ApplyIR 13 indexArray () String (Ref __iruid_223) (Ref __iruid_227)))) (If (ApplyComparisonOp NEQ (GetField locus (Ref __iruid_229)) (Ref __iruid_224)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_229))) (locus (GetField locus (Ref __iruid_229))) (a_index (Ref __iruid_227)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (SelectFields (locus alleles rsid qual filters info) (Ref row)))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_225)) (False) (If (IsNA (Ref __iruid_226)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_225) (Ref __iruid_226)) (I32 0)))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row)))))))) (Let n_cols (ArrayLen (GetField __cols (Ref global))) (InsertFields (Let __iruid_280 (MakeStruct) (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Let __iruid_231 (GetField __uid_3 (SelectFields (locus alleles rsid qual filters info __uid_3) (Ref row))) (InsertFields (SelectFields (locus alleles rsid qual filters info __uid_3) (Ref row)) None (locus (GetField locus (Ref __iruid_231))) (alleles (GetField alleles (Ref __iruid_231))) (a_index (GetField a_index (Ref __iruid_231))) (was_split (GetField was_split (Ref __iruid_231))) (old_alleles (GetField alleles (SelectFields (locus alleles rsid qual filters info __uid_3) (Ref row)))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row))))))) (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref row)))) (InsertFields (Ref row) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (ToArray (StreamZip -1 AssumeSameLength (g sa) (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row))) (ToStream False (GetField __cols (Ref global))) (Let __iruid_232 (If (IsNA (GetField PL (Ref g))) (NA Array[Int32]) (ToArray (StreamMap __iruid_233 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_238 __iruid_239) __iruid_234 (StreamFilter __iruid_235 (StreamMap __iruid_236 (StreamFilter __iruid_237 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Ref row))))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_237)) (GetField a_index (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Ref row))))) (Ref __iruid_233))) (ApplyIR 25 indexArray () Int32 (GetField PL (Ref g)) (Ref __iruid_236))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_235)))) (NA Int32) (True) (If (Ref __iruid_239) (Ref __iruid_234) (If (ApplyComparisonOp LT (Ref __iruid_238) (Ref __iruid_234)) (Ref __iruid_238) (Ref __iruid_234))) (False) (Ref __iruid_238))))) (InsertFields (Ref g) None (GT (Apply 15 downcode () Call (GetField GT (Ref g)) (GetField a_index (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Ref row))))) (DP (GetField DP (Ref g))) (AD (If (IsNA (GetField AD (Ref g))) (NA Array[Int32]) (Let __iruid_240 (GetField AD (Ref g)) (Let __iruid_241 (GetField a_index (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Ref row))) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_242 __iruid_243 (StreamFilter __iruid_244 (ToStream False (Ref __iruid_240)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_244)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_242) (Ref __iruid_243))) (ApplyIR 17 indexArray () Int32 (Ref __iruid_240) (Ref __iruid_241))) (ApplyIR 18 indexArray () Int32 (Ref __iruid_240) (Ref __iruid_241))))))) (PL (Ref __iruid_232)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_232)) (GetField GQ (Ref g))))))))))) (Let n_cols (ArrayLen (GetField __cols (Ref global))) (InsertFields (Let __iruid_281 (MakeStruct) (MakeStruct (locus (GetField locus (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Ref row)))) (alleles (GetField alleles (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Ref row)))) (rsid (GetField rsid (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Ref row)))) (qual (GetField qual (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Ref row)))) (filters (GetField filters (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Ref row)))) (info (GetField info (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Ref row)))) (a_index (GetField a_index (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Ref row)))) (was_split (GetField was_split (SelectFields (locus alleles rsid qual filters info a_index was_split old_alleles) (Ref row)))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row))))))) 2023-02-10 11:11:33 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: after: IR size 306: (TableWrite "{\"writer\":{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"stageLocally\":false,\"codecSpecJSONStr\":null,\"partitions\":null,\"partitionsTypeStr\":null,\"checkpointFile\":null},\"colsFieldName\":\"__cols\",\"entriesFieldName\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"colKey\":[\"s\"]}" (TableMapRows (TableUnion (TableKeyBy (locus alleles) True (TableMapRows (TableKeyBy (locus) False (TableKeyBy (locus) False (TableExplode ("__uid_3") (TableMapRows (TableRead None False {\"files\":[\"/home/hj7968/Hail/Inputs/dragen-joint-test.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"nPartitions\":144,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":true,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"}) (InsertFields (Let __iruid_509 (GetField alleles (Ref row)) (Let __iruid_510 (GetField locus (Ref row)) (InsertFields (SelectFields (locus alleles rsid qual filters info) (Ref row)) None (__uid_3 (ArraySort __iruid_511 __iruid_512 (StreamFlatMap __iruid_513 (StreamFilter __iruid_514 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_509)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_509) (Ref __iruid_514)) (Str "*"))) (ToStream False (Let __iruid_515 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_510) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_509) (I32 0)) (ApplyIR 7 indexArray () String (Ref __iruid_509) (Ref __iruid_513)))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_515)) (Ref __iruid_510)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_515))) (locus (GetField locus (Ref __iruid_515))) (a_index (Ref __iruid_513)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref row))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_511)) (False) (If (IsNA (Ref __iruid_512)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_511) (Ref __iruid_512)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row)))))))) (InsertFields (Let __iruid_517 (GetField __uid_3 (Ref row)) (InsertFields (SelectFields (locus alleles rsid qual filters info) (Ref row)) None (locus (GetField locus (Ref __iruid_517))) (alleles (GetField alleles (Ref __iruid_517))) (a_index (GetField a_index (Ref __iruid_517))) (was_split (GetField was_split (Ref __iruid_517))) (old_alleles (GetField alleles (Ref row))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row)))))) (TableKeyBy (locus alleles) False (TableMapRows (TableKeyBy () False (TableExplode ("__uid_3") (TableMapRows (TableRead None False {\"files\":[\"/home/hj7968/Hail/Inputs/dragen-joint-test.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"nPartitions\":144,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":true,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"}) (InsertFields (Let __iruid_518 (GetField alleles (Ref row)) (Let __iruid_519 (GetField locus (Ref row)) (InsertFields (SelectFields (locus alleles rsid qual filters info) (Ref row)) None (__uid_3 (ArraySort __iruid_520 __iruid_521 (StreamFlatMap __iruid_522 (StreamFilter __iruid_523 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_518)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_518) (Ref __iruid_523)) (Str "*"))) (ToStream False (Let __iruid_524 (Apply 14 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_519) (MakeArray Array[String] (ArrayRef 12 (Ref __iruid_518) (I32 0)) (ApplyIR 13 indexArray () String (Ref __iruid_518) (Ref __iruid_522)))) (If (ApplyComparisonOp NEQ (GetField locus (Ref __iruid_524)) (Ref __iruid_519)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_524))) (locus (GetField locus (Ref __iruid_524))) (a_index (Ref __iruid_522)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref row))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_520)) (False) (If (IsNA (Ref __iruid_521)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_520) (Ref __iruid_521)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row))))))) (InsertFields (Let __iruid_526 (GetField __uid_3 (Ref row)) (InsertFields (SelectFields (locus alleles rsid qual filters info) (Ref row)) None (locus (GetField locus (Ref __iruid_526))) (alleles (GetField alleles (Ref __iruid_526))) (a_index (GetField a_index (Ref __iruid_526))) (was_split (GetField was_split (Ref __iruid_526))) (old_alleles (GetField alleles (Ref row))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row))))))) (MakeStruct (locus (GetField locus (Ref row))) (alleles (GetField alleles (Ref row))) (rsid (GetField rsid (Ref row))) (qual (GetField qual (Ref row))) (filters (GetField filters (Ref row))) (info (GetField info (Ref row))) (a_index (GetField a_index (Ref row))) (was_split (GetField was_split (Ref row))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_527 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row))) (Let __iruid_528 (If (IsNA (GetField PL (Ref __iruid_527))) (NA Array[Int32]) (ToArray (StreamMap __iruid_529 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_534 __iruid_535) __iruid_530 (StreamFilter __iruid_531 (StreamMap __iruid_532 (StreamFilter __iruid_533 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref row)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_533)) (GetField a_index (Ref row)))) (Ref __iruid_529))) (ApplyIR 25 indexArray () Int32 (GetField PL (Ref __iruid_527)) (Ref __iruid_532))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_531)))) (NA Int32) (True) (If (Ref __iruid_535) (Ref __iruid_530) (If (ApplyComparisonOp LT (Ref __iruid_534) (Ref __iruid_530)) (Ref __iruid_534) (Ref __iruid_530))) (False) (Ref __iruid_534))))) (InsertFields (Ref __iruid_527) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_527)) (GetField a_index (Ref row)))) (DP (GetField DP (Ref __iruid_527))) (AD (If (IsNA (GetField AD (Ref __iruid_527))) (NA Array[Int32]) (Let __iruid_536 (GetField AD (Ref __iruid_527)) (Let __iruid_537 (GetField a_index (Ref row)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_538 __iruid_539 (StreamFilter __iruid_540 (ToStream False (Ref __iruid_536)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_540)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_538) (Ref __iruid_539))) (ApplyIR 17 indexArray () Int32 (Ref __iruid_536) (Ref __iruid_537))) (ApplyIR 18 indexArray () Int32 (Ref __iruid_536) (Ref __iruid_537))))))) (PL (Ref __iruid_528)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_528)) (GetField GQ (Ref __iruid_527)))))))))))) 2023-02-10 11:11:33 root: INFO: LowerOrInterpretNonCompilable: whole stage code generation is a go! 2023-02-10 11:11:33 root: INFO: lowering result: TableWrite 2023-02-10 11:11:33 root: INFO: optimize optimize: compileLowerer, initial IR: before: IR size 167: (Let sortedPartData (ArraySort __iruid_575 __iruid_576 (Let __iruid_571 (CollectDistributedArray context globals (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (MakeStruct) (StreamAgg x (StreamAggScan key (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref context)) (MakeStruct (key (Ref key)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (ApplyScanOp PrevNonnull () ((Ref key)))))) (Let n (ApplyAggOp Count () ()) (AggLet key False (GetField key (Ref x)) (MakeStruct (n (Ref n)) (minkey (ApplyAggOp TakeBy ((I32 1)) ((Ref key) (Ref key)))) (maxkey (ApplyAggOp TakeBy ((I32 1)) ((Ref key) (Ref key)))) (ksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref x))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref x)) (GetField key (Ref x))))))) (Ref n))) (pksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields (locus) (GetField prevkey (Ref x)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref x))) (SelectFields (locus) (GetField key (Ref x)))))))) (Ref n))) (sample (ApplyAggOp TakeBy ((I32 20)) ((GetField key (Ref x)) (GetField token (Ref x)))))))))) (StreamMap __iruid_574 (StreamFilter __iruid_573 (StreamMap __iruid_572 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_571)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_571) (Ref __iruid_572)) None (i (Ref __iruid_572)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_573))) (I32 0))) (InsertFields (Ref __iruid_574) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_574)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_574)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_575)) (SelectFields (minkey maxkey) (Ref __iruid_576)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold acc partDataWithIndex (ToStream False (Ref sortedPartData)) (True) (ApplySpecial -1 land () Boolean (Ref acc) (GetField ksorted (Ref partDataWithIndex)))) (StreamFold acc i (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref sortedPartData)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref acc) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref sortedPartData) (Ref i))) (GetField minkey (ArrayRef -1 (Ref sortedPartData) (ApplyBinaryPrimOp Add (Ref i) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold acc partDataWithIndex (ToStream False (Ref sortedPartData)) (True) (ApplySpecial -1 land () Boolean (Ref acc) (GetField pksorted (Ref partDataWithIndex)))) (StreamFold acc i (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref sortedPartData)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref acc) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref sortedPartData) (Ref i)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref sortedPartData) (ApplyBinaryPrimOp Add (Ref i) (I32 1)))))))))) (sortedPartData (Ref sortedPartData)))) 2023-02-10 11:11:34 root: INFO: optimize optimize: compileLowerer, initial IR: after: IR size 167: (Let __iruid_619 (ArraySort __iruid_620 __iruid_621 (Let __iruid_622 (CollectDistributedArray __iruid_623 __iruid_624 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (StreamAgg __iruid_625 (StreamAggScan __iruid_626 (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_623)) (MakeStruct (key (Ref __iruid_626)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (ApplyScanOp PrevNonnull () ((Ref __iruid_626)))))) (Let __iruid_627 (ApplyAggOp Count () ()) (AggLet __iruid_628 False (GetField key (Ref __iruid_625)) (MakeStruct (n (Ref __iruid_627)) (minkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_628) (Ref __iruid_628)))) (maxkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_628) (Ref __iruid_628)))) (ksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_625))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_625)) (GetField key (Ref __iruid_625))))))) (Ref __iruid_627))) (pksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_625)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_625))) (SelectFields (locus) (GetField key (Ref __iruid_625)))))))) (Ref __iruid_627))) (sample (ApplyAggOp TakeBy ((I32 20)) ((GetField key (Ref __iruid_625)) (GetField token (Ref __iruid_625)))))))))) (StreamMap __iruid_629 (StreamFilter __iruid_630 (StreamMap __iruid_631 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_622)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_622) (Ref __iruid_631)) None (i (Ref __iruid_631)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_630))) (I32 0))) (InsertFields (Ref __iruid_629) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_629)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_629)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_620)) (SelectFields (minkey maxkey) (Ref __iruid_621)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_632 __iruid_633 (ToStream False (Ref __iruid_619)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_632) (GetField ksorted (Ref __iruid_633)))) (StreamFold __iruid_634 __iruid_635 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_619)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_634) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_619) (Ref __iruid_635))) (GetField minkey (ArrayRef -1 (Ref __iruid_619) (ApplyBinaryPrimOp Add (Ref __iruid_635) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_636 __iruid_637 (ToStream False (Ref __iruid_619)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_636) (GetField pksorted (Ref __iruid_637)))) (StreamFold __iruid_638 __iruid_639 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_619)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_638) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_619) (Ref __iruid_639)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_619) (ApplyBinaryPrimOp Add (Ref __iruid_639) (I32 1)))))))))) (sortedPartData (Ref __iruid_619)))) 2023-02-10 11:11:34 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: before: IR size 167: (Let __iruid_619 (ArraySort __iruid_620 __iruid_621 (Let __iruid_622 (CollectDistributedArray __iruid_623 __iruid_624 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (StreamAgg __iruid_625 (StreamAggScan __iruid_626 (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_623)) (MakeStruct (key (Ref __iruid_626)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (ApplyScanOp PrevNonnull () ((Ref __iruid_626)))))) (Let __iruid_627 (ApplyAggOp Count () ()) (AggLet __iruid_628 False (GetField key (Ref __iruid_625)) (MakeStruct (n (Ref __iruid_627)) (minkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_628) (Ref __iruid_628)))) (maxkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_628) (Ref __iruid_628)))) (ksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_625))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_625)) (GetField key (Ref __iruid_625))))))) (Ref __iruid_627))) (pksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_625)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_625))) (SelectFields (locus) (GetField key (Ref __iruid_625)))))))) (Ref __iruid_627))) (sample (ApplyAggOp TakeBy ((I32 20)) ((GetField key (Ref __iruid_625)) (GetField token (Ref __iruid_625)))))))))) (StreamMap __iruid_629 (StreamFilter __iruid_630 (StreamMap __iruid_631 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_622)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_622) (Ref __iruid_631)) None (i (Ref __iruid_631)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_630))) (I32 0))) (InsertFields (Ref __iruid_629) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_629)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_629)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_620)) (SelectFields (minkey maxkey) (Ref __iruid_621)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_632 __iruid_633 (ToStream False (Ref __iruid_619)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_632) (GetField ksorted (Ref __iruid_633)))) (StreamFold __iruid_634 __iruid_635 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_619)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_634) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_619) (Ref __iruid_635))) (GetField minkey (ArrayRef -1 (Ref __iruid_619) (ApplyBinaryPrimOp Add (Ref __iruid_635) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_636 __iruid_637 (ToStream False (Ref __iruid_619)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_636) (GetField pksorted (Ref __iruid_637)))) (StreamFold __iruid_638 __iruid_639 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_619)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_638) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_619) (Ref __iruid_639)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_619) (ApplyBinaryPrimOp Add (Ref __iruid_639) (I32 1)))))))))) (sortedPartData (Ref __iruid_619)))) 2023-02-10 11:11:34 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: after: IR size 167: (Let __iruid_682 (ArraySort __iruid_683 __iruid_684 (Let __iruid_685 (CollectDistributedArray __iruid_686 __iruid_687 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (StreamAgg __iruid_688 (StreamAggScan __iruid_689 (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_686)) (MakeStruct (key (Ref __iruid_689)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (ApplyScanOp PrevNonnull () ((Ref __iruid_689)))))) (Let __iruid_690 (ApplyAggOp Count () ()) (AggLet __iruid_691 False (GetField key (Ref __iruid_688)) (MakeStruct (n (Ref __iruid_690)) (minkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_691) (Ref __iruid_691)))) (maxkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_691) (Ref __iruid_691)))) (ksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_688))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_688)) (GetField key (Ref __iruid_688))))))) (Ref __iruid_690))) (pksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_688)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_688))) (SelectFields (locus) (GetField key (Ref __iruid_688)))))))) (Ref __iruid_690))) (sample (ApplyAggOp TakeBy ((I32 20)) ((GetField key (Ref __iruid_688)) (GetField token (Ref __iruid_688)))))))))) (StreamMap __iruid_692 (StreamFilter __iruid_693 (StreamMap __iruid_694 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_685)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_685) (Ref __iruid_694)) None (i (Ref __iruid_694)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_693))) (I32 0))) (InsertFields (Ref __iruid_692) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_692)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_692)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_683)) (SelectFields (minkey maxkey) (Ref __iruid_684)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_695 __iruid_696 (ToStream False (Ref __iruid_682)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_695) (GetField ksorted (Ref __iruid_696)))) (StreamFold __iruid_697 __iruid_698 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_682)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_697) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_682) (Ref __iruid_698))) (GetField minkey (ArrayRef -1 (Ref __iruid_682) (ApplyBinaryPrimOp Add (Ref __iruid_698) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_699 __iruid_700 (ToStream False (Ref __iruid_682)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_699) (GetField pksorted (Ref __iruid_700)))) (StreamFold __iruid_701 __iruid_702 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_682)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_701) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_682) (Ref __iruid_702)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_682) (ApplyBinaryPrimOp Add (Ref __iruid_702) (I32 1)))))))))) (sortedPartData (Ref __iruid_682)))) 2023-02-10 11:11:34 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: before: IR size 205: (Let __iruid_682 (ArraySort __iruid_683 __iruid_684 (Let __iruid_685 (CollectDistributedArray __iruid_686 __iruid_687 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (Let __iruid_704 (RunAgg ((TypedStateSig +PInt64) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}) (TypedStateSig +PInt64) (TypedStateSig +PInt64) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) (Begin (Begin (InitOp 0 (Count (TypedStateSig +PInt64)) ()) (InitOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((I32 1))) (InitOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((I32 1))) (InitOp 3 (Sum (TypedStateSig +PInt64)) ()) (InitOp 4 (Sum (TypedStateSig +PInt64)) ()) (InitOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) ((I32 20)))) (StreamFor __iruid_688 (RunAggScan __iruid_689 ( (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_686)) (Begin (InitOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ())) (Begin (SeqOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_689)))) (Let __iruid_703 (MakeTuple (0) (ResultOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})))) (MakeStruct (key (Ref __iruid_689)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (GetTupleElement 0 (Ref __iruid_703)))))) (Let __iruid_691 (GetField key (Ref __iruid_688)) (Begin (SeqOp 0 (Count (TypedStateSig +PInt64)) ()) (SeqOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_691) (Ref __iruid_691))) (SeqOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_691) (Ref __iruid_691))) (SeqOp 3 (Sum (TypedStateSig +PInt64)) ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_688))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_688)) (GetField key (Ref __iruid_688))))))) (SeqOp 4 (Sum (TypedStateSig +PInt64)) ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_688)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_688))) (SelectFields (locus) (GetField key (Ref __iruid_688)))))))) (SeqOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) ((GetField key (Ref __iruid_688)) (GetField token (Ref __iruid_688)))))))) (MakeTuple (0 1 2 3 4 5) (ResultOp 0 (Count (TypedStateSig +PInt64))) (ResultOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}))) (ResultOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}))) (ResultOp 3 (Sum (TypedStateSig +PInt64))) (ResultOp 4 (Sum (TypedStateSig +PInt64))) (ResultOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64))))) (Let __iruid_690 (GetTupleElement 0 (Ref __iruid_704)) (MakeStruct (n (Ref __iruid_690)) (minkey (GetTupleElement 1 (Ref __iruid_704))) (maxkey (GetTupleElement 2 (Ref __iruid_704))) (ksorted (ApplyComparisonOp EQ (GetTupleElement 3 (Ref __iruid_704)) (Ref __iruid_690))) (pksorted (ApplyComparisonOp EQ (GetTupleElement 4 (Ref __iruid_704)) (Ref __iruid_690))) (sample (GetTupleElement 5 (Ref __iruid_704))))))) (StreamMap __iruid_692 (StreamFilter __iruid_693 (StreamMap __iruid_694 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_685)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_685) (Ref __iruid_694)) None (i (Ref __iruid_694)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_693))) (I32 0))) (InsertFields (Ref __iruid_692) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_692)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_692)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_683)) (SelectFields (minkey maxkey) (Ref __iruid_684)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_695 __iruid_696 (ToStream False (Ref __iruid_682)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_695) (GetField ksorted (Ref __iruid_696)))) (StreamFold __iruid_697 __iruid_698 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_682)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_697) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_682) (Ref __iruid_698))) (GetField minkey (ArrayRef -1 (Ref __iruid_682) (ApplyBinaryPrimOp Add (Ref __iruid_698) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_699 __iruid_700 (ToStream False (Ref __iruid_682)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_699) (GetField pksorted (Ref __iruid_700)))) (StreamFold __iruid_701 __iruid_702 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_682)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_701) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_682) (Ref __iruid_702)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_682) (ApplyBinaryPrimOp Add (Ref __iruid_702) (I32 1)))))))))) (sortedPartData (Ref __iruid_682)))) 2023-02-10 11:11:34 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: after: IR size 205: (Let __iruid_751 (ArraySort __iruid_752 __iruid_753 (Let __iruid_754 (CollectDistributedArray __iruid_755 __iruid_756 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (Let __iruid_757 (RunAgg ((TypedStateSig +PInt64) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}) (TypedStateSig +PInt64) (TypedStateSig +PInt64) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) (Begin (Begin (InitOp 0 (Count (TypedStateSig +PInt64)) ()) (InitOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((I32 1))) (InitOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((I32 1))) (InitOp 3 (Sum (TypedStateSig +PInt64)) ()) (InitOp 4 (Sum (TypedStateSig +PInt64)) ()) (InitOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) ((I32 20)))) (StreamFor __iruid_758 (RunAggScan __iruid_759 ( (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_755)) (Begin (InitOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ())) (Begin (SeqOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_759)))) (Let __iruid_760 (MakeTuple (0) (ResultOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})))) (MakeStruct (key (Ref __iruid_759)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (GetTupleElement 0 (Ref __iruid_760)))))) (Let __iruid_761 (GetField key (Ref __iruid_758)) (Begin (SeqOp 0 (Count (TypedStateSig +PInt64)) ()) (SeqOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_761) (Ref __iruid_761))) (SeqOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_761) (Ref __iruid_761))) (SeqOp 3 (Sum (TypedStateSig +PInt64)) ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_758))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_758)) (GetField key (Ref __iruid_758))))))) (SeqOp 4 (Sum (TypedStateSig +PInt64)) ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_758)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_758))) (SelectFields (locus) (GetField key (Ref __iruid_758)))))))) (SeqOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) ((GetField key (Ref __iruid_758)) (GetField token (Ref __iruid_758)))))))) (MakeTuple (0 1 2 3 4 5) (ResultOp 0 (Count (TypedStateSig +PInt64))) (ResultOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}))) (ResultOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}))) (ResultOp 3 (Sum (TypedStateSig +PInt64))) (ResultOp 4 (Sum (TypedStateSig +PInt64))) (ResultOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64))))) (Let __iruid_762 (GetTupleElement 0 (Ref __iruid_757)) (MakeStruct (n (Ref __iruid_762)) (minkey (GetTupleElement 1 (Ref __iruid_757))) (maxkey (GetTupleElement 2 (Ref __iruid_757))) (ksorted (ApplyComparisonOp EQ (GetTupleElement 3 (Ref __iruid_757)) (Ref __iruid_762))) (pksorted (ApplyComparisonOp EQ (GetTupleElement 4 (Ref __iruid_757)) (Ref __iruid_762))) (sample (GetTupleElement 5 (Ref __iruid_757))))))) (StreamMap __iruid_763 (StreamFilter __iruid_764 (StreamMap __iruid_765 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_754)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_754) (Ref __iruid_765)) None (i (Ref __iruid_765)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_764))) (I32 0))) (InsertFields (Ref __iruid_763) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_763)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_763)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_752)) (SelectFields (minkey maxkey) (Ref __iruid_753)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_766 __iruid_767 (ToStream False (Ref __iruid_751)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_766) (GetField ksorted (Ref __iruid_767)))) (StreamFold __iruid_768 __iruid_769 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_751)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_768) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_751) (Ref __iruid_769))) (GetField minkey (ArrayRef -1 (Ref __iruid_751) (ApplyBinaryPrimOp Add (Ref __iruid_769) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_770 __iruid_771 (ToStream False (Ref __iruid_751)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_770) (GetField pksorted (Ref __iruid_771)))) (StreamFold __iruid_772 __iruid_773 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_751)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_772) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_751) (Ref __iruid_773)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_751) (ApplyBinaryPrimOp Add (Ref __iruid_773) (I32 1)))))))))) (sortedPartData (Ref __iruid_751)))) 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C13HailClassLoaderContainer. 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C13HailClassLoaderContainer. 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C14FSContainer. 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C14FSContainer. 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C15collect_distributed_array. 2023-02-10 11:11:34 root: INFO: instruction count: 150: __C15collect_distributed_array.apply 2023-02-10 11:11:34 root: INFO: instruction count: 17: __C15collect_distributed_array.apply 2023-02-10 11:11:34 root: INFO: instruction count: 27: __C15collect_distributed_array.__m16DECODE_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND_TO_SBaseStructPointer 2023-02-10 11:11:34 root: INFO: instruction count: 53: __C15collect_distributed_array.__m17INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:34 root: INFO: instruction count: 10: __C15collect_distributed_array.__m18INPLACE_DECODE_r_int32_TO_r_int32 2023-02-10 11:11:34 root: INFO: instruction count: 31: __C15collect_distributed_array.__m19INPLACE_DECODE_r_binary_TO_r_string 2023-02-10 11:11:34 root: INFO: instruction count: 10: __C15collect_distributed_array.__m20INPLACE_DECODE_r_int64_TO_r_int64 2023-02-10 11:11:34 root: INFO: instruction count: 10: __C15collect_distributed_array.__m21INPLACE_DECODE_r_bool_TO_r_bool 2023-02-10 11:11:34 root: INFO: instruction count: 27: __C15collect_distributed_array.__m23DECODE_r_struct_of_r_struct_of_ENDEND_TO_SBaseStructPointer 2023-02-10 11:11:34 root: INFO: instruction count: 8: __C15collect_distributed_array.__m24INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-02-10 11:11:34 root: INFO: instruction count: 323: __C15collect_distributed_array.__m26split_Let 2023-02-10 11:11:34 root: INFO: instruction count: 17: __C15collect_distributed_array.__m44i_gt_j 2023-02-10 11:11:34 root: INFO: instruction count: 71: __C15collect_distributed_array.__m45ord_compareNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 11: __C15collect_distributed_array.__m46ord_compare 2023-02-10 11:11:34 root: INFO: instruction count: 163: __C15collect_distributed_array.__m47ord_compareNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 15: __C15collect_distributed_array.__m48ord_compare 2023-02-10 11:11:34 root: INFO: instruction count: 74: __C15collect_distributed_array.__m49ord_compareNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 9: __C15collect_distributed_array.__m51ord_compareNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 89: __C15collect_distributed_array.__m52ord_compareNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 15: __C15collect_distributed_array.__m53ord_compare 2023-02-10 11:11:34 root: INFO: instruction count: 82: __C15collect_distributed_array.__m54ord_compareNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 11: __C15collect_distributed_array.__m55ord_compare 2023-02-10 11:11:34 root: INFO: instruction count: 11: __C15collect_distributed_array.__m56ord_compare 2023-02-10 11:11:34 root: INFO: instruction count: 8: __C15collect_distributed_array.__m57ord_compareNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 18: __C15collect_distributed_array.__m58swap 2023-02-10 11:11:34 root: INFO: instruction count: 74: __C15collect_distributed_array.__m59rebalance_up 2023-02-10 11:11:34 root: INFO: instruction count: 150: __C15collect_distributed_array.__m60rebalance_down 2023-02-10 11:11:34 root: INFO: instruction count: 17: __C15collect_distributed_array.__m73i_gt_j 2023-02-10 11:11:34 root: INFO: instruction count: 18: __C15collect_distributed_array.__m74swap 2023-02-10 11:11:34 root: INFO: instruction count: 74: __C15collect_distributed_array.__m75rebalance_up 2023-02-10 11:11:34 root: INFO: instruction count: 150: __C15collect_distributed_array.__m76rebalance_down 2023-02-10 11:11:34 root: INFO: instruction count: 17: __C15collect_distributed_array.__m91i_gt_j 2023-02-10 11:11:34 root: INFO: instruction count: 79: __C15collect_distributed_array.__m92ord_compareNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 11: __C15collect_distributed_array.__m93ord_compare 2023-02-10 11:11:34 root: INFO: instruction count: 8: __C15collect_distributed_array.__m94ord_compareNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 18: __C15collect_distributed_array.__m95swap 2023-02-10 11:11:34 root: INFO: instruction count: 74: __C15collect_distributed_array.__m96rebalance_up 2023-02-10 11:11:34 root: INFO: instruction count: 150: __C15collect_distributed_array.__m97rebalance_down 2023-02-10 11:11:34 root: INFO: instruction count: 9: __C15collect_distributed_array.__m98begin_group_0 2023-02-10 11:11:34 root: INFO: instruction count: 403: __C15collect_distributed_array.__m99begin_group_0 2023-02-10 11:11:34 root: INFO: instruction count: 205: __C15collect_distributed_array.__m100split_StreamFor 2023-02-10 11:11:34 root: INFO: instruction count: 12: __C15collect_distributed_array.__m108setup_null 2023-02-10 11:11:34 root: INFO: instruction count: 216: __C15collect_distributed_array.__m120begin_group_0 2023-02-10 11:11:34 root: INFO: instruction count: 18: __C15collect_distributed_array.__m121begin_group_0 2023-02-10 11:11:34 root: INFO: instruction count: 4: __C15collect_distributed_array.setObjects 2023-02-10 11:11:34 root: INFO: instruction count: 5: __C15collect_distributed_array.__m128split_Begin 2023-02-10 11:11:34 root: INFO: instruction count: 267: __C15collect_distributed_array.__m130begin_group_0 2023-02-10 11:11:34 root: INFO: instruction count: 827: __C15collect_distributed_array.__m131take_by_seqop 2023-02-10 11:11:34 root: INFO: instruction count: 120: __C15collect_distributed_array.__m133take_by_garbage_collect 2023-02-10 11:11:34 root: INFO: instruction count: 827: __C15collect_distributed_array.__m134take_by_seqop 2023-02-10 11:11:34 root: INFO: instruction count: 11: __C15collect_distributed_array.__m136ord_compare 2023-02-10 11:11:34 root: INFO: instruction count: 163: __C15collect_distributed_array.__m137ord_compareNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 120: __C15collect_distributed_array.__m138take_by_garbage_collect 2023-02-10 11:11:34 root: INFO: instruction count: 11: __C15collect_distributed_array.__m139ord_lteq 2023-02-10 11:11:34 root: INFO: instruction count: 212: __C15collect_distributed_array.__m140ord_lteqNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 15: __C15collect_distributed_array.__m141ord_lteq 2023-02-10 11:11:34 root: INFO: instruction count: 25: __C15collect_distributed_array.__m142ord_lteqNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 15: __C15collect_distributed_array.__m143ord_equiv 2023-02-10 11:11:34 root: INFO: instruction count: 25: __C15collect_distributed_array.__m144ord_equivNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 15: __C15collect_distributed_array.__m145ord_lteq 2023-02-10 11:11:34 root: INFO: instruction count: 99: __C15collect_distributed_array.__m146ord_lteqNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 11: __C15collect_distributed_array.__m147ord_lteq 2023-02-10 11:11:34 root: INFO: instruction count: 21: __C15collect_distributed_array.__m148ord_lteqNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 11: __C15collect_distributed_array.__m149ord_equiv 2023-02-10 11:11:34 root: INFO: instruction count: 21: __C15collect_distributed_array.__m150ord_equivNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 15: __C15collect_distributed_array.__m151ord_equiv 2023-02-10 11:11:34 root: INFO: instruction count: 81: __C15collect_distributed_array.__m152ord_equivNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 5: __C15collect_distributed_array.__m153toInt64 2023-02-10 11:11:34 root: INFO: instruction count: 11: __C15collect_distributed_array.__m156ord_lteq 2023-02-10 11:11:34 root: INFO: instruction count: 108: __C15collect_distributed_array.__m157ord_lteqNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 370: __C15collect_distributed_array.__m160take_by_seqop 2023-02-10 11:11:34 root: INFO: instruction count: 390: __C15collect_distributed_array.__m162take_by_garbage_collect 2023-02-10 11:11:34 root: INFO: instruction count: 355: __C15collect_distributed_array.__m163take_by_result 2023-02-10 11:11:34 root: INFO: instruction count: 28: __C15collect_distributed_array.__m164result_quicksort 2023-02-10 11:11:34 root: INFO: instruction count: 19: __C15collect_distributed_array.__m165quicksort_swap 2023-02-10 11:11:34 root: INFO: instruction count: 193: __C15collect_distributed_array.__m166quicksort_partition 2023-02-10 11:11:34 root: INFO: instruction count: 355: __C15collect_distributed_array.__m167take_by_result 2023-02-10 11:11:34 root: INFO: instruction count: 28: __C15collect_distributed_array.__m168result_quicksort 2023-02-10 11:11:34 root: INFO: instruction count: 19: __C15collect_distributed_array.__m169quicksort_swap 2023-02-10 11:11:34 root: INFO: instruction count: 193: __C15collect_distributed_array.__m170quicksort_partition 2023-02-10 11:11:34 root: INFO: instruction count: 355: __C15collect_distributed_array.__m171take_by_result 2023-02-10 11:11:34 root: INFO: instruction count: 28: __C15collect_distributed_array.__m172result_quicksort 2023-02-10 11:11:34 root: INFO: instruction count: 19: __C15collect_distributed_array.__m173quicksort_swap 2023-02-10 11:11:34 root: INFO: instruction count: 193: __C15collect_distributed_array.__m174quicksort_partition 2023-02-10 11:11:34 root: INFO: instruction count: 11: __C15collect_distributed_array.__m200ord_equiv 2023-02-10 11:11:34 root: INFO: instruction count: 16: __C15collect_distributed_array.__m201ord_equivNonnull 2023-02-10 11:11:34 root: INFO: instruction count: 9: __C15collect_distributed_array.__m214ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDENDEND 2023-02-10 11:11:34 root: INFO: instruction count: 109: __C15collect_distributed_array.__m215ENCODE_SBaseStructPointer_TO_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDEND 2023-02-10 11:11:34 root: INFO: instruction count: 4: __C15collect_distributed_array.__m216ENCODE_SInt64$_TO_r_int64 2023-02-10 11:11:34 root: INFO: instruction count: 35: __C15collect_distributed_array.__m217ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND 2023-02-10 11:11:34 root: INFO: instruction count: 51: __C15collect_distributed_array.__m218ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND 2023-02-10 11:11:34 root: INFO: instruction count: 25: __C15collect_distributed_array.__m219ENCODE_SCanonicalLocusPointer_TO_r_struct_of_r_binaryANDr_int32END 2023-02-10 11:11:34 root: INFO: instruction count: 16: __C15collect_distributed_array.__m220ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:11:34 root: INFO: instruction count: 4: __C15collect_distributed_array.__m221ENCODE_SInt32$_TO_r_int32 2023-02-10 11:11:34 root: INFO: instruction count: 39: __C15collect_distributed_array.__m222ENCODE_SIndexablePointer_TO_r_array_of_r_binary 2023-02-10 11:11:34 root: INFO: instruction count: 4: __C15collect_distributed_array.__m223ENCODE_SBoolean$_TO_r_bool 2023-02-10 11:11:34 root: INFO: instruction count: 21: __C15collect_distributed_array.setPartitionIndex 2023-02-10 11:11:34 root: INFO: instruction count: 4: __C15collect_distributed_array.addPartitionRegion 2023-02-10 11:11:34 root: INFO: instruction count: 4: __C15collect_distributed_array.setPool 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C15collect_distributed_array.addHailClassLoader 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C15collect_distributed_array.addFS 2023-02-10 11:11:34 root: INFO: instruction count: 43: __C15collect_distributed_array.addReferenceGenomes 2023-02-10 11:11:34 root: INFO: instruction count: 379: __C15collect_distributed_array.__m26split_Let_region12_17 2023-02-10 11:11:34 root: INFO: instruction count: 322: __C15collect_distributed_array.__m100split_StreamFor_region6_21 2023-02-10 11:11:34 root: INFO: instruction count: 273: __C15collect_distributed_array.__m131take_by_seqop_region15_17 2023-02-10 11:11:34 root: INFO: instruction count: 238: __C15collect_distributed_array.__m131take_by_seqop_region3_3 2023-02-10 11:11:34 root: INFO: instruction count: 521: __C15collect_distributed_array.__m133take_by_garbage_collect_region2_12 2023-02-10 11:11:34 root: INFO: instruction count: 273: __C15collect_distributed_array.__m134take_by_seqop_region15_17 2023-02-10 11:11:34 root: INFO: instruction count: 238: __C15collect_distributed_array.__m134take_by_seqop_region3_3 2023-02-10 11:11:34 root: INFO: instruction count: 521: __C15collect_distributed_array.__m138take_by_garbage_collect_region2_12 2023-02-10 11:11:34 root: INFO: instruction count: 261: __C15collect_distributed_array.__m160take_by_seqop_region9_11 2023-02-10 11:11:34 root: INFO: instruction count: 253: __C15collect_distributed_array.__m160take_by_seqop_region3_5 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C226__m26split_LetSpills. 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C229__m100split_StreamForSpills. 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C234__m131take_by_seqopSpills. 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C249__m133take_by_garbage_collectSpills. 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C255__m134take_by_seqopSpills. 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C270__m138take_by_garbage_collectSpills. 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C276__m160take_by_seqopSpills. 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C50RGContainer_GRCh38. 2023-02-10 11:11:34 root: INFO: instruction count: 3: __C50RGContainer_GRCh38. 2023-02-10 11:11:35 root: INFO: encoder cache miss (0 hits, 1 misses, 0.000) 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C421HailClassLoaderContainer. 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C421HailClassLoaderContainer. 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C422FSContainer. 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C422FSContainer. 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C423etypeEncode. 2023-02-10 11:11:35 root: INFO: instruction count: 7: __C423etypeEncode.apply 2023-02-10 11:11:35 root: INFO: instruction count: 33: __C423etypeEncode.__m424ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_ENDANDr_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND 2023-02-10 11:11:35 root: INFO: instruction count: 1: __C423etypeEncode.__m425ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-02-10 11:11:35 root: INFO: instruction count: 35: __C423etypeEncode.__m426ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:35 root: INFO: instruction count: 61: __C423etypeEncode.__m427ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:35 root: INFO: instruction count: 4: __C423etypeEncode.__m428ENCODE_SInt32$_TO_r_int32 2023-02-10 11:11:35 root: INFO: instruction count: 16: __C423etypeEncode.__m429ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:11:35 root: INFO: instruction count: 4: __C423etypeEncode.__m430ENCODE_SInt64$_TO_r_int64 2023-02-10 11:11:35 root: INFO: instruction count: 4: __C423etypeEncode.__m431ENCODE_SBoolean$_TO_r_bool 2023-02-10 11:11:35 MemoryStore: INFO: Block broadcast_1 stored as values in memory (estimated size 11.2 KiB, free 79.8 GiB) 2023-02-10 11:11:35 MemoryStore: INFO: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 79.8 GiB) 2023-02-10 11:11:35 BlockManagerInfo: INFO: Added broadcast_1_piece0 in memory on 163.152.180.157:46313 (size: 2.6 KiB, free: 79.8 GiB) 2023-02-10 11:11:35 SparkContext: INFO: Created broadcast 1 from broadcast at SparkBackend.scala:280 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C1HailClassLoaderContainer. 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C1HailClassLoaderContainer. 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C2FSContainer. 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C2FSContainer. 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C3Compiled. 2023-02-10 11:11:35 root: INFO: instruction count: 519: __C3Compiled.apply 2023-02-10 11:11:35 root: INFO: instruction count: 4: __C3Compiled.setBackend 2023-02-10 11:11:35 root: INFO: instruction count: 9: __C3Compiled.__m294ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND 2023-02-10 11:11:35 root: INFO: instruction count: 61: __C3Compiled.__m295ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:35 root: INFO: instruction count: 4: __C3Compiled.__m296ENCODE_SInt32$_TO_r_int32 2023-02-10 11:11:35 root: INFO: instruction count: 16: __C3Compiled.__m297ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:11:35 root: INFO: instruction count: 4: __C3Compiled.__m298ENCODE_SInt64$_TO_r_int64 2023-02-10 11:11:35 root: INFO: instruction count: 4: __C3Compiled.__m299ENCODE_SBoolean$_TO_r_bool 2023-02-10 11:11:35 root: INFO: instruction count: 9: __C3Compiled.__m300ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_ENDEND 2023-02-10 11:11:35 root: INFO: instruction count: 1: __C3Compiled.__m301ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-02-10 11:11:35 root: INFO: instruction count: 4: __C3Compiled.setObjects 2023-02-10 11:11:35 root: INFO: instruction count: 27: __C3Compiled.__m303DECODE_r_struct_of_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDENDEND_TO_SBaseStructPointer 2023-02-10 11:11:35 root: INFO: instruction count: 62: __C3Compiled.__m304INPLACE_DECODE_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDEND_TO_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_locusANDr_array_of_r_stringENDANDr_array_of_r_struct_of_r_locusANDr_array_of_r_stringENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_locusANDr_array_of_r_stringENDEND 2023-02-10 11:11:35 root: INFO: instruction count: 10: __C3Compiled.__m305INPLACE_DECODE_r_int64_TO_r_int64 2023-02-10 11:11:35 root: INFO: instruction count: 58: __C3Compiled.__m306INPLACE_DECODE_r_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND_TO_r_array_of_r_struct_of_r_locusANDr_array_of_r_stringEND 2023-02-10 11:11:35 root: INFO: instruction count: 26: __C3Compiled.__m307INPLACE_DECODE_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND_TO_r_struct_of_r_locusANDr_array_of_r_stringEND 2023-02-10 11:11:35 root: INFO: instruction count: 26: __C3Compiled.__m308INPLACE_DECODE_r_struct_of_r_binaryANDr_int32END_TO_r_locus 2023-02-10 11:11:35 root: INFO: instruction count: 31: __C3Compiled.__m309INPLACE_DECODE_r_binary_TO_r_string 2023-02-10 11:11:35 root: INFO: instruction count: 10: __C3Compiled.__m310INPLACE_DECODE_r_int32_TO_r_int32 2023-02-10 11:11:35 root: INFO: instruction count: 58: __C3Compiled.__m311INPLACE_DECODE_r_array_of_r_binary_TO_r_array_of_r_string 2023-02-10 11:11:35 root: INFO: instruction count: 10: __C3Compiled.__m312INPLACE_DECODE_r_bool_TO_r_bool 2023-02-10 11:11:35 root: INFO: instruction count: 35: __C3Compiled.__m321arrayref_bounds_check 2023-02-10 11:11:35 root: INFO: instruction count: 11: __C3Compiled.__m325ord_gt 2023-02-10 11:11:35 root: INFO: instruction count: 14: __C3Compiled.__m326ord_gtNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 12: __C3Compiled.__m331setup_jab 2023-02-10 11:11:35 root: INFO: instruction count: 31: __C3Compiled.__m334dependent_sorting_func 2023-02-10 11:11:35 root: INFO: instruction count: 11: __C3Compiled.__m337ord_lt 2023-02-10 11:11:35 root: INFO: instruction count: 91: __C3Compiled.__m338ord_ltNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 11: __C3Compiled.__m339ord_lt 2023-02-10 11:11:35 root: INFO: instruction count: 215: __C3Compiled.__m340ord_ltNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 15: __C3Compiled.__m341ord_lt 2023-02-10 11:11:35 root: INFO: instruction count: 25: __C3Compiled.__m342ord_ltNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 74: __C3Compiled.__m343ord_compareNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 9: __C3Compiled.__m345ord_compareNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 89: __C3Compiled.__m346ord_compareNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 15: __C3Compiled.__m347ord_equiv 2023-02-10 11:11:35 root: INFO: instruction count: 25: __C3Compiled.__m348ord_equivNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 15: __C3Compiled.__m349ord_lt 2023-02-10 11:11:35 root: INFO: instruction count: 102: __C3Compiled.__m350ord_ltNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 11: __C3Compiled.__m351ord_lt 2023-02-10 11:11:35 root: INFO: instruction count: 21: __C3Compiled.__m352ord_ltNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 11: __C3Compiled.__m353ord_equiv 2023-02-10 11:11:35 root: INFO: instruction count: 21: __C3Compiled.__m354ord_equivNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 15: __C3Compiled.__m355ord_equiv 2023-02-10 11:11:35 root: INFO: instruction count: 81: __C3Compiled.__m356ord_equivNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 11: __C3Compiled.__m357ord_equiv 2023-02-10 11:11:35 root: INFO: instruction count: 162: __C3Compiled.__m358ord_equivNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 202: __C3Compiled.__m359arraySorter_outer 2023-02-10 11:11:35 root: INFO: instruction count: 66: __C3Compiled.__m360arraySorter_merge 2023-02-10 11:11:35 root: INFO: instruction count: 36: __C3Compiled.__m361arraySorter_splitMerge 2023-02-10 11:11:35 root: INFO: instruction count: 79: __C3Compiled.__m366split_StreamFold 2023-02-10 11:11:35 root: INFO: instruction count: 146: __C3Compiled.__m376split_StreamFold 2023-02-10 11:11:35 root: INFO: instruction count: 11: __C3Compiled.__m384ord_lteq 2023-02-10 11:11:35 root: INFO: instruction count: 212: __C3Compiled.__m385ord_lteqNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 15: __C3Compiled.__m386ord_lteq 2023-02-10 11:11:35 root: INFO: instruction count: 25: __C3Compiled.__m387ord_lteqNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 15: __C3Compiled.__m388ord_lteq 2023-02-10 11:11:35 root: INFO: instruction count: 99: __C3Compiled.__m389ord_lteqNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 11: __C3Compiled.__m390ord_lteq 2023-02-10 11:11:35 root: INFO: instruction count: 21: __C3Compiled.__m391ord_lteqNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 79: __C3Compiled.__m393split_StreamFold 2023-02-10 11:11:35 root: INFO: instruction count: 146: __C3Compiled.__m403split_StreamFold 2023-02-10 11:11:35 root: INFO: instruction count: 11: __C3Compiled.__m411ord_lteq 2023-02-10 11:11:35 root: INFO: instruction count: 108: __C3Compiled.__m412ord_lteqNonnull 2023-02-10 11:11:35 root: INFO: instruction count: 9: __C3Compiled.setPartitionIndex 2023-02-10 11:11:35 root: INFO: instruction count: 4: __C3Compiled.addPartitionRegion 2023-02-10 11:11:35 root: INFO: instruction count: 4: __C3Compiled.setPool 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C3Compiled.addHailClassLoader 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C3Compiled.addFS 2023-02-10 11:11:35 root: INFO: instruction count: 43: __C3Compiled.addReferenceGenomes 2023-02-10 11:11:35 root: INFO: instruction count: 62: __C3Compiled.addLiterals 2023-02-10 11:11:35 root: INFO: instruction count: 36: __C3Compiled.__m417DECODE_r_struct_of_r_struct_of_ENDANDr_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND_TO_SBaseStructPointer 2023-02-10 11:11:35 root: INFO: instruction count: 8: __C3Compiled.__m418INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-02-10 11:11:35 root: INFO: instruction count: 58: __C3Compiled.__m419INPLACE_DECODE_r_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_array_of_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:35 root: INFO: instruction count: 53: __C3Compiled.__m420INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:35 root: INFO: instruction count: 331: __C3Compiled.apply_region14_22 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C432applySpills. 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C344RGContainer_GRCh38. 2023-02-10 11:11:35 root: INFO: instruction count: 3: __C344RGContainer_GRCh38. 2023-02-10 11:11:35 MemoryStore: INFO: Block broadcast_2 stored as values in memory (estimated size 64.0 B, free 79.8 GiB) 2023-02-10 11:11:35 MemoryStore: INFO: Block broadcast_2_piece0 stored as bytes in memory (estimated size 49.0 B, free 79.8 GiB) 2023-02-10 11:11:35 BlockManagerInfo: INFO: Added broadcast_2_piece0 in memory on 163.152.180.157:46313 (size: 49.0 B, free: 79.8 GiB) 2023-02-10 11:11:35 SparkContext: INFO: Created broadcast 2 from broadcast at SparkBackend.scala:280 2023-02-10 11:11:35 MemoryStore: INFO: Block broadcast_3 stored as values in memory (estimated size 370.8 KiB, free 79.8 GiB) 2023-02-10 11:11:35 MemoryStore: INFO: Block broadcast_3_piece0 stored as bytes in memory (estimated size 27.1 KiB, free 79.8 GiB) 2023-02-10 11:11:35 BlockManagerInfo: INFO: Added broadcast_3_piece0 in memory on 163.152.180.157:46313 (size: 27.1 KiB, free: 79.8 GiB) 2023-02-10 11:11:35 SparkContext: INFO: Created broadcast 3 from broadcast at SparkBackend.scala:280 2023-02-10 11:11:35 SparkContext: INFO: Starting job: collect at SparkBackend.scala:288 2023-02-10 11:11:35 DAGScheduler: INFO: Got job 0 (collect at SparkBackend.scala:288) with 144 output partitions 2023-02-10 11:11:35 DAGScheduler: INFO: Final stage: ResultStage 0 (collect at SparkBackend.scala:288) 2023-02-10 11:11:35 DAGScheduler: INFO: Parents of final stage: List() 2023-02-10 11:11:35 DAGScheduler: INFO: Missing parents: List() 2023-02-10 11:11:35 DAGScheduler: INFO: Submitting ResultStage 0 (SparkBackendComputeRDD[0] at RDD at SparkBackend.scala:720), which has no missing parents 2023-02-10 11:11:35 MemoryStore: INFO: Block broadcast_4 stored as values in memory (estimated size 411.7 KiB, free 79.8 GiB) 2023-02-10 11:11:35 MemoryStore: INFO: Block broadcast_4_piece0 stored as bytes in memory (estimated size 198.8 KiB, free 79.8 GiB) 2023-02-10 11:11:35 BlockManagerInfo: INFO: Added broadcast_4_piece0 in memory on 163.152.180.157:46313 (size: 198.8 KiB, free: 79.8 GiB) 2023-02-10 11:11:35 SparkContext: INFO: Created broadcast 4 from broadcast at DAGScheduler.scala:1433 2023-02-10 11:11:35 DAGScheduler: INFO: Submitting 144 missing tasks from ResultStage 0 (SparkBackendComputeRDD[0] at RDD at SparkBackend.scala:720) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)) 2023-02-10 11:11:35 TaskSchedulerImpl: INFO: Adding task set 0.0 with 144 tasks resource profile 0 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 0.0 in stage 0.0 (TID 0) (163.152.180.157, executor driver, partition 0, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 1.0 in stage 0.0 (TID 1) (163.152.180.157, executor driver, partition 1, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 2.0 in stage 0.0 (TID 2) (163.152.180.157, executor driver, partition 2, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 3.0 in stage 0.0 (TID 3) (163.152.180.157, executor driver, partition 3, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 4.0 in stage 0.0 (TID 4) (163.152.180.157, executor driver, partition 4, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 5.0 in stage 0.0 (TID 5) (163.152.180.157, executor driver, partition 5, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 6.0 in stage 0.0 (TID 6) (163.152.180.157, executor driver, partition 6, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 7.0 in stage 0.0 (TID 7) (163.152.180.157, executor driver, partition 7, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 8.0 in stage 0.0 (TID 8) (163.152.180.157, executor driver, partition 8, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 9.0 in stage 0.0 (TID 9) (163.152.180.157, executor driver, partition 9, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 10.0 in stage 0.0 (TID 10) (163.152.180.157, executor driver, partition 10, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 11.0 in stage 0.0 (TID 11) (163.152.180.157, executor driver, partition 11, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 12.0 in stage 0.0 (TID 12) (163.152.180.157, executor driver, partition 12, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 13.0 in stage 0.0 (TID 13) (163.152.180.157, executor driver, partition 13, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 14.0 in stage 0.0 (TID 14) (163.152.180.157, executor driver, partition 14, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 15.0 in stage 0.0 (TID 15) (163.152.180.157, executor driver, partition 15, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 16.0 in stage 0.0 (TID 16) (163.152.180.157, executor driver, partition 16, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 17.0 in stage 0.0 (TID 17) (163.152.180.157, executor driver, partition 17, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 18.0 in stage 0.0 (TID 18) (163.152.180.157, executor driver, partition 18, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 19.0 in stage 0.0 (TID 19) (163.152.180.157, executor driver, partition 19, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 20.0 in stage 0.0 (TID 20) (163.152.180.157, executor driver, partition 20, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 21.0 in stage 0.0 (TID 21) (163.152.180.157, executor driver, partition 21, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 22.0 in stage 0.0 (TID 22) (163.152.180.157, executor driver, partition 22, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 23.0 in stage 0.0 (TID 23) (163.152.180.157, executor driver, partition 23, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 24.0 in stage 0.0 (TID 24) (163.152.180.157, executor driver, partition 24, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 25.0 in stage 0.0 (TID 25) (163.152.180.157, executor driver, partition 25, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 26.0 in stage 0.0 (TID 26) (163.152.180.157, executor driver, partition 26, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 27.0 in stage 0.0 (TID 27) (163.152.180.157, executor driver, partition 27, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 28.0 in stage 0.0 (TID 28) (163.152.180.157, executor driver, partition 28, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 29.0 in stage 0.0 (TID 29) (163.152.180.157, executor driver, partition 29, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 30.0 in stage 0.0 (TID 30) (163.152.180.157, executor driver, partition 30, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 31.0 in stage 0.0 (TID 31) (163.152.180.157, executor driver, partition 31, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 32.0 in stage 0.0 (TID 32) (163.152.180.157, executor driver, partition 32, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 33.0 in stage 0.0 (TID 33) (163.152.180.157, executor driver, partition 33, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 34.0 in stage 0.0 (TID 34) (163.152.180.157, executor driver, partition 34, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 35.0 in stage 0.0 (TID 35) (163.152.180.157, executor driver, partition 35, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 36.0 in stage 0.0 (TID 36) (163.152.180.157, executor driver, partition 36, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 37.0 in stage 0.0 (TID 37) (163.152.180.157, executor driver, partition 37, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 38.0 in stage 0.0 (TID 38) (163.152.180.157, executor driver, partition 38, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 TaskSetManager: INFO: Starting task 39.0 in stage 0.0 (TID 39) (163.152.180.157, executor driver, partition 39, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:35 Executor: INFO: Running task 27.0 in stage 0.0 (TID 27) 2023-02-10 11:11:35 Executor: INFO: Running task 29.0 in stage 0.0 (TID 29) 2023-02-10 11:11:35 Executor: INFO: Running task 2.0 in stage 0.0 (TID 2) 2023-02-10 11:11:35 Executor: INFO: Running task 24.0 in stage 0.0 (TID 24) 2023-02-10 11:11:35 Executor: INFO: Running task 7.0 in stage 0.0 (TID 7) 2023-02-10 11:11:35 Executor: INFO: Running task 0.0 in stage 0.0 (TID 0) 2023-02-10 11:11:35 Executor: INFO: Running task 4.0 in stage 0.0 (TID 4) 2023-02-10 11:11:35 Executor: INFO: Running task 18.0 in stage 0.0 (TID 18) 2023-02-10 11:11:35 Executor: INFO: Running task 22.0 in stage 0.0 (TID 22) 2023-02-10 11:11:35 Executor: INFO: Running task 15.0 in stage 0.0 (TID 15) 2023-02-10 11:11:35 Executor: INFO: Running task 26.0 in stage 0.0 (TID 26) 2023-02-10 11:11:35 Executor: INFO: Running task 23.0 in stage 0.0 (TID 23) 2023-02-10 11:11:35 Executor: INFO: Running task 25.0 in stage 0.0 (TID 25) 2023-02-10 11:11:35 Executor: INFO: Running task 9.0 in stage 0.0 (TID 9) 2023-02-10 11:11:35 Executor: INFO: Running task 12.0 in stage 0.0 (TID 12) 2023-02-10 11:11:35 Executor: INFO: Running task 11.0 in stage 0.0 (TID 11) 2023-02-10 11:11:35 Executor: INFO: Running task 37.0 in stage 0.0 (TID 37) 2023-02-10 11:11:35 Executor: INFO: Running task 13.0 in stage 0.0 (TID 13) 2023-02-10 11:11:35 Executor: INFO: Running task 6.0 in stage 0.0 (TID 6) 2023-02-10 11:11:35 Executor: INFO: Running task 3.0 in stage 0.0 (TID 3) 2023-02-10 11:11:35 Executor: INFO: Running task 16.0 in stage 0.0 (TID 16) 2023-02-10 11:11:35 Executor: INFO: Running task 21.0 in stage 0.0 (TID 21) 2023-02-10 11:11:35 Executor: INFO: Running task 14.0 in stage 0.0 (TID 14) 2023-02-10 11:11:35 Executor: INFO: Running task 30.0 in stage 0.0 (TID 30) 2023-02-10 11:11:35 Executor: INFO: Running task 36.0 in stage 0.0 (TID 36) 2023-02-10 11:11:35 Executor: INFO: Running task 33.0 in stage 0.0 (TID 33) 2023-02-10 11:11:35 Executor: INFO: Running task 19.0 in stage 0.0 (TID 19) 2023-02-10 11:11:35 Executor: INFO: Running task 20.0 in stage 0.0 (TID 20) 2023-02-10 11:11:35 Executor: INFO: Running task 5.0 in stage 0.0 (TID 5) 2023-02-10 11:11:35 Executor: INFO: Running task 10.0 in stage 0.0 (TID 10) 2023-02-10 11:11:35 Executor: INFO: Running task 17.0 in stage 0.0 (TID 17) 2023-02-10 11:11:35 Executor: INFO: Running task 28.0 in stage 0.0 (TID 28) 2023-02-10 11:11:35 Executor: INFO: Running task 38.0 in stage 0.0 (TID 38) 2023-02-10 11:11:35 Executor: INFO: Running task 1.0 in stage 0.0 (TID 1) 2023-02-10 11:11:35 Executor: INFO: Running task 31.0 in stage 0.0 (TID 31) 2023-02-10 11:11:35 Executor: INFO: Running task 35.0 in stage 0.0 (TID 35) 2023-02-10 11:11:35 Executor: INFO: Running task 8.0 in stage 0.0 (TID 8) 2023-02-10 11:11:35 Executor: INFO: Running task 32.0 in stage 0.0 (TID 32) 2023-02-10 11:11:35 Executor: INFO: Running task 34.0 in stage 0.0 (TID 34) 2023-02-10 11:11:35 Executor: INFO: Running task 39.0 in stage 0.0 (TID 39) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 28.0 in stage 0.0 (TID 28) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 6.0 in stage 0.0 (TID 6) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 13.0 in stage 0.0 (TID 13) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 1.0 in stage 0.0 (TID 1) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 0.0 in stage 0.0 (TID 0) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 125: Executor task launch worker for task 11.0 in stage 0.0 (TID 11) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 18.0 in stage 0.0 (TID 18) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 31.0 in stage 0.0 (TID 31) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 121: Executor task launch worker for task 7.0 in stage 0.0 (TID 7) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 30.0 in stage 0.0 (TID 30) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 14.0 in stage 0.0 (TID 14) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 39.0 in stage 0.0 (TID 39) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 25.0 in stage 0.0 (TID 25) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 8.0 in stage 0.0 (TID 8) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 16.0 in stage 0.0 (TID 16) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 149: Executor task launch worker for task 35.0 in stage 0.0 (TID 35) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 22.0 in stage 0.0 (TID 22) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 138: Executor task launch worker for task 24.0 in stage 0.0 (TID 24) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 32.0 in stage 0.0 (TID 32) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 33.0 in stage 0.0 (TID 33) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 2.0 in stage 0.0 (TID 2) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 12.0 in stage 0.0 (TID 12) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 5.0 in stage 0.0 (TID 5) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 36.0 in stage 0.0 (TID 36) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 10.0 in stage 0.0 (TID 10) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 123: Executor task launch worker for task 9.0 in stage 0.0 (TID 9) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 129: Executor task launch worker for task 15.0 in stage 0.0 (TID 15) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 37.0 in stage 0.0 (TID 37) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 20.0 in stage 0.0 (TID 20) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 4.0 in stage 0.0 (TID 4) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 29.0 in stage 0.0 (TID 29) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 17.0 in stage 0.0 (TID 17) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 27.0 in stage 0.0 (TID 27) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 135: Executor task launch worker for task 21.0 in stage 0.0 (TID 21) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 34.0 in stage 0.0 (TID 34) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 3.0 in stage 0.0 (TID 3) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 38.0 in stage 0.0 (TID 38) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 26.0 in stage 0.0 (TID 26) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 19.0 in stage 0.0 (TID 19) 2023-02-10 11:11:36 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 23.0 in stage 0.0 (TID 23) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 145: Executor task launch worker for task 31.0 in stage 0.0 (TID 31) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 142: Executor task launch worker for task 28.0 in stage 0.0 (TID 28) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 127: Executor task launch worker for task 13.0 in stage 0.0 (TID 13) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 144: Executor task launch worker for task 30.0 in stage 0.0 (TID 30) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 140: Executor task launch worker for task 26.0 in stage 0.0 (TID 26) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 119: Executor task launch worker for task 5.0 in stage 0.0 (TID 5) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 116: Executor task launch worker for task 2.0 in stage 0.0 (TID 2) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 143: Executor task launch worker for task 29.0 in stage 0.0 (TID 29) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 131: Executor task launch worker for task 17.0 in stage 0.0 (TID 17) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 130: Executor task launch worker for task 16.0 in stage 0.0 (TID 16) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 120: Executor task launch worker for task 6.0 in stage 0.0 (TID 6) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 153: Executor task launch worker for task 39.0 in stage 0.0 (TID 39) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 149: Executor task launch worker for task 35.0 in stage 0.0 (TID 35) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 125: Executor task launch worker for task 11.0 in stage 0.0 (TID 11) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 133: Executor task launch worker for task 19.0 in stage 0.0 (TID 19) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 129: Executor task launch worker for task 15.0 in stage 0.0 (TID 15) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 132: Executor task launch worker for task 18.0 in stage 0.0 (TID 18) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 137: Executor task launch worker for task 23.0 in stage 0.0 (TID 23) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 124: Executor task launch worker for task 10.0 in stage 0.0 (TID 10) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 115: Executor task launch worker for task 1.0 in stage 0.0 (TID 1) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 136: Executor task launch worker for task 22.0 in stage 0.0 (TID 22) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 117: Executor task launch worker for task 3.0 in stage 0.0 (TID 3) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 118: Executor task launch worker for task 4.0 in stage 0.0 (TID 4) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 147: Executor task launch worker for task 33.0 in stage 0.0 (TID 33) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 114: Executor task launch worker for task 0.0 in stage 0.0 (TID 0) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 121: Executor task launch worker for task 7.0 in stage 0.0 (TID 7) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 134: Executor task launch worker for task 20.0 in stage 0.0 (TID 20) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 150: Executor task launch worker for task 36.0 in stage 0.0 (TID 36) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 146: Executor task launch worker for task 32.0 in stage 0.0 (TID 32) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 151: Executor task launch worker for task 37.0 in stage 0.0 (TID 37) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 122: Executor task launch worker for task 8.0 in stage 0.0 (TID 8) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 148: Executor task launch worker for task 34.0 in stage 0.0 (TID 34) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 138: Executor task launch worker for task 24.0 in stage 0.0 (TID 24) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 126: Executor task launch worker for task 12.0 in stage 0.0 (TID 12) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 152: Executor task launch worker for task 38.0 in stage 0.0 (TID 38) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 139: Executor task launch worker for task 25.0 in stage 0.0 (TID 25) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 141: Executor task launch worker for task 27.0 in stage 0.0 (TID 27) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 128: Executor task launch worker for task 14.0 in stage 0.0 (TID 14) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 123: Executor task launch worker for task 9.0 in stage 0.0 (TID 9) 2023-02-10 11:11:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 135: Executor task launch worker for task 21.0 in stage 0.0 (TID 21) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=21, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=5, cache hits=1 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 135: Executor task launch worker for task 21.0 in stage 0.0 (TID 21) 2023-02-10 11:11:38 Executor: INFO: Finished task 21.0 in stage 0.0 (TID 21). 1461 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 40.0 in stage 0.0 (TID 40) (163.152.180.157, executor driver, partition 40, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 40.0 in stage 0.0 (TID 40) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 21.0 in stage 0.0 (TID 21) in 2566 ms on 163.152.180.157 (executor driver) (1/144) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 135: Executor task launch worker for task 40.0 in stage 0.0 (TID 40) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 135: Executor task launch worker for task 40.0 in stage 0.0 (TID 40) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=30, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 302.0K allocated (300.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 144: Executor task launch worker for task 30.0 in stage 0.0 (TID 30) 2023-02-10 11:11:38 Executor: INFO: Finished task 30.0 in stage 0.0 (TID 30). 1457 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 41.0 in stage 0.0 (TID 41) (163.152.180.157, executor driver, partition 41, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 41.0 in stage 0.0 (TID 41) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 30.0 in stage 0.0 (TID 30) in 2712 ms on 163.152.180.157 (executor driver) (2/144) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=19, attempt=0, peakBytes=306176, peakBytesReadable=299.00 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 299.0K allocated (297.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 133: Executor task launch worker for task 19.0 in stage 0.0 (TID 19) 2023-02-10 11:11:38 Executor: INFO: Finished task 19.0 in stage 0.0 (TID 19). 1576 bytes result sent to driver 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=18, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 132: Executor task launch worker for task 18.0 in stage 0.0 (TID 18) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 42.0 in stage 0.0 (TID 42) (163.152.180.157, executor driver, partition 42, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=36, attempt=0, peakBytes=306688, peakBytesReadable=299.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 Executor: INFO: Finished task 18.0 in stage 0.0 (TID 18). 1758 bytes result sent to driver 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 299.5K allocated (297.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 150: Executor task launch worker for task 36.0 in stage 0.0 (TID 36) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=34, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 302.0K allocated (300.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 148: Executor task launch worker for task 34.0 in stage 0.0 (TID 34) 2023-02-10 11:11:38 Executor: INFO: Running task 42.0 in stage 0.0 (TID 42) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 41.0 in stage 0.0 (TID 41) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 144: Executor task launch worker for task 41.0 in stage 0.0 (TID 41) 2023-02-10 11:11:38 Executor: INFO: Finished task 34.0 in stage 0.0 (TID 34). 1592 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Finished task 36.0 in stage 0.0 (TID 36). 1482 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 43.0 in stage 0.0 (TID 43) (163.152.180.157, executor driver, partition 43, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 19.0 in stage 0.0 (TID 19) in 2739 ms on 163.152.180.157 (executor driver) (3/144) 2023-02-10 11:11:38 Executor: INFO: Running task 43.0 in stage 0.0 (TID 43) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 44.0 in stage 0.0 (TID 44) (163.152.180.157, executor driver, partition 44, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 45.0 in stage 0.0 (TID 45) (163.152.180.157, executor driver, partition 45, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 18.0 in stage 0.0 (TID 18) in 2741 ms on 163.152.180.157 (executor driver) (4/144) 2023-02-10 11:11:38 Executor: INFO: Running task 45.0 in stage 0.0 (TID 45) 2023-02-10 11:11:38 Executor: INFO: Running task 44.0 in stage 0.0 (TID 44) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 36.0 in stage 0.0 (TID 36) in 2739 ms on 163.152.180.157 (executor driver) (5/144) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=26, attempt=0, peakBytes=306176, peakBytesReadable=299.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 299.0K allocated (297.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 140: Executor task launch worker for task 26.0 in stage 0.0 (TID 26) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=16, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:38 Executor: INFO: Finished task 26.0 in stage 0.0 (TID 26). 1614 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 46.0 in stage 0.0 (TID 46) (163.152.180.157, executor driver, partition 46, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 300.8K allocated (297.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 130: Executor task launch worker for task 16.0 in stage 0.0 (TID 16) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=1, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=6, cache hits=2 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 302.5K allocated (300.0K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 115: Executor task launch worker for task 1.0 in stage 0.0 (TID 1) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=29, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 301.3K allocated (299.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 143: Executor task launch worker for task 29.0 in stage 0.0 (TID 29) 2023-02-10 11:11:38 Executor: INFO: Finished task 16.0 in stage 0.0 (TID 16). 1456 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Finished task 1.0 in stage 0.0 (TID 1). 1535 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Finished task 29.0 in stage 0.0 (TID 29). 1560 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Running task 46.0 in stage 0.0 (TID 46) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 34.0 in stage 0.0 (TID 34) in 2762 ms on 163.152.180.157 (executor driver) (6/144) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 26.0 in stage 0.0 (TID 26) in 2764 ms on 163.152.180.157 (executor driver) (7/144) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 1.0 in stage 0.0 (TID 1) in 2771 ms on 163.152.180.157 (executor driver) (8/144) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 47.0 in stage 0.0 (TID 47) (163.152.180.157, executor driver, partition 47, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 48.0 in stage 0.0 (TID 48) (163.152.180.157, executor driver, partition 48, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 48.0 in stage 0.0 (TID 48) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 49.0 in stage 0.0 (TID 49) (163.152.180.157, executor driver, partition 49, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 49.0 in stage 0.0 (TID 49) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 29.0 in stage 0.0 (TID 29) in 2767 ms on 163.152.180.157 (executor driver) (9/144) 2023-02-10 11:11:38 Executor: INFO: Running task 47.0 in stage 0.0 (TID 47) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 16.0 in stage 0.0 (TID 16) in 2770 ms on 163.152.180.157 (executor driver) (10/144) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=27, attempt=0, peakBytes=305664, peakBytesReadable=298.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=31, attempt=0, peakBytes=308992, peakBytesReadable=301.75 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=17, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 298.5K allocated (296.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 141: Executor task launch worker for task 27.0 in stage 0.0 (TID 27) 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 301.8K allocated (299.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 145: Executor task launch worker for task 31.0 in stage 0.0 (TID 31) 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 131: Executor task launch worker for task 17.0 in stage 0.0 (TID 17) 2023-02-10 11:11:38 Executor: INFO: Finished task 17.0 in stage 0.0 (TID 17). 1458 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Finished task 27.0 in stage 0.0 (TID 27). 1477 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Finished task 31.0 in stage 0.0 (TID 31). 1463 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 50.0 in stage 0.0 (TID 50) (163.152.180.157, executor driver, partition 50, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 17.0 in stage 0.0 (TID 17) in 2801 ms on 163.152.180.157 (executor driver) (11/144) 2023-02-10 11:11:38 Executor: INFO: Running task 50.0 in stage 0.0 (TID 50) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 51.0 in stage 0.0 (TID 51) (163.152.180.157, executor driver, partition 51, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 27.0 in stage 0.0 (TID 27) in 2800 ms on 163.152.180.157 (executor driver) (12/144) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 52.0 in stage 0.0 (TID 52) (163.152.180.157, executor driver, partition 52, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 51.0 in stage 0.0 (TID 51) 2023-02-10 11:11:38 Executor: INFO: Running task 52.0 in stage 0.0 (TID 52) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=39, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=3, cache hits=1 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 153: Executor task launch worker for task 39.0 in stage 0.0 (TID 39) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 31.0 in stage 0.0 (TID 31) in 2807 ms on 163.152.180.157 (executor driver) (13/144) 2023-02-10 11:11:38 Executor: INFO: Finished task 39.0 in stage 0.0 (TID 39). 1467 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 53.0 in stage 0.0 (TID 53) (163.152.180.157, executor driver, partition 53, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 39.0 in stage 0.0 (TID 39) in 2809 ms on 163.152.180.157 (executor driver) (14/144) 2023-02-10 11:11:38 Executor: INFO: Running task 53.0 in stage 0.0 (TID 53) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=13, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 127: Executor task launch worker for task 13.0 in stage 0.0 (TID 13) 2023-02-10 11:11:38 Executor: INFO: Finished task 13.0 in stage 0.0 (TID 13). 1510 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 54.0 in stage 0.0 (TID 54) (163.152.180.157, executor driver, partition 54, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 13.0 in stage 0.0 (TID 13) in 2822 ms on 163.152.180.157 (executor driver) (15/144) 2023-02-10 11:11:38 Executor: INFO: Running task 54.0 in stage 0.0 (TID 54) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=24, attempt=0, peakBytes=307200, peakBytesReadable=300.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 300.0K allocated (298.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 138: Executor task launch worker for task 24.0 in stage 0.0 (TID 24) 2023-02-10 11:11:38 Executor: INFO: Finished task 24.0 in stage 0.0 (TID 24). 1453 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 55.0 in stage 0.0 (TID 55) (163.152.180.157, executor driver, partition 55, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 24.0 in stage 0.0 (TID 24) in 2826 ms on 163.152.180.157 (executor driver) (16/144) 2023-02-10 11:11:38 Executor: INFO: Running task 55.0 in stage 0.0 (TID 55) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=12, attempt=0, peakBytes=308992, peakBytesReadable=301.75 KiB, chunks requested=4, cache hits=0 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=20, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 301.8K allocated (298.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 126: Executor task launch worker for task 12.0 in stage 0.0 (TID 12) 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 134: Executor task launch worker for task 20.0 in stage 0.0 (TID 20) 2023-02-10 11:11:38 Executor: INFO: Finished task 20.0 in stage 0.0 (TID 20). 1460 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Finished task 12.0 in stage 0.0 (TID 12). 1494 bytes result sent to driver 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 42.0 in stage 0.0 (TID 42) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 45.0 in stage 0.0 (TID 45) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=38, attempt=0, peakBytes=306688, peakBytesReadable=299.50 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=14, attempt=0, peakBytes=306176, peakBytesReadable=299.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 299.5K allocated (297.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 152: Executor task launch worker for task 38.0 in stage 0.0 (TID 38) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=8, attempt=0, peakBytes=310272, peakBytesReadable=303.00 KiB, chunks requested=8, cache hits=3 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 299.0K allocated (297.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 128: Executor task launch worker for task 14.0 in stage 0.0 (TID 14) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 56.0 in stage 0.0 (TID 56) (163.152.180.157, executor driver, partition 56, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 43.0 in stage 0.0 (TID 43) 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 303.0K allocated (300.0K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 122: Executor task launch worker for task 8.0 in stage 0.0 (TID 8) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 132: Executor task launch worker for task 45.0 in stage 0.0 (TID 45) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 133: Executor task launch worker for task 42.0 in stage 0.0 (TID 42) 2023-02-10 11:11:38 Executor: INFO: Running task 56.0 in stage 0.0 (TID 56) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 44.0 in stage 0.0 (TID 44) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 57.0 in stage 0.0 (TID 57) (163.152.180.157, executor driver, partition 57, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 47.0 in stage 0.0 (TID 47) 2023-02-10 11:11:38 Executor: INFO: Finished task 14.0 in stage 0.0 (TID 14). 1452 bytes result sent to driver 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 148: Executor task launch worker for task 44.0 in stage 0.0 (TID 44) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 150: Executor task launch worker for task 43.0 in stage 0.0 (TID 43) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 12.0 in stage 0.0 (TID 12) in 2852 ms on 163.152.180.157 (executor driver) (17/144) 2023-02-10 11:11:38 Executor: INFO: Running task 57.0 in stage 0.0 (TID 57) 2023-02-10 11:11:38 Executor: INFO: Finished task 8.0 in stage 0.0 (TID 8). 1475 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Finished task 38.0 in stage 0.0 (TID 38). 1469 bytes result sent to driver 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 48.0 in stage 0.0 (TID 48) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 58.0 in stage 0.0 (TID 58) (163.152.180.157, executor driver, partition 58, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 130: Executor task launch worker for task 47.0 in stage 0.0 (TID 47) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 49.0 in stage 0.0 (TID 49) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 20.0 in stage 0.0 (TID 20) in 2855 ms on 163.152.180.157 (executor driver) (18/144) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 14.0 in stage 0.0 (TID 14) in 2857 ms on 163.152.180.157 (executor driver) (19/144) 2023-02-10 11:11:38 Executor: INFO: Running task 58.0 in stage 0.0 (TID 58) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=22, attempt=0, peakBytes=305920, peakBytesReadable=298.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 298.8K allocated (296.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 136: Executor task launch worker for task 22.0 in stage 0.0 (TID 22) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 140: Executor task launch worker for task 49.0 in stage 0.0 (TID 49) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 59.0 in stage 0.0 (TID 59) (163.152.180.157, executor driver, partition 59, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Finished task 22.0 in stage 0.0 (TID 22). 1506 bytes result sent to driver 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 143: Executor task launch worker for task 48.0 in stage 0.0 (TID 48) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 46.0 in stage 0.0 (TID 46) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 8.0 in stage 0.0 (TID 8) in 2861 ms on 163.152.180.157 (executor driver) (20/144) 2023-02-10 11:11:38 Executor: INFO: Running task 59.0 in stage 0.0 (TID 59) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 38.0 in stage 0.0 (TID 38) in 2855 ms on 163.152.180.157 (executor driver) (21/144) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 115: Executor task launch worker for task 46.0 in stage 0.0 (TID 46) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 52.0 in stage 0.0 (TID 52) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 50.0 in stage 0.0 (TID 50) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 145: Executor task launch worker for task 50.0 in stage 0.0 (TID 50) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 53.0 in stage 0.0 (TID 53) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 51.0 in stage 0.0 (TID 51) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=0, attempt=0, peakBytes=377088, peakBytesReadable=368.25 KiB, chunks requested=18, cache hits=5 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 368.3K allocated (363.8K blocks / 4.5K chunks), regions.size = 9, 0 current java objects, thread 114: Executor task launch worker for task 0.0 in stage 0.0 (TID 0) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 131: Executor task launch worker for task 52.0 in stage 0.0 (TID 52) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 141: Executor task launch worker for task 51.0 in stage 0.0 (TID 51) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 60.0 in stage 0.0 (TID 60) (163.152.180.157, executor driver, partition 60, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 153: Executor task launch worker for task 53.0 in stage 0.0 (TID 53) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 54.0 in stage 0.0 (TID 54) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 138: Executor task launch worker for task 55.0 in stage 0.0 (TID 55) 2023-02-10 11:11:38 Executor: INFO: Running task 60.0 in stage 0.0 (TID 60) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 127: Executor task launch worker for task 54.0 in stage 0.0 (TID 54) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 56.0 in stage 0.0 (TID 56) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 61.0 in stage 0.0 (TID 61) (163.152.180.157, executor driver, partition 61, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 22.0 in stage 0.0 (TID 22) in 2872 ms on 163.152.180.157 (executor driver) (22/144) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 138: Executor task launch worker for task 55.0 in stage 0.0 (TID 55) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 134: Executor task launch worker for task 56.0 in stage 0.0 (TID 56) 2023-02-10 11:11:38 Executor: INFO: Running task 61.0 in stage 0.0 (TID 61) 2023-02-10 11:11:38 Executor: INFO: Finished task 0.0 in stage 0.0 (TID 0). 1536 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 62.0 in stage 0.0 (TID 62) (163.152.180.157, executor driver, partition 62, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 62.0 in stage 0.0 (TID 62) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 0.0 in stage 0.0 (TID 0) in 2897 ms on 163.152.180.157 (executor driver) (23/144) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 59.0 in stage 0.0 (TID 59) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 58.0 in stage 0.0 (TID 58) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 136: Executor task launch worker for task 59.0 in stage 0.0 (TID 59) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 152: Executor task launch worker for task 58.0 in stage 0.0 (TID 58) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 57.0 in stage 0.0 (TID 57) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 128: Executor task launch worker for task 57.0 in stage 0.0 (TID 57) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=32, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=7, cache hits=1 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 60.0 in stage 0.0 (TID 60) 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 301.3K allocated (298.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 146: Executor task launch worker for task 32.0 in stage 0.0 (TID 32) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=23, attempt=0, peakBytes=305920, peakBytesReadable=298.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 298.8K allocated (296.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 137: Executor task launch worker for task 23.0 in stage 0.0 (TID 23) 2023-02-10 11:11:38 Executor: INFO: Finished task 32.0 in stage 0.0 (TID 32). 1472 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Finished task 23.0 in stage 0.0 (TID 23). 1475 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 63.0 in stage 0.0 (TID 63) (163.152.180.157, executor driver, partition 63, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 63.0 in stage 0.0 (TID 63) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 61.0 in stage 0.0 (TID 61) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 64.0 in stage 0.0 (TID 64) (163.152.180.157, executor driver, partition 64, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 122: Executor task launch worker for task 60.0 in stage 0.0 (TID 60) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 23.0 in stage 0.0 (TID 23) in 2888 ms on 163.152.180.157 (executor driver) (24/144) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 32.0 in stage 0.0 (TID 32) in 2886 ms on 163.152.180.157 (executor driver) (25/144) 2023-02-10 11:11:38 Executor: INFO: Running task 64.0 in stage 0.0 (TID 64) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 126: Executor task launch worker for task 61.0 in stage 0.0 (TID 61) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=2, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=5, cache hits=1 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 116: Executor task launch worker for task 2.0 in stage 0.0 (TID 2) 2023-02-10 11:11:38 Executor: INFO: Finished task 2.0 in stage 0.0 (TID 2). 1506 bytes result sent to driver 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=6, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 120: Executor task launch worker for task 6.0 in stage 0.0 (TID 6) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 65.0 in stage 0.0 (TID 65) (163.152.180.157, executor driver, partition 65, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 2.0 in stage 0.0 (TID 2) in 2894 ms on 163.152.180.157 (executor driver) (26/144) 2023-02-10 11:11:38 Executor: INFO: Finished task 6.0 in stage 0.0 (TID 6). 1478 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 66.0 in stage 0.0 (TID 66) (163.152.180.157, executor driver, partition 66, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 6.0 in stage 0.0 (TID 6) in 2895 ms on 163.152.180.157 (executor driver) (27/144) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 62.0 in stage 0.0 (TID 62) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 63.0 in stage 0.0 (TID 63) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 64.0 in stage 0.0 (TID 64) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 137: Executor task launch worker for task 63.0 in stage 0.0 (TID 63) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 146: Executor task launch worker for task 64.0 in stage 0.0 (TID 64) 2023-02-10 11:11:38 Executor: INFO: Running task 66.0 in stage 0.0 (TID 66) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 114: Executor task launch worker for task 62.0 in stage 0.0 (TID 62) 2023-02-10 11:11:38 Executor: INFO: Running task 65.0 in stage 0.0 (TID 65) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=37, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 302.5K allocated (300.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 151: Executor task launch worker for task 37.0 in stage 0.0 (TID 37) 2023-02-10 11:11:38 Executor: INFO: Finished task 37.0 in stage 0.0 (TID 37). 1464 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 67.0 in stage 0.0 (TID 67) (163.152.180.157, executor driver, partition 67, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 37.0 in stage 0.0 (TID 37) in 2904 ms on 163.152.180.157 (executor driver) (28/144) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=35, attempt=0, peakBytes=308224, peakBytesReadable=301.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 301.0K allocated (299.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 149: Executor task launch worker for task 35.0 in stage 0.0 (TID 35) 2023-02-10 11:11:38 Executor: INFO: Finished task 35.0 in stage 0.0 (TID 35). 1483 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Running task 67.0 in stage 0.0 (TID 67) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 68.0 in stage 0.0 (TID 68) (163.152.180.157, executor driver, partition 68, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=33, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=6, cache hits=2 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 302.5K allocated (300.0K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 147: Executor task launch worker for task 33.0 in stage 0.0 (TID 33) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 35.0 in stage 0.0 (TID 35) in 2911 ms on 163.152.180.157 (executor driver) (29/144) 2023-02-10 11:11:38 Executor: INFO: Finished task 33.0 in stage 0.0 (TID 33). 1458 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Running task 68.0 in stage 0.0 (TID 68) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 69.0 in stage 0.0 (TID 69) (163.152.180.157, executor driver, partition 69, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 33.0 in stage 0.0 (TID 33) in 2913 ms on 163.152.180.157 (executor driver) (30/144) 2023-02-10 11:11:38 Executor: INFO: Running task 69.0 in stage 0.0 (TID 69) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 66.0 in stage 0.0 (TID 66) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 158: Executor task launch worker for task 65.0 in stage 0.0 (TID 65) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=9, attempt=0, peakBytes=307456, peakBytesReadable=300.25 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 300.3K allocated (297.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 123: Executor task launch worker for task 9.0 in stage 0.0 (TID 9) 2023-02-10 11:11:38 Executor: INFO: Finished task 9.0 in stage 0.0 (TID 9). 1515 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 70.0 in stage 0.0 (TID 70) (163.152.180.157, executor driver, partition 70, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 9.0 in stage 0.0 (TID 9) in 2930 ms on 163.152.180.157 (executor driver) (31/144) 2023-02-10 11:11:38 Executor: INFO: Running task 70.0 in stage 0.0 (TID 70) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=7, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 300.8K allocated (298.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 121: Executor task launch worker for task 7.0 in stage 0.0 (TID 7) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=25, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 301.5K allocated (298.5K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 139: Executor task launch worker for task 25.0 in stage 0.0 (TID 25) 2023-02-10 11:11:38 Executor: INFO: Finished task 7.0 in stage 0.0 (TID 7). 1481 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Finished task 25.0 in stage 0.0 (TID 25). 1453 bytes result sent to driver 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 69.0 in stage 0.0 (TID 69) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 147: Executor task launch worker for task 69.0 in stage 0.0 (TID 69) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 67.0 in stage 0.0 (TID 67) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=3, attempt=0, peakBytes=307200, peakBytesReadable=300.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 300.0K allocated (298.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 117: Executor task launch worker for task 3.0 in stage 0.0 (TID 3) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=10, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=11, cache hits=3 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 302.0K allocated (299.0K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 124: Executor task launch worker for task 10.0 in stage 0.0 (TID 10) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 151: Executor task launch worker for task 67.0 in stage 0.0 (TID 67) 2023-02-10 11:11:38 Executor: INFO: Finished task 3.0 in stage 0.0 (TID 3). 1452 bytes result sent to driver 2023-02-10 11:11:38 Executor: INFO: Finished task 10.0 in stage 0.0 (TID 10). 1573 bytes result sent to driver 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 149: Executor task launch worker for task 68.0 in stage 0.0 (TID 68) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 149: Executor task launch worker for task 68.0 in stage 0.0 (TID 68) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 120: Executor task launch worker for task 66.0 in stage 0.0 (TID 66) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 70.0 in stage 0.0 (TID 70) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 116: Executor task launch worker for task 70.0 in stage 0.0 (TID 70) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=4, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 118: Executor task launch worker for task 4.0 in stage 0.0 (TID 4) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 158: Executor task launch worker for task 65.0 in stage 0.0 (TID 65) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=11, attempt=0, peakBytes=310528, peakBytesReadable=303.25 KiB, chunks requested=9, cache hits=2 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 303.3K allocated (300.3K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 125: Executor task launch worker for task 11.0 in stage 0.0 (TID 11) 2023-02-10 11:11:38 Executor: INFO: Finished task 11.0 in stage 0.0 (TID 11). 1464 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 71.0 in stage 0.0 (TID 71) (163.152.180.157, executor driver, partition 71, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 71.0 in stage 0.0 (TID 71) 2023-02-10 11:11:38 Executor: INFO: Finished task 4.0 in stage 0.0 (TID 4). 1474 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 7.0 in stage 0.0 (TID 7) in 2974 ms on 163.152.180.157 (executor driver) (32/144) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 25.0 in stage 0.0 (TID 25) in 2971 ms on 163.152.180.157 (executor driver) (33/144) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 72.0 in stage 0.0 (TID 72) (163.152.180.157, executor driver, partition 72, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 72.0 in stage 0.0 (TID 72) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 73.0 in stage 0.0 (TID 73) (163.152.180.157, executor driver, partition 73, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 73.0 in stage 0.0 (TID 73) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 74.0 in stage 0.0 (TID 74) (163.152.180.157, executor driver, partition 74, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 74.0 in stage 0.0 (TID 74) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 75.0 in stage 0.0 (TID 75) (163.152.180.157, executor driver, partition 75, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 75.0 in stage 0.0 (TID 75) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 76.0 in stage 0.0 (TID 76) (163.152.180.157, executor driver, partition 76, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 Executor: INFO: Running task 76.0 in stage 0.0 (TID 76) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 3.0 in stage 0.0 (TID 3) in 2980 ms on 163.152.180.157 (executor driver) (34/144) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 11.0 in stage 0.0 (TID 11) in 2978 ms on 163.152.180.157 (executor driver) (35/144) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 4.0 in stage 0.0 (TID 4) in 2980 ms on 163.152.180.157 (executor driver) (36/144) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 125: Executor task launch worker for task 71.0 in stage 0.0 (TID 71) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 125: Executor task launch worker for task 71.0 in stage 0.0 (TID 71) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 10.0 in stage 0.0 (TID 10) in 2987 ms on 163.152.180.157 (executor driver) (37/144) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=5, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 119: Executor task launch worker for task 5.0 in stage 0.0 (TID 5) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 73.0 in stage 0.0 (TID 73) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 72.0 in stage 0.0 (TID 72) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 74.0 in stage 0.0 (TID 74) 2023-02-10 11:11:38 Executor: INFO: Finished task 5.0 in stage 0.0 (TID 5). 1453 bytes result sent to driver 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 124: Executor task launch worker for task 73.0 in stage 0.0 (TID 73) 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 77.0 in stage 0.0 (TID 77) (163.152.180.157, executor driver, partition 77, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 118: Executor task launch worker for task 72.0 in stage 0.0 (TID 72) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 75.0 in stage 0.0 (TID 75) 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 5.0 in stage 0.0 (TID 5) in 2996 ms on 163.152.180.157 (executor driver) (38/144) 2023-02-10 11:11:38 Executor: INFO: Running task 77.0 in stage 0.0 (TID 77) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 139: Executor task launch worker for task 75.0 in stage 0.0 (TID 75) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 117: Executor task launch worker for task 74.0 in stage 0.0 (TID 74) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 121: Executor task launch worker for task 76.0 in stage 0.0 (TID 76) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 121: Executor task launch worker for task 76.0 in stage 0.0 (TID 76) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 123: Executor task launch worker for task 77.0 in stage 0.0 (TID 77) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 123: Executor task launch worker for task 77.0 in stage 0.0 (TID 77) 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=15, attempt=0, peakBytes=310784, peakBytesReadable=303.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 303.5K allocated (301.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 129: Executor task launch worker for task 15.0 in stage 0.0 (TID 15) 2023-02-10 11:11:38 Executor: INFO: Finished task 15.0 in stage 0.0 (TID 15). 1459 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 78.0 in stage 0.0 (TID 78) (163.152.180.157, executor driver, partition 78, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 root: INFO: TaskReport: stage=0, partition=28, attempt=0, peakBytes=305664, peakBytesReadable=298.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 15.0 in stage 0.0 (TID 15) in 3139 ms on 163.152.180.157 (executor driver) (39/144) 2023-02-10 11:11:38 root: INFO: RegionPool: FREE: 298.5K allocated (296.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 142: Executor task launch worker for task 28.0 in stage 0.0 (TID 28) 2023-02-10 11:11:38 Executor: INFO: Running task 78.0 in stage 0.0 (TID 78) 2023-02-10 11:11:38 Executor: INFO: Finished task 28.0 in stage 0.0 (TID 28). 1472 bytes result sent to driver 2023-02-10 11:11:38 TaskSetManager: INFO: Starting task 79.0 in stage 0.0 (TID 79) (163.152.180.157, executor driver, partition 79, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:38 TaskSetManager: INFO: Finished task 28.0 in stage 0.0 (TID 28) in 3142 ms on 163.152.180.157 (executor driver) (40/144) 2023-02-10 11:11:38 Executor: INFO: Running task 79.0 in stage 0.0 (TID 79) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 78.0 in stage 0.0 (TID 78) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 119: Executor task launch worker for task 78.0 in stage 0.0 (TID 78) 2023-02-10 11:11:38 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 79.0 in stage 0.0 (TID 79) 2023-02-10 11:11:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 142: Executor task launch worker for task 79.0 in stage 0.0 (TID 79) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=40, attempt=0, peakBytes=307456, peakBytesReadable=300.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.3K allocated (298.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 135: Executor task launch worker for task 40.0 in stage 0.0 (TID 40) 2023-02-10 11:11:39 Executor: INFO: Finished task 40.0 in stage 0.0 (TID 40). 1566 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 80.0 in stage 0.0 (TID 80) (163.152.180.157, executor driver, partition 80, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 40.0 in stage 0.0 (TID 40) in 1290 ms on 163.152.180.157 (executor driver) (41/144) 2023-02-10 11:11:39 Executor: INFO: Running task 80.0 in stage 0.0 (TID 80) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=56, attempt=0, peakBytes=309504, peakBytesReadable=302.25 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 302.3K allocated (299.3K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 134: Executor task launch worker for task 56.0 in stage 0.0 (TID 56) 2023-02-10 11:11:39 Executor: INFO: Finished task 56.0 in stage 0.0 (TID 56). 1506 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 81.0 in stage 0.0 (TID 81) (163.152.180.157, executor driver, partition 81, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 56.0 in stage 0.0 (TID 56) in 1017 ms on 163.152.180.157 (executor driver) (42/144) 2023-02-10 11:11:39 Executor: INFO: Running task 81.0 in stage 0.0 (TID 81) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=41, attempt=0, peakBytes=306176, peakBytesReadable=299.00 KiB, chunks requested=3, cache hits=1 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 299.0K allocated (296.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 144: Executor task launch worker for task 41.0 in stage 0.0 (TID 41) 2023-02-10 11:11:39 Executor: INFO: Finished task 41.0 in stage 0.0 (TID 41). 1475 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 82.0 in stage 0.0 (TID 82) (163.152.180.157, executor driver, partition 82, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 41.0 in stage 0.0 (TID 41) in 1160 ms on 163.152.180.157 (executor driver) (43/144) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 135: Executor task launch worker for task 80.0 in stage 0.0 (TID 80) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 135: Executor task launch worker for task 80.0 in stage 0.0 (TID 80) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 81.0 in stage 0.0 (TID 81) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 134: Executor task launch worker for task 81.0 in stage 0.0 (TID 81) 2023-02-10 11:11:39 Executor: INFO: Running task 82.0 in stage 0.0 (TID 82) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=53, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 153: Executor task launch worker for task 53.0 in stage 0.0 (TID 53) 2023-02-10 11:11:39 Executor: INFO: Finished task 53.0 in stage 0.0 (TID 53). 1458 bytes result sent to driver 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=49, attempt=0, peakBytes=307200, peakBytesReadable=300.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.0K allocated (298.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 140: Executor task launch worker for task 49.0 in stage 0.0 (TID 49) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 83.0 in stage 0.0 (TID 83) (163.152.180.157, executor driver, partition 83, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 53.0 in stage 0.0 (TID 53) in 1077 ms on 163.152.180.157 (executor driver) (44/144) 2023-02-10 11:11:39 Executor: INFO: Finished task 49.0 in stage 0.0 (TID 49). 1544 bytes result sent to driver 2023-02-10 11:11:39 Executor: INFO: Running task 83.0 in stage 0.0 (TID 83) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 49.0 in stage 0.0 (TID 49) in 1121 ms on 163.152.180.157 (executor driver) (45/144) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 84.0 in stage 0.0 (TID 84) (163.152.180.157, executor driver, partition 84, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 82.0 in stage 0.0 (TID 82) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=48, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 143: Executor task launch worker for task 48.0 in stage 0.0 (TID 48) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 144: Executor task launch worker for task 82.0 in stage 0.0 (TID 82) 2023-02-10 11:11:39 Executor: INFO: Finished task 48.0 in stage 0.0 (TID 48). 1483 bytes result sent to driver 2023-02-10 11:11:39 Executor: INFO: Running task 84.0 in stage 0.0 (TID 84) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 85.0 in stage 0.0 (TID 85) (163.152.180.157, executor driver, partition 85, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 48.0 in stage 0.0 (TID 48) in 1129 ms on 163.152.180.157 (executor driver) (46/144) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=46, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=4, cache hits=1 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 115: Executor task launch worker for task 46.0 in stage 0.0 (TID 46) 2023-02-10 11:11:39 Executor: INFO: Finished task 46.0 in stage 0.0 (TID 46). 1716 bytes result sent to driver 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=43, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 150: Executor task launch worker for task 43.0 in stage 0.0 (TID 43) 2023-02-10 11:11:39 Executor: INFO: Running task 85.0 in stage 0.0 (TID 85) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 83.0 in stage 0.0 (TID 83) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 153: Executor task launch worker for task 83.0 in stage 0.0 (TID 83) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=44, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=69, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 84.0 in stage 0.0 (TID 84) 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 148: Executor task launch worker for task 44.0 in stage 0.0 (TID 44) 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 147: Executor task launch worker for task 69.0 in stage 0.0 (TID 69) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=62, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 114: Executor task launch worker for task 62.0 in stage 0.0 (TID 62) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=47, attempt=0, peakBytes=306432, peakBytesReadable=299.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 299.3K allocated (297.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 130: Executor task launch worker for task 47.0 in stage 0.0 (TID 47) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 140: Executor task launch worker for task 84.0 in stage 0.0 (TID 84) 2023-02-10 11:11:39 Executor: INFO: Finished task 69.0 in stage 0.0 (TID 69). 1493 bytes result sent to driver 2023-02-10 11:11:39 Executor: INFO: Finished task 44.0 in stage 0.0 (TID 44). 1537 bytes result sent to driver 2023-02-10 11:11:39 Executor: INFO: Finished task 62.0 in stage 0.0 (TID 62). 1609 bytes result sent to driver 2023-02-10 11:11:39 Executor: INFO: Finished task 43.0 in stage 0.0 (TID 43). 1557 bytes result sent to driver 2023-02-10 11:11:39 Executor: INFO: Finished task 47.0 in stage 0.0 (TID 47). 1486 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 86.0 in stage 0.0 (TID 86) (163.152.180.157, executor driver, partition 86, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 Executor: INFO: Running task 86.0 in stage 0.0 (TID 86) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 87.0 in stage 0.0 (TID 87) (163.152.180.157, executor driver, partition 87, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 88.0 in stage 0.0 (TID 88) (163.152.180.157, executor driver, partition 88, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 89.0 in stage 0.0 (TID 89) (163.152.180.157, executor driver, partition 89, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 46.0 in stage 0.0 (TID 46) in 1160 ms on 163.152.180.157 (executor driver) (47/144) 2023-02-10 11:11:39 Executor: INFO: Running task 88.0 in stage 0.0 (TID 88) 2023-02-10 11:11:39 Executor: INFO: Running task 89.0 in stage 0.0 (TID 89) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 43.0 in stage 0.0 (TID 43) in 1175 ms on 163.152.180.157 (executor driver) (48/144) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 44.0 in stage 0.0 (TID 44) in 1174 ms on 163.152.180.157 (executor driver) (49/144) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 69.0 in stage 0.0 (TID 69) in 1000 ms on 163.152.180.157 (executor driver) (50/144) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=63, attempt=0, peakBytes=308224, peakBytesReadable=301.00 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 301.0K allocated (298.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 137: Executor task launch worker for task 63.0 in stage 0.0 (TID 63) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 90.0 in stage 0.0 (TID 90) (163.152.180.157, executor driver, partition 90, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 Executor: INFO: Finished task 63.0 in stage 0.0 (TID 63). 1473 bytes result sent to driver 2023-02-10 11:11:39 Executor: INFO: Running task 90.0 in stage 0.0 (TID 90) 2023-02-10 11:11:39 Executor: INFO: Running task 87.0 in stage 0.0 (TID 87) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 91.0 in stage 0.0 (TID 91) (163.152.180.157, executor driver, partition 91, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 92.0 in stage 0.0 (TID 92) (163.152.180.157, executor driver, partition 92, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 Executor: INFO: Running task 92.0 in stage 0.0 (TID 92) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 62.0 in stage 0.0 (TID 62) in 1044 ms on 163.152.180.157 (executor driver) (51/144) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 85.0 in stage 0.0 (TID 85) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 47.0 in stage 0.0 (TID 47) in 1151 ms on 163.152.180.157 (executor driver) (52/144) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=57, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 63.0 in stage 0.0 (TID 63) in 1031 ms on 163.152.180.157 (executor driver) (53/144) 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 302.0K allocated (300.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 128: Executor task launch worker for task 57.0 in stage 0.0 (TID 57) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=60, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 122: Executor task launch worker for task 60.0 in stage 0.0 (TID 60) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 143: Executor task launch worker for task 85.0 in stage 0.0 (TID 85) 2023-02-10 11:11:39 Executor: INFO: Finished task 60.0 in stage 0.0 (TID 60). 1472 bytes result sent to driver 2023-02-10 11:11:39 Executor: INFO: Finished task 57.0 in stage 0.0 (TID 57). 1487 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 93.0 in stage 0.0 (TID 93) (163.152.180.157, executor driver, partition 93, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=64, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=45, attempt=0, peakBytes=305920, peakBytesReadable=298.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=65, attempt=0, peakBytes=310016, peakBytesReadable=302.75 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 146: Executor task launch worker for task 64.0 in stage 0.0 (TID 64) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 60.0 in stage 0.0 (TID 60) in 1051 ms on 163.152.180.157 (executor driver) (54/144) 2023-02-10 11:11:39 Executor: INFO: Running task 93.0 in stage 0.0 (TID 93) 2023-02-10 11:11:39 Executor: INFO: Finished task 64.0 in stage 0.0 (TID 64). 1503 bytes result sent to driver 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 298.8K allocated (296.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 132: Executor task launch worker for task 45.0 in stage 0.0 (TID 45) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 94.0 in stage 0.0 (TID 94) (163.152.180.157, executor driver, partition 94, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 Executor: INFO: Running task 91.0 in stage 0.0 (TID 91) 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 302.8K allocated (298.8K blocks / 4.0K chunks), regions.size = 9, 0 current java objects, thread 158: Executor task launch worker for task 65.0 in stage 0.0 (TID 65) 2023-02-10 11:11:39 Executor: INFO: Finished task 45.0 in stage 0.0 (TID 45). 1536 bytes result sent to driver 2023-02-10 11:11:39 Executor: INFO: Running task 94.0 in stage 0.0 (TID 94) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 95.0 in stage 0.0 (TID 95) (163.152.180.157, executor driver, partition 95, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 Executor: INFO: Finished task 65.0 in stage 0.0 (TID 65). 1522 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 96.0 in stage 0.0 (TID 96) (163.152.180.157, executor driver, partition 96, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 97.0 in stage 0.0 (TID 97) (163.152.180.157, executor driver, partition 97, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 57.0 in stage 0.0 (TID 57) in 1076 ms on 163.152.180.157 (executor driver) (55/144) 2023-02-10 11:11:39 Executor: INFO: Running task 96.0 in stage 0.0 (TID 96) 2023-02-10 11:11:39 Executor: INFO: Running task 95.0 in stage 0.0 (TID 95) 2023-02-10 11:11:39 Executor: INFO: Running task 97.0 in stage 0.0 (TID 97) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 65.0 in stage 0.0 (TID 65) in 1032 ms on 163.152.180.157 (executor driver) (56/144) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=52, attempt=0, peakBytes=307200, peakBytesReadable=300.00 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 45.0 in stage 0.0 (TID 45) in 1183 ms on 163.152.180.157 (executor driver) (57/144) 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.0K allocated (297.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 131: Executor task launch worker for task 52.0 in stage 0.0 (TID 52) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 64.0 in stage 0.0 (TID 64) in 1036 ms on 163.152.180.157 (executor driver) (58/144) 2023-02-10 11:11:39 Executor: INFO: Finished task 52.0 in stage 0.0 (TID 52). 1527 bytes result sent to driver 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 86.0 in stage 0.0 (TID 86) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 98.0 in stage 0.0 (TID 98) (163.152.180.157, executor driver, partition 98, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 Executor: INFO: Running task 98.0 in stage 0.0 (TID 98) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 130: Executor task launch worker for task 86.0 in stage 0.0 (TID 86) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 88.0 in stage 0.0 (TID 88) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 89.0 in stage 0.0 (TID 89) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 114: Executor task launch worker for task 88.0 in stage 0.0 (TID 88) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 148: Executor task launch worker for task 89.0 in stage 0.0 (TID 89) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=66, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 87.0 in stage 0.0 (TID 87) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 52.0 in stage 0.0 (TID 52) in 1124 ms on 163.152.180.157 (executor driver) (59/144) 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 120: Executor task launch worker for task 66.0 in stage 0.0 (TID 66) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 129: Executor task launch worker for task 93.0 in stage 0.0 (TID 93) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 94.0 in stage 0.0 (TID 94) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=42, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 158: Executor task launch worker for task 96.0 in stage 0.0 (TID 96) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 150: Executor task launch worker for task 87.0 in stage 0.0 (TID 87) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 92.0 in stage 0.0 (TID 92) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 90.0 in stage 0.0 (TID 90) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 129: Executor task launch worker for task 93.0 in stage 0.0 (TID 93) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 97.0 in stage 0.0 (TID 97) 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 133: Executor task launch worker for task 42.0 in stage 0.0 (TID 42) 2023-02-10 11:11:39 Executor: INFO: Finished task 66.0 in stage 0.0 (TID 66). 1482 bytes result sent to driver 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 146: Executor task launch worker for task 94.0 in stage 0.0 (TID 94) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 158: Executor task launch worker for task 96.0 in stage 0.0 (TID 96) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 91.0 in stage 0.0 (TID 91) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 147: Executor task launch worker for task 90.0 in stage 0.0 (TID 90) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 128: Executor task launch worker for task 97.0 in stage 0.0 (TID 97) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 115: Executor task launch worker for task 92.0 in stage 0.0 (TID 92) 2023-02-10 11:11:39 Executor: INFO: Finished task 42.0 in stage 0.0 (TID 42). 1461 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 99.0 in stage 0.0 (TID 99) (163.152.180.157, executor driver, partition 99, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 137: Executor task launch worker for task 91.0 in stage 0.0 (TID 91) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 66.0 in stage 0.0 (TID 66) in 1046 ms on 163.152.180.157 (executor driver) (60/144) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 100.0 in stage 0.0 (TID 100) (163.152.180.157, executor driver, partition 100, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 Executor: INFO: Running task 99.0 in stage 0.0 (TID 99) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=73, attempt=0, peakBytes=306432, peakBytesReadable=299.25 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 42.0 in stage 0.0 (TID 42) in 1219 ms on 163.152.180.157 (executor driver) (61/144) 2023-02-10 11:11:39 Executor: INFO: Running task 100.0 in stage 0.0 (TID 100) 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 299.3K allocated (296.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 124: Executor task launch worker for task 73.0 in stage 0.0 (TID 73) 2023-02-10 11:11:39 Executor: INFO: Finished task 73.0 in stage 0.0 (TID 73). 1471 bytes result sent to driver 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 98.0 in stage 0.0 (TID 98) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 101.0 in stage 0.0 (TID 101) (163.152.180.157, executor driver, partition 101, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 131: Executor task launch worker for task 98.0 in stage 0.0 (TID 98) 2023-02-10 11:11:39 Executor: INFO: Running task 101.0 in stage 0.0 (TID 101) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 73.0 in stage 0.0 (TID 73) in 967 ms on 163.152.180.157 (executor driver) (62/144) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=54, attempt=0, peakBytes=306688, peakBytesReadable=299.50 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 299.5K allocated (297.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 127: Executor task launch worker for task 54.0 in stage 0.0 (TID 54) 2023-02-10 11:11:39 Executor: INFO: Finished task 54.0 in stage 0.0 (TID 54). 1453 bytes result sent to driver 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 95.0 in stage 0.0 (TID 95) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 102.0 in stage 0.0 (TID 102) (163.152.180.157, executor driver, partition 102, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=71, attempt=0, peakBytes=306176, peakBytesReadable=299.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 299.0K allocated (297.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 125: Executor task launch worker for task 71.0 in stage 0.0 (TID 71) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 54.0 in stage 0.0 (TID 54) in 1125 ms on 163.152.180.157 (executor driver) (63/144) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=74, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.8K allocated (297.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 117: Executor task launch worker for task 74.0 in stage 0.0 (TID 74) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 132: Executor task launch worker for task 95.0 in stage 0.0 (TID 95) 2023-02-10 11:11:39 Executor: INFO: Running task 102.0 in stage 0.0 (TID 102) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=50, attempt=0, peakBytes=308992, peakBytesReadable=301.75 KiB, chunks requested=4, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 301.8K allocated (298.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 145: Executor task launch worker for task 50.0 in stage 0.0 (TID 50) 2023-02-10 11:11:39 Executor: INFO: Finished task 50.0 in stage 0.0 (TID 50). 1461 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 103.0 in stage 0.0 (TID 103) (163.152.180.157, executor driver, partition 103, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 50.0 in stage 0.0 (TID 50) in 1152 ms on 163.152.180.157 (executor driver) (64/144) 2023-02-10 11:11:39 Executor: INFO: Running task 103.0 in stage 0.0 (TID 103) 2023-02-10 11:11:39 Executor: INFO: Finished task 74.0 in stage 0.0 (TID 74). 1477 bytes result sent to driver 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 100.0 in stage 0.0 (TID 100) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 104.0 in stage 0.0 (TID 104) (163.152.180.157, executor driver, partition 104, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 99.0 in stage 0.0 (TID 99) 2023-02-10 11:11:39 Executor: INFO: Running task 104.0 in stage 0.0 (TID 104) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 133: Executor task launch worker for task 99.0 in stage 0.0 (TID 99) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 101.0 in stage 0.0 (TID 101) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 122: Executor task launch worker for task 101.0 in stage 0.0 (TID 101) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=70, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 116: Executor task launch worker for task 70.0 in stage 0.0 (TID 70) 2023-02-10 11:11:39 Executor: INFO: Finished task 70.0 in stage 0.0 (TID 70). 1557 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 105.0 in stage 0.0 (TID 105) (163.152.180.157, executor driver, partition 105, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 70.0 in stage 0.0 (TID 70) in 1033 ms on 163.152.180.157 (executor driver) (65/144) 2023-02-10 11:11:39 Executor: INFO: Running task 105.0 in stage 0.0 (TID 105) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 102.0 in stage 0.0 (TID 102) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=77, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 301.3K allocated (299.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 123: Executor task launch worker for task 77.0 in stage 0.0 (TID 77) 2023-02-10 11:11:39 Executor: INFO: Finished task 71.0 in stage 0.0 (TID 71). 1525 bytes result sent to driver 2023-02-10 11:11:39 Executor: INFO: Finished task 77.0 in stage 0.0 (TID 77). 1545 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 106.0 in stage 0.0 (TID 106) (163.152.180.157, executor driver, partition 106, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 120: Executor task launch worker for task 100.0 in stage 0.0 (TID 100) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 107.0 in stage 0.0 (TID 107) (163.152.180.157, executor driver, partition 107, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 127: Executor task launch worker for task 102.0 in stage 0.0 (TID 102) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 74.0 in stage 0.0 (TID 74) in 990 ms on 163.152.180.157 (executor driver) (66/144) 2023-02-10 11:11:39 Executor: INFO: Running task 107.0 in stage 0.0 (TID 107) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 77.0 in stage 0.0 (TID 77) in 973 ms on 163.152.180.157 (executor driver) (67/144) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 103.0 in stage 0.0 (TID 103) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 124: Executor task launch worker for task 103.0 in stage 0.0 (TID 103) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 104.0 in stage 0.0 (TID 104) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=76, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 121: Executor task launch worker for task 76.0 in stage 0.0 (TID 76) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 117: Executor task launch worker for task 104.0 in stage 0.0 (TID 104) 2023-02-10 11:11:39 Executor: INFO: Finished task 76.0 in stage 0.0 (TID 76). 1463 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 108.0 in stage 0.0 (TID 108) (163.152.180.157, executor driver, partition 108, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=67, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=9, cache hits=4 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 301.5K allocated (299.0K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 151: Executor task launch worker for task 67.0 in stage 0.0 (TID 67) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 76.0 in stage 0.0 (TID 76) in 992 ms on 163.152.180.157 (executor driver) (68/144) 2023-02-10 11:11:39 Executor: INFO: Running task 106.0 in stage 0.0 (TID 106) 2023-02-10 11:11:39 Executor: INFO: Running task 108.0 in stage 0.0 (TID 108) 2023-02-10 11:11:39 Executor: INFO: Finished task 67.0 in stage 0.0 (TID 67). 1474 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 71.0 in stage 0.0 (TID 71) in 1018 ms on 163.152.180.157 (executor driver) (69/144) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 105.0 in stage 0.0 (TID 105) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=75, attempt=0, peakBytes=305920, peakBytesReadable=298.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 298.8K allocated (296.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 139: Executor task launch worker for task 75.0 in stage 0.0 (TID 75) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 109.0 in stage 0.0 (TID 109) (163.152.180.157, executor driver, partition 109, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 116: Executor task launch worker for task 105.0 in stage 0.0 (TID 105) 2023-02-10 11:11:39 Executor: INFO: Finished task 75.0 in stage 0.0 (TID 75). 1453 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 67.0 in stage 0.0 (TID 67) in 1077 ms on 163.152.180.157 (executor driver) (70/144) 2023-02-10 11:11:39 Executor: INFO: Running task 109.0 in stage 0.0 (TID 109) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 110.0 in stage 0.0 (TID 110) (163.152.180.157, executor driver, partition 110, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 75.0 in stage 0.0 (TID 75) in 1009 ms on 163.152.180.157 (executor driver) (71/144) 2023-02-10 11:11:39 Executor: INFO: Running task 110.0 in stage 0.0 (TID 110) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 108.0 in stage 0.0 (TID 108) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 123: Executor task launch worker for task 106.0 in stage 0.0 (TID 106) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 125: Executor task launch worker for task 107.0 in stage 0.0 (TID 107) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 125: Executor task launch worker for task 107.0 in stage 0.0 (TID 107) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 123: Executor task launch worker for task 106.0 in stage 0.0 (TID 106) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=59, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=11, cache hits=1 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.8K allocated (297.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 136: Executor task launch worker for task 59.0 in stage 0.0 (TID 59) 2023-02-10 11:11:39 Executor: INFO: Finished task 59.0 in stage 0.0 (TID 59). 1496 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 111.0 in stage 0.0 (TID 111) (163.152.180.157, executor driver, partition 111, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 59.0 in stage 0.0 (TID 59) in 1139 ms on 163.152.180.157 (executor driver) (72/144) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=51, attempt=0, peakBytes=307200, peakBytesReadable=300.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.0K allocated (298.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 141: Executor task launch worker for task 51.0 in stage 0.0 (TID 51) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 109.0 in stage 0.0 (TID 109) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 145: Executor task launch worker for task 108.0 in stage 0.0 (TID 108) 2023-02-10 11:11:39 Executor: INFO: Running task 111.0 in stage 0.0 (TID 111) 2023-02-10 11:11:39 Executor: INFO: Finished task 51.0 in stage 0.0 (TID 51). 1453 bytes result sent to driver 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 151: Executor task launch worker for task 109.0 in stage 0.0 (TID 109) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 112.0 in stage 0.0 (TID 112) (163.152.180.157, executor driver, partition 112, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 51.0 in stage 0.0 (TID 51) in 1200 ms on 163.152.180.157 (executor driver) (73/144) 2023-02-10 11:11:39 Executor: INFO: Running task 112.0 in stage 0.0 (TID 112) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 121: Executor task launch worker for task 110.0 in stage 0.0 (TID 110) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=78, attempt=0, peakBytes=310016, peakBytesReadable=302.75 KiB, chunks requested=9, cache hits=1 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 302.5K allocated (299.5K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 119: Executor task launch worker for task 78.0 in stage 0.0 (TID 78) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 121: Executor task launch worker for task 110.0 in stage 0.0 (TID 110) 2023-02-10 11:11:39 Executor: INFO: Finished task 78.0 in stage 0.0 (TID 78). 1452 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 113.0 in stage 0.0 (TID 113) (163.152.180.157, executor driver, partition 113, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=55, attempt=0, peakBytes=306176, peakBytesReadable=299.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 78.0 in stage 0.0 (TID 78) in 898 ms on 163.152.180.157 (executor driver) (74/144) 2023-02-10 11:11:39 Executor: INFO: Running task 113.0 in stage 0.0 (TID 113) 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 299.0K allocated (297.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 138: Executor task launch worker for task 55.0 in stage 0.0 (TID 55) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 111.0 in stage 0.0 (TID 111) 2023-02-10 11:11:39 Executor: INFO: Finished task 55.0 in stage 0.0 (TID 55). 1511 bytes result sent to driver 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 136: Executor task launch worker for task 111.0 in stage 0.0 (TID 111) 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 114.0 in stage 0.0 (TID 114) (163.152.180.157, executor driver, partition 114, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 Executor: INFO: Running task 114.0 in stage 0.0 (TID 114) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 55.0 in stage 0.0 (TID 55) in 1213 ms on 163.152.180.157 (executor driver) (75/144) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 112.0 in stage 0.0 (TID 112) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 141: Executor task launch worker for task 112.0 in stage 0.0 (TID 112) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=79, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 301.3K allocated (298.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 142: Executor task launch worker for task 79.0 in stage 0.0 (TID 79) 2023-02-10 11:11:39 Executor: INFO: Finished task 79.0 in stage 0.0 (TID 79). 1471 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 115.0 in stage 0.0 (TID 115) (163.152.180.157, executor driver, partition 115, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 79.0 in stage 0.0 (TID 79) in 902 ms on 163.152.180.157 (executor driver) (76/144) 2023-02-10 11:11:39 Executor: INFO: Running task 115.0 in stage 0.0 (TID 115) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 113.0 in stage 0.0 (TID 113) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 119: Executor task launch worker for task 113.0 in stage 0.0 (TID 113) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 138: Executor task launch worker for task 114.0 in stage 0.0 (TID 114) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 138: Executor task launch worker for task 114.0 in stage 0.0 (TID 114) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=72, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 118: Executor task launch worker for task 72.0 in stage 0.0 (TID 72) 2023-02-10 11:11:39 Executor: INFO: Finished task 72.0 in stage 0.0 (TID 72). 1524 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 116.0 in stage 0.0 (TID 116) (163.152.180.157, executor driver, partition 116, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 72.0 in stage 0.0 (TID 72) in 1085 ms on 163.152.180.157 (executor driver) (77/144) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=61, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=6, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 302.0K allocated (299.0K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 126: Executor task launch worker for task 61.0 in stage 0.0 (TID 61) 2023-02-10 11:11:39 Executor: INFO: Finished task 61.0 in stage 0.0 (TID 61). 1502 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 117.0 in stage 0.0 (TID 117) (163.152.180.157, executor driver, partition 117, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 61.0 in stage 0.0 (TID 61) in 1189 ms on 163.152.180.157 (executor driver) (78/144) 2023-02-10 11:11:39 Executor: INFO: Running task 117.0 in stage 0.0 (TID 117) 2023-02-10 11:11:39 Executor: INFO: Running task 116.0 in stage 0.0 (TID 116) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 115.0 in stage 0.0 (TID 115) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 117.0 in stage 0.0 (TID 117) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 142: Executor task launch worker for task 115.0 in stage 0.0 (TID 115) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 126: Executor task launch worker for task 117.0 in stage 0.0 (TID 117) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 116.0 in stage 0.0 (TID 116) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 118: Executor task launch worker for task 116.0 in stage 0.0 (TID 116) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=58, attempt=0, peakBytes=315392, peakBytesReadable=308.00 KiB, chunks requested=12, cache hits=2 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 308.0K allocated (304.0K blocks / 4.0K chunks), regions.size = 9, 0 current java objects, thread 152: Executor task launch worker for task 58.0 in stage 0.0 (TID 58) 2023-02-10 11:11:39 Executor: INFO: Finished task 58.0 in stage 0.0 (TID 58). 1475 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 118.0 in stage 0.0 (TID 118) (163.152.180.157, executor driver, partition 118, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 Executor: INFO: Running task 118.0 in stage 0.0 (TID 118) 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 58.0 in stage 0.0 (TID 58) in 1263 ms on 163.152.180.157 (executor driver) (79/144) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 118.0 in stage 0.0 (TID 118) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 139: Executor task launch worker for task 118.0 in stage 0.0 (TID 118) 2023-02-10 11:11:39 root: INFO: TaskReport: stage=0, partition=68, attempt=0, peakBytes=304640, peakBytesReadable=297.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:39 root: INFO: RegionPool: FREE: 297.5K allocated (295.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 149: Executor task launch worker for task 68.0 in stage 0.0 (TID 68) 2023-02-10 11:11:39 Executor: INFO: Finished task 68.0 in stage 0.0 (TID 68). 1468 bytes result sent to driver 2023-02-10 11:11:39 TaskSetManager: INFO: Starting task 119.0 in stage 0.0 (TID 119) (163.152.180.157, executor driver, partition 119, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:39 TaskSetManager: INFO: Finished task 68.0 in stage 0.0 (TID 68) in 1240 ms on 163.152.180.157 (executor driver) (80/144) 2023-02-10 11:11:39 Executor: INFO: Running task 119.0 in stage 0.0 (TID 119) 2023-02-10 11:11:39 root: INFO: RegionPool: initialized for thread 149: Executor task launch worker for task 119.0 in stage 0.0 (TID 119) 2023-02-10 11:11:39 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 149: Executor task launch worker for task 119.0 in stage 0.0 (TID 119) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=85, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=7, cache hits=2 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.5K allocated (303.0K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 143: Executor task launch worker for task 85.0 in stage 0.0 (TID 85) 2023-02-10 11:11:40 Executor: INFO: Finished task 85.0 in stage 0.0 (TID 85). 1520 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 120.0 in stage 0.0 (TID 120) (163.152.180.157, executor driver, partition 120, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 85.0 in stage 0.0 (TID 85) in 860 ms on 163.152.180.157 (executor driver) (81/144) 2023-02-10 11:11:40 Executor: INFO: Running task 120.0 in stage 0.0 (TID 120) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 120.0 in stage 0.0 (TID 120) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 143: Executor task launch worker for task 120.0 in stage 0.0 (TID 120) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=82, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.8K allocated (303.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 144: Executor task launch worker for task 82.0 in stage 0.0 (TID 82) 2023-02-10 11:11:40 Executor: INFO: Finished task 82.0 in stage 0.0 (TID 82). 1484 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 121.0 in stage 0.0 (TID 121) (163.152.180.157, executor driver, partition 121, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 82.0 in stage 0.0 (TID 82) in 970 ms on 163.152.180.157 (executor driver) (82/144) 2023-02-10 11:11:40 Executor: INFO: Running task 121.0 in stage 0.0 (TID 121) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=80, attempt=0, peakBytes=310272, peakBytesReadable=303.00 KiB, chunks requested=15, cache hits=7 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 303.0K allocated (301.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 135: Executor task launch worker for task 80.0 in stage 0.0 (TID 80) 2023-02-10 11:11:40 Executor: INFO: Finished task 80.0 in stage 0.0 (TID 80). 1510 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 122.0 in stage 0.0 (TID 122) (163.152.180.157, executor driver, partition 122, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 80.0 in stage 0.0 (TID 80) in 1014 ms on 163.152.180.157 (executor driver) (83/144) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 121.0 in stage 0.0 (TID 121) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 152: Executor task launch worker for task 121.0 in stage 0.0 (TID 121) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=84, attempt=0, peakBytes=316416, peakBytesReadable=309.00 KiB, chunks requested=4, cache hits=0 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=89, attempt=0, peakBytes=316160, peakBytesReadable=308.75 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 309.0K allocated (306.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 140: Executor task launch worker for task 84.0 in stage 0.0 (TID 84) 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 308.8K allocated (306.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 148: Executor task launch worker for task 89.0 in stage 0.0 (TID 89) 2023-02-10 11:11:40 Executor: INFO: Finished task 84.0 in stage 0.0 (TID 84). 1618 bytes result sent to driver 2023-02-10 11:11:40 Executor: INFO: Finished task 89.0 in stage 0.0 (TID 89). 1550 bytes result sent to driver 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=83, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.0K allocated (303.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 153: Executor task launch worker for task 83.0 in stage 0.0 (TID 83) 2023-02-10 11:11:40 Executor: INFO: Finished task 83.0 in stage 0.0 (TID 83). 1499 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 123.0 in stage 0.0 (TID 123) (163.152.180.157, executor driver, partition 123, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 Executor: INFO: Running task 122.0 in stage 0.0 (TID 122) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 84.0 in stage 0.0 (TID 84) in 977 ms on 163.152.180.157 (executor driver) (84/144) 2023-02-10 11:11:40 Executor: INFO: Running task 123.0 in stage 0.0 (TID 123) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=81, attempt=0, peakBytes=317696, peakBytesReadable=310.25 KiB, chunks requested=10, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 309.8K allocated (306.3K blocks / 3.5K chunks), regions.size = 9, 0 current java objects, thread 134: Executor task launch worker for task 81.0 in stage 0.0 (TID 81) 2023-02-10 11:11:40 Executor: INFO: Finished task 81.0 in stage 0.0 (TID 81). 1614 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 124.0 in stage 0.0 (TID 124) (163.152.180.157, executor driver, partition 124, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 125.0 in stage 0.0 (TID 125) (163.152.180.157, executor driver, partition 125, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 126.0 in stage 0.0 (TID 126) (163.152.180.157, executor driver, partition 126, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 Executor: INFO: Running task 126.0 in stage 0.0 (TID 126) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 81.0 in stage 0.0 (TID 81) in 1014 ms on 163.152.180.157 (executor driver) (85/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=88, attempt=0, peakBytes=312576, peakBytesReadable=305.25 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.3K allocated (302.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 114: Executor task launch worker for task 88.0 in stage 0.0 (TID 88) 2023-02-10 11:11:40 Executor: INFO: Finished task 88.0 in stage 0.0 (TID 88). 1487 bytes result sent to driver 2023-02-10 11:11:40 Executor: INFO: Running task 125.0 in stage 0.0 (TID 125) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=91, attempt=0, peakBytes=312064, peakBytesReadable=304.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 304.8K allocated (302.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 137: Executor task launch worker for task 91.0 in stage 0.0 (TID 91) 2023-02-10 11:11:40 Executor: INFO: Finished task 91.0 in stage 0.0 (TID 91). 1479 bytes result sent to driver 2023-02-10 11:11:40 Executor: INFO: Running task 124.0 in stage 0.0 (TID 124) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 89.0 in stage 0.0 (TID 89) in 967 ms on 163.152.180.157 (executor driver) (86/144) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 83.0 in stage 0.0 (TID 83) in 993 ms on 163.152.180.157 (executor driver) (87/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=92, attempt=0, peakBytes=311040, peakBytesReadable=303.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 303.8K allocated (301.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 115: Executor task launch worker for task 92.0 in stage 0.0 (TID 92) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 123.0 in stage 0.0 (TID 123) 2023-02-10 11:11:40 Executor: INFO: Finished task 92.0 in stage 0.0 (TID 92). 1476 bytes result sent to driver 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 140: Executor task launch worker for task 123.0 in stage 0.0 (TID 123) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 122.0 in stage 0.0 (TID 122) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 159: Executor task launch worker for task 122.0 in stage 0.0 (TID 122) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 126.0 in stage 0.0 (TID 126) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 153: Executor task launch worker for task 126.0 in stage 0.0 (TID 126) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 125.0 in stage 0.0 (TID 125) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=98, attempt=0, peakBytes=312064, peakBytesReadable=304.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 124.0 in stage 0.0 (TID 124) 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 304.8K allocated (302.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 131: Executor task launch worker for task 98.0 in stage 0.0 (TID 98) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=87, attempt=0, peakBytes=318976, peakBytesReadable=311.50 KiB, chunks requested=15, cache hits=5 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 311.5K allocated (308.0K blocks / 3.5K chunks), regions.size = 9, 0 current java objects, thread 150: Executor task launch worker for task 87.0 in stage 0.0 (TID 87) 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 127.0 in stage 0.0 (TID 127) (163.152.180.157, executor driver, partition 127, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 Executor: INFO: Finished task 98.0 in stage 0.0 (TID 98). 1503 bytes result sent to driver 2023-02-10 11:11:40 Executor: INFO: Finished task 87.0 in stage 0.0 (TID 87). 1498 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 88.0 in stage 0.0 (TID 88) in 982 ms on 163.152.180.157 (executor driver) (88/144) 2023-02-10 11:11:40 Executor: INFO: Running task 127.0 in stage 0.0 (TID 127) 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 128.0 in stage 0.0 (TID 128) (163.152.180.157, executor driver, partition 128, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 Executor: INFO: Running task 128.0 in stage 0.0 (TID 128) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 91.0 in stage 0.0 (TID 91) in 979 ms on 163.152.180.157 (executor driver) (89/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=95, attempt=0, peakBytes=311296, peakBytesReadable=304.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 129.0 in stage 0.0 (TID 129) (163.152.180.157, executor driver, partition 129, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 304.0K allocated (302.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 132: Executor task launch worker for task 95.0 in stage 0.0 (TID 95) 2023-02-10 11:11:40 Executor: INFO: Running task 129.0 in stage 0.0 (TID 129) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 92.0 in stage 0.0 (TID 92) in 980 ms on 163.152.180.157 (executor driver) (90/144) 2023-02-10 11:11:40 Executor: INFO: Finished task 95.0 in stage 0.0 (TID 95). 1519 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 130.0 in stage 0.0 (TID 130) (163.152.180.157, executor driver, partition 130, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 98.0 in stage 0.0 (TID 98) in 973 ms on 163.152.180.157 (executor driver) (91/144) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 148: Executor task launch worker for task 124.0 in stage 0.0 (TID 124) 2023-02-10 11:11:40 Executor: INFO: Running task 130.0 in stage 0.0 (TID 130) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=93, attempt=0, peakBytes=313600, peakBytesReadable=306.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=103, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 131.0 in stage 0.0 (TID 131) (163.152.180.157, executor driver, partition 131, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 124: Executor task launch worker for task 103.0 in stage 0.0 (TID 103) 2023-02-10 11:11:40 Executor: INFO: Running task 131.0 in stage 0.0 (TID 131) 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 132.0 in stage 0.0 (TID 132) (163.152.180.157, executor driver, partition 132, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 Executor: INFO: Running task 132.0 in stage 0.0 (TID 132) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 87.0 in stage 0.0 (TID 87) in 988 ms on 163.152.180.157 (executor driver) (92/144) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 134: Executor task launch worker for task 125.0 in stage 0.0 (TID 125) 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 306.3K allocated (304.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 129: Executor task launch worker for task 93.0 in stage 0.0 (TID 93) 2023-02-10 11:11:40 Executor: INFO: Finished task 93.0 in stage 0.0 (TID 93). 1486 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 133.0 in stage 0.0 (TID 133) (163.152.180.157, executor driver, partition 133, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 93.0 in stage 0.0 (TID 93) in 982 ms on 163.152.180.157 (executor driver) (93/144) 2023-02-10 11:11:40 Executor: INFO: Running task 133.0 in stage 0.0 (TID 133) 2023-02-10 11:11:40 Executor: INFO: Finished task 103.0 in stage 0.0 (TID 103). 1510 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 95.0 in stage 0.0 (TID 95) in 986 ms on 163.152.180.157 (executor driver) (94/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=94, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 146: Executor task launch worker for task 94.0 in stage 0.0 (TID 94) 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 134.0 in stage 0.0 (TID 134) (163.152.180.157, executor driver, partition 134, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 103.0 in stage 0.0 (TID 103) in 958 ms on 163.152.180.157 (executor driver) (95/144) 2023-02-10 11:11:40 Executor: INFO: Finished task 94.0 in stage 0.0 (TID 94). 1492 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 135.0 in stage 0.0 (TID 135) (163.152.180.157, executor driver, partition 135, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 Executor: INFO: Running task 134.0 in stage 0.0 (TID 134) 2023-02-10 11:11:40 Executor: INFO: Running task 135.0 in stage 0.0 (TID 135) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=97, attempt=0, peakBytes=310784, peakBytesReadable=303.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 303.5K allocated (301.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 128: Executor task launch worker for task 97.0 in stage 0.0 (TID 97) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 131.0 in stage 0.0 (TID 131) 2023-02-10 11:11:40 Executor: INFO: Finished task 97.0 in stage 0.0 (TID 97). 1477 bytes result sent to driver 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 137: Executor task launch worker for task 131.0 in stage 0.0 (TID 131) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 127.0 in stage 0.0 (TID 127) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 129: Executor task launch worker for task 133.0 in stage 0.0 (TID 133) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=100, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.8K allocated (303.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 120: Executor task launch worker for task 100.0 in stage 0.0 (TID 100) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 129: Executor task launch worker for task 133.0 in stage 0.0 (TID 133) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 128.0 in stage 0.0 (TID 128) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 132.0 in stage 0.0 (TID 132) 2023-02-10 11:11:40 Executor: INFO: Finished task 100.0 in stage 0.0 (TID 100). 1491 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 94.0 in stage 0.0 (TID 94) in 997 ms on 163.152.180.157 (executor driver) (96/144) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 131: Executor task launch worker for task 128.0 in stage 0.0 (TID 128) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 114: Executor task launch worker for task 132.0 in stage 0.0 (TID 132) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=99, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.0K allocated (303.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 133: Executor task launch worker for task 99.0 in stage 0.0 (TID 99) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 129.0 in stage 0.0 (TID 129) 2023-02-10 11:11:40 Executor: INFO: Finished task 99.0 in stage 0.0 (TID 99). 1513 bytes result sent to driver 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 115: Executor task launch worker for task 129.0 in stage 0.0 (TID 129) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 150: Executor task launch worker for task 127.0 in stage 0.0 (TID 127) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 134.0 in stage 0.0 (TID 134) 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 136.0 in stage 0.0 (TID 136) (163.152.180.157, executor driver, partition 136, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 Executor: INFO: Running task 136.0 in stage 0.0 (TID 136) 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 137.0 in stage 0.0 (TID 137) (163.152.180.157, executor driver, partition 137, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 124: Executor task launch worker for task 134.0 in stage 0.0 (TID 134) 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 138.0 in stage 0.0 (TID 138) (163.152.180.157, executor driver, partition 138, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 Executor: INFO: Running task 137.0 in stage 0.0 (TID 137) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 99.0 in stage 0.0 (TID 99) in 988 ms on 163.152.180.157 (executor driver) (97/144) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 97.0 in stage 0.0 (TID 97) in 1003 ms on 163.152.180.157 (executor driver) (98/144) 2023-02-10 11:11:40 Executor: INFO: Running task 138.0 in stage 0.0 (TID 138) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 100.0 in stage 0.0 (TID 100) in 987 ms on 163.152.180.157 (executor driver) (99/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=109, attempt=0, peakBytes=314112, peakBytesReadable=306.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 306.8K allocated (304.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 151: Executor task launch worker for task 109.0 in stage 0.0 (TID 109) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 135.0 in stage 0.0 (TID 135) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 130.0 in stage 0.0 (TID 130) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 144: Executor task launch worker for task 135.0 in stage 0.0 (TID 135) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 132: Executor task launch worker for task 130.0 in stage 0.0 (TID 130) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=104, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 Executor: INFO: Finished task 109.0 in stage 0.0 (TID 109). 1502 bytes result sent to driver 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.0K allocated (303.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 117: Executor task launch worker for task 104.0 in stage 0.0 (TID 104) 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 139.0 in stage 0.0 (TID 139) (163.152.180.157, executor driver, partition 139, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 Executor: INFO: Finished task 104.0 in stage 0.0 (TID 104). 1474 bytes result sent to driver 2023-02-10 11:11:40 Executor: INFO: Running task 139.0 in stage 0.0 (TID 139) 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 140.0 in stage 0.0 (TID 140) (163.152.180.157, executor driver, partition 140, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 104.0 in stage 0.0 (TID 104) in 985 ms on 163.152.180.157 (executor driver) (100/144) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 109.0 in stage 0.0 (TID 109) in 955 ms on 163.152.180.157 (executor driver) (101/144) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 137.0 in stage 0.0 (TID 137) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=108, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 120: Executor task launch worker for task 137.0 in stage 0.0 (TID 137) 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 145: Executor task launch worker for task 108.0 in stage 0.0 (TID 108) 2023-02-10 11:11:40 Executor: INFO: Finished task 108.0 in stage 0.0 (TID 108). 1476 bytes result sent to driver 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=102, attempt=0, peakBytes=314112, peakBytesReadable=306.75 KiB, chunks requested=6, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 306.5K allocated (304.0K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 127: Executor task launch worker for task 102.0 in stage 0.0 (TID 102) 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 141.0 in stage 0.0 (TID 141) (163.152.180.157, executor driver, partition 141, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 Executor: INFO: Running task 141.0 in stage 0.0 (TID 141) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 108.0 in stage 0.0 (TID 108) in 977 ms on 163.152.180.157 (executor driver) (102/144) 2023-02-10 11:11:40 Executor: INFO: Finished task 102.0 in stage 0.0 (TID 102). 1526 bytes result sent to driver 2023-02-10 11:11:40 Executor: INFO: Running task 140.0 in stage 0.0 (TID 140) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 138.0 in stage 0.0 (TID 138) 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 142.0 in stage 0.0 (TID 142) (163.152.180.157, executor driver, partition 142, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=112, attempt=0, peakBytes=312064, peakBytesReadable=304.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 304.8K allocated (302.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 141: Executor task launch worker for task 112.0 in stage 0.0 (TID 112) 2023-02-10 11:11:40 Executor: INFO: Running task 142.0 in stage 0.0 (TID 142) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 102.0 in stage 0.0 (TID 102) in 1003 ms on 163.152.180.157 (executor driver) (103/144) 2023-02-10 11:11:40 Executor: INFO: Finished task 112.0 in stage 0.0 (TID 112). 1480 bytes result sent to driver 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=113, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.0K allocated (303.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 119: Executor task launch worker for task 113.0 in stage 0.0 (TID 113) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 128: Executor task launch worker for task 138.0 in stage 0.0 (TID 138) 2023-02-10 11:11:40 TaskSetManager: INFO: Starting task 143.0 in stage 0.0 (TID 143) (163.152.180.157, executor driver, partition 143, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:40 Executor: INFO: Finished task 113.0 in stage 0.0 (TID 113). 1503 bytes result sent to driver 2023-02-10 11:11:40 Executor: INFO: Running task 143.0 in stage 0.0 (TID 143) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=90, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.8K allocated (303.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 147: Executor task launch worker for task 90.0 in stage 0.0 (TID 90) 2023-02-10 11:11:40 Executor: INFO: Finished task 90.0 in stage 0.0 (TID 90). 1474 bytes result sent to driver 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=101, attempt=0, peakBytes=311552, peakBytesReadable=304.25 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 304.3K allocated (301.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 122: Executor task launch worker for task 101.0 in stage 0.0 (TID 101) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 136.0 in stage 0.0 (TID 136) 2023-02-10 11:11:40 Executor: INFO: Finished task 101.0 in stage 0.0 (TID 101). 1487 bytes result sent to driver 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 133: Executor task launch worker for task 136.0 in stage 0.0 (TID 136) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 112.0 in stage 0.0 (TID 112) in 952 ms on 163.152.180.157 (executor driver) (104/144) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 113.0 in stage 0.0 (TID 113) in 940 ms on 163.152.180.157 (executor driver) (105/144) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 90.0 in stage 0.0 (TID 90) in 1038 ms on 163.152.180.157 (executor driver) (106/144) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 101.0 in stage 0.0 (TID 101) in 1015 ms on 163.152.180.157 (executor driver) (107/144) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 141.0 in stage 0.0 (TID 141) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 140.0 in stage 0.0 (TID 140) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 146: Executor task launch worker for task 141.0 in stage 0.0 (TID 141) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 142.0 in stage 0.0 (TID 142) 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 139.0 in stage 0.0 (TID 139) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 145: Executor task launch worker for task 142.0 in stage 0.0 (TID 142) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 117: Executor task launch worker for task 139.0 in stage 0.0 (TID 139) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 151: Executor task launch worker for task 140.0 in stage 0.0 (TID 140) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=111, attempt=0, peakBytes=311296, peakBytesReadable=304.00 KiB, chunks requested=4, cache hits=1 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 303.8K allocated (301.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 136: Executor task launch worker for task 111.0 in stage 0.0 (TID 111) 2023-02-10 11:11:40 Executor: INFO: Finished task 111.0 in stage 0.0 (TID 111). 1478 bytes result sent to driver 2023-02-10 11:11:40 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 143.0 in stage 0.0 (TID 143) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 111.0 in stage 0.0 (TID 111) in 976 ms on 163.152.180.157 (executor driver) (108/144) 2023-02-10 11:11:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 119: Executor task launch worker for task 143.0 in stage 0.0 (TID 143) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=110, attempt=0, peakBytes=312576, peakBytesReadable=305.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.3K allocated (303.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 121: Executor task launch worker for task 110.0 in stage 0.0 (TID 110) 2023-02-10 11:11:40 Executor: INFO: Finished task 110.0 in stage 0.0 (TID 110). 1659 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 110.0 in stage 0.0 (TID 110) in 991 ms on 163.152.180.157 (executor driver) (109/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=107, attempt=0, peakBytes=311296, peakBytesReadable=304.00 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 304.0K allocated (302.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 125: Executor task launch worker for task 107.0 in stage 0.0 (TID 107) 2023-02-10 11:11:40 Executor: INFO: Finished task 107.0 in stage 0.0 (TID 107). 1502 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 107.0 in stage 0.0 (TID 107) in 1025 ms on 163.152.180.157 (executor driver) (110/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=96, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 158: Executor task launch worker for task 96.0 in stage 0.0 (TID 96) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=117, attempt=0, peakBytes=311040, peakBytesReadable=303.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 303.8K allocated (301.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 126: Executor task launch worker for task 117.0 in stage 0.0 (TID 117) 2023-02-10 11:11:40 Executor: INFO: Finished task 96.0 in stage 0.0 (TID 96). 1476 bytes result sent to driver 2023-02-10 11:11:40 Executor: INFO: Finished task 117.0 in stage 0.0 (TID 117). 1500 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 96.0 in stage 0.0 (TID 96) in 1072 ms on 163.152.180.157 (executor driver) (111/144) 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 117.0 in stage 0.0 (TID 117) in 934 ms on 163.152.180.157 (executor driver) (112/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=86, attempt=0, peakBytes=312064, peakBytesReadable=304.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 304.8K allocated (302.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 130: Executor task launch worker for task 86.0 in stage 0.0 (TID 86) 2023-02-10 11:11:40 Executor: INFO: Finished task 86.0 in stage 0.0 (TID 86). 1482 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 86.0 in stage 0.0 (TID 86) in 1103 ms on 163.152.180.157 (executor driver) (113/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=105, attempt=0, peakBytes=311552, peakBytesReadable=304.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 304.3K allocated (302.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 116: Executor task launch worker for task 105.0 in stage 0.0 (TID 105) 2023-02-10 11:11:40 Executor: INFO: Finished task 105.0 in stage 0.0 (TID 105). 1504 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 105.0 in stage 0.0 (TID 105) in 1051 ms on 163.152.180.157 (executor driver) (114/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=116, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.8K allocated (303.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 118: Executor task launch worker for task 116.0 in stage 0.0 (TID 116) 2023-02-10 11:11:40 Executor: INFO: Finished task 116.0 in stage 0.0 (TID 116). 1526 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 116.0 in stage 0.0 (TID 116) in 964 ms on 163.152.180.157 (executor driver) (115/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=115, attempt=0, peakBytes=313600, peakBytesReadable=306.25 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 306.3K allocated (303.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 142: Executor task launch worker for task 115.0 in stage 0.0 (TID 115) 2023-02-10 11:11:40 Executor: INFO: Finished task 115.0 in stage 0.0 (TID 115). 1599 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 115.0 in stage 0.0 (TID 115) in 990 ms on 163.152.180.157 (executor driver) (116/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=114, attempt=0, peakBytes=313344, peakBytesReadable=306.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 306.0K allocated (304.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 138: Executor task launch worker for task 114.0 in stage 0.0 (TID 114) 2023-02-10 11:11:40 Executor: INFO: Finished task 114.0 in stage 0.0 (TID 114). 1477 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 114.0 in stage 0.0 (TID 114) in 1020 ms on 163.152.180.157 (executor driver) (117/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=118, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 139: Executor task launch worker for task 118.0 in stage 0.0 (TID 118) 2023-02-10 11:11:40 Executor: INFO: Finished task 118.0 in stage 0.0 (TID 118). 1545 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 118.0 in stage 0.0 (TID 118) in 967 ms on 163.152.180.157 (executor driver) (118/144) 2023-02-10 11:11:40 root: INFO: TaskReport: stage=0, partition=106, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:40 root: INFO: RegionPool: FREE: 305.0K allocated (303.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 123: Executor task launch worker for task 106.0 in stage 0.0 (TID 106) 2023-02-10 11:11:40 Executor: INFO: Finished task 106.0 in stage 0.0 (TID 106). 1659 bytes result sent to driver 2023-02-10 11:11:40 TaskSetManager: INFO: Finished task 106.0 in stage 0.0 (TID 106) in 1171 ms on 163.152.180.157 (executor driver) (119/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=119, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 302.5K allocated (300.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 149: Executor task launch worker for task 119.0 in stage 0.0 (TID 119) 2023-02-10 11:11:41 Executor: INFO: Finished task 119.0 in stage 0.0 (TID 119). 1482 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 119.0 in stage 0.0 (TID 119) in 1061 ms on 163.152.180.157 (executor driver) (120/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=126, attempt=0, peakBytes=312064, peakBytesReadable=304.75 KiB, chunks requested=4, cache hits=1 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 304.8K allocated (302.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 153: Executor task launch worker for task 126.0 in stage 0.0 (TID 126) 2023-02-10 11:11:41 Executor: INFO: Finished task 126.0 in stage 0.0 (TID 126). 1468 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 126.0 in stage 0.0 (TID 126) in 577 ms on 163.152.180.157 (executor driver) (121/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=122, attempt=0, peakBytes=314112, peakBytesReadable=306.75 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 306.8K allocated (304.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 159: Executor task launch worker for task 122.0 in stage 0.0 (TID 122) 2023-02-10 11:11:41 Executor: INFO: Finished task 122.0 in stage 0.0 (TID 122). 1441 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 122.0 in stage 0.0 (TID 122) in 601 ms on 163.152.180.157 (executor driver) (122/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=129, attempt=0, peakBytes=317184, peakBytesReadable=309.75 KiB, chunks requested=7, cache hits=1 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 309.8K allocated (307.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 115: Executor task launch worker for task 129.0 in stage 0.0 (TID 129) 2023-02-10 11:11:41 Executor: INFO: Finished task 129.0 in stage 0.0 (TID 129). 1439 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 129.0 in stage 0.0 (TID 129) in 659 ms on 163.152.180.157 (executor driver) (123/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=125, attempt=0, peakBytes=314112, peakBytesReadable=306.75 KiB, chunks requested=5, cache hits=2 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 306.8K allocated (304.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 134: Executor task launch worker for task 125.0 in stage 0.0 (TID 125) 2023-02-10 11:11:41 Executor: INFO: Finished task 125.0 in stage 0.0 (TID 125). 1489 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 125.0 in stage 0.0 (TID 125) in 686 ms on 163.152.180.157 (executor driver) (124/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=127, attempt=0, peakBytes=314112, peakBytesReadable=306.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 306.8K allocated (304.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 150: Executor task launch worker for task 127.0 in stage 0.0 (TID 127) 2023-02-10 11:11:41 Executor: INFO: Finished task 127.0 in stage 0.0 (TID 127). 1438 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 127.0 in stage 0.0 (TID 127) in 682 ms on 163.152.180.157 (executor driver) (125/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=134, attempt=0, peakBytes=315648, peakBytesReadable=308.25 KiB, chunks requested=9, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 308.3K allocated (305.3K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 124: Executor task launch worker for task 134.0 in stage 0.0 (TID 134) 2023-02-10 11:11:41 Executor: INFO: Finished task 134.0 in stage 0.0 (TID 134). 1431 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 134.0 in stage 0.0 (TID 134) in 658 ms on 163.152.180.157 (executor driver) (126/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=136, attempt=0, peakBytes=316416, peakBytesReadable=309.00 KiB, chunks requested=8, cache hits=1 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 308.8K allocated (305.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 133: Executor task launch worker for task 136.0 in stage 0.0 (TID 136) 2023-02-10 11:11:41 Executor: INFO: Finished task 136.0 in stage 0.0 (TID 136). 1489 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 136.0 in stage 0.0 (TID 136) in 659 ms on 163.152.180.157 (executor driver) (127/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=137, attempt=0, peakBytes=311040, peakBytesReadable=303.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 303.8K allocated (301.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 120: Executor task launch worker for task 137.0 in stage 0.0 (TID 137) 2023-02-10 11:11:41 Executor: INFO: Finished task 137.0 in stage 0.0 (TID 137). 1442 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 137.0 in stage 0.0 (TID 137) in 677 ms on 163.152.180.157 (executor driver) (128/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=135, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 305.8K allocated (303.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 144: Executor task launch worker for task 135.0 in stage 0.0 (TID 135) 2023-02-10 11:11:41 Executor: INFO: Finished task 135.0 in stage 0.0 (TID 135). 1524 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 135.0 in stage 0.0 (TID 135) in 694 ms on 163.152.180.157 (executor driver) (129/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=123, attempt=0, peakBytes=313344, peakBytesReadable=306.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 306.0K allocated (304.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 140: Executor task launch worker for task 123.0 in stage 0.0 (TID 123) 2023-02-10 11:11:41 Executor: INFO: Finished task 123.0 in stage 0.0 (TID 123). 1445 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 123.0 in stage 0.0 (TID 123) in 782 ms on 163.152.180.157 (executor driver) (130/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=130, attempt=0, peakBytes=314624, peakBytesReadable=307.25 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 307.3K allocated (305.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 132: Executor task launch worker for task 130.0 in stage 0.0 (TID 130) 2023-02-10 11:11:41 Executor: INFO: Finished task 130.0 in stage 0.0 (TID 130). 1554 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 130.0 in stage 0.0 (TID 130) in 800 ms on 163.152.180.157 (executor driver) (131/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=143, attempt=0, peakBytes=322816, peakBytesReadable=315.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 315.3K allocated (313.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 119: Executor task launch worker for task 143.0 in stage 0.0 (TID 143) 2023-02-10 11:11:41 Executor: INFO: Finished task 143.0 in stage 0.0 (TID 143). 1771 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 143.0 in stage 0.0 (TID 143) in 764 ms on 163.152.180.157 (executor driver) (132/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=120, attempt=0, peakBytes=312576, peakBytesReadable=305.25 KiB, chunks requested=9, cache hits=2 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 305.3K allocated (302.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 143: Executor task launch worker for task 120.0 in stage 0.0 (TID 120) 2023-02-10 11:11:41 Executor: INFO: Finished task 120.0 in stage 0.0 (TID 120). 1511 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 120.0 in stage 0.0 (TID 120) in 1068 ms on 163.152.180.157 (executor driver) (133/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=141, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 146: Executor task launch worker for task 141.0 in stage 0.0 (TID 141) 2023-02-10 11:11:41 Executor: INFO: Finished task 141.0 in stage 0.0 (TID 141). 1483 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 141.0 in stage 0.0 (TID 141) in 905 ms on 163.152.180.157 (executor driver) (134/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=142, attempt=0, peakBytes=318976, peakBytesReadable=311.50 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 311.5K allocated (309.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 145: Executor task launch worker for task 142.0 in stage 0.0 (TID 142) 2023-02-10 11:11:41 Executor: INFO: Finished task 142.0 in stage 0.0 (TID 142). 1606 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 142.0 in stage 0.0 (TID 142) in 913 ms on 163.152.180.157 (executor driver) (135/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=132, attempt=0, peakBytes=315136, peakBytesReadable=307.75 KiB, chunks requested=8, cache hits=2 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 307.8K allocated (304.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 114: Executor task launch worker for task 132.0 in stage 0.0 (TID 132) 2023-02-10 11:11:41 Executor: INFO: Finished task 132.0 in stage 0.0 (TID 132). 1488 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 132.0 in stage 0.0 (TID 132) in 964 ms on 163.152.180.157 (executor driver) (136/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=121, attempt=0, peakBytes=314624, peakBytesReadable=307.25 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 307.0K allocated (305.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 152: Executor task launch worker for task 121.0 in stage 0.0 (TID 121) 2023-02-10 11:11:41 Executor: INFO: Finished task 121.0 in stage 0.0 (TID 121). 1496 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 121.0 in stage 0.0 (TID 121) in 1030 ms on 163.152.180.157 (executor driver) (137/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=133, attempt=0, peakBytes=314112, peakBytesReadable=306.75 KiB, chunks requested=8, cache hits=3 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 306.8K allocated (304.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 129: Executor task launch worker for task 133.0 in stage 0.0 (TID 133) 2023-02-10 11:11:41 Executor: INFO: Finished task 133.0 in stage 0.0 (TID 133). 1519 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 133.0 in stage 0.0 (TID 133) in 979 ms on 163.152.180.157 (executor driver) (138/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=140, attempt=0, peakBytes=308224, peakBytesReadable=301.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 301.0K allocated (299.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 151: Executor task launch worker for task 140.0 in stage 0.0 (TID 140) 2023-02-10 11:11:41 Executor: INFO: Finished task 140.0 in stage 0.0 (TID 140). 1459 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 140.0 in stage 0.0 (TID 140) in 951 ms on 163.152.180.157 (executor driver) (139/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=131, attempt=0, peakBytes=313344, peakBytesReadable=306.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 306.0K allocated (304.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 137: Executor task launch worker for task 131.0 in stage 0.0 (TID 131) 2023-02-10 11:11:41 Executor: INFO: Finished task 131.0 in stage 0.0 (TID 131). 1550 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 131.0 in stage 0.0 (TID 131) in 1008 ms on 163.152.180.157 (executor driver) (140/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=138, attempt=0, peakBytes=315136, peakBytesReadable=307.75 KiB, chunks requested=7, cache hits=1 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 307.8K allocated (303.8K blocks / 4.0K chunks), regions.size = 9, 0 current java objects, thread 128: Executor task launch worker for task 138.0 in stage 0.0 (TID 138) 2023-02-10 11:11:41 Executor: INFO: Finished task 138.0 in stage 0.0 (TID 138). 1525 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 138.0 in stage 0.0 (TID 138) in 995 ms on 163.152.180.157 (executor driver) (141/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=124, attempt=0, peakBytes=317696, peakBytesReadable=310.25 KiB, chunks requested=11, cache hits=0 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 310.3K allocated (306.8K blocks / 3.5K chunks), regions.size = 9, 0 current java objects, thread 148: Executor task launch worker for task 124.0 in stage 0.0 (TID 124) 2023-02-10 11:11:41 Executor: INFO: Finished task 124.0 in stage 0.0 (TID 124). 1496 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 124.0 in stage 0.0 (TID 124) in 1054 ms on 163.152.180.157 (executor driver) (142/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=128, attempt=0, peakBytes=325376, peakBytesReadable=317.75 KiB, chunks requested=19, cache hits=3 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 317.8K allocated (315.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 131: Executor task launch worker for task 128.0 in stage 0.0 (TID 128) 2023-02-10 11:11:41 Executor: INFO: Finished task 128.0 in stage 0.0 (TID 128). 1496 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 128.0 in stage 0.0 (TID 128) in 1048 ms on 163.152.180.157 (executor driver) (143/144) 2023-02-10 11:11:41 root: INFO: TaskReport: stage=0, partition=139, attempt=0, peakBytes=311552, peakBytesReadable=304.25 KiB, chunks requested=14, cache hits=8 2023-02-10 11:11:41 root: INFO: RegionPool: FREE: 304.3K allocated (300.8K blocks / 3.5K chunks), regions.size = 9, 0 current java objects, thread 117: Executor task launch worker for task 139.0 in stage 0.0 (TID 139) 2023-02-10 11:11:41 Executor: INFO: Finished task 139.0 in stage 0.0 (TID 139). 1462 bytes result sent to driver 2023-02-10 11:11:41 TaskSetManager: INFO: Finished task 139.0 in stage 0.0 (TID 139) in 1020 ms on 163.152.180.157 (executor driver) (144/144) 2023-02-10 11:11:41 DAGScheduler: INFO: ResultStage 0 (collect at SparkBackend.scala:288) finished in 6.213 s 2023-02-10 11:11:41 TaskSchedulerImpl: INFO: Removed TaskSet 0.0, whose tasks have all completed, from pool 2023-02-10 11:11:41 DAGScheduler: INFO: Job 0 is finished. Cancelling potential speculative or zombie tasks for this job 2023-02-10 11:11:41 TaskSchedulerImpl: INFO: Killing all running tasks in stage 0: Stage finished 2023-02-10 11:11:41 DAGScheduler: INFO: Job 0 finished: collect at SparkBackend.scala:288, took 6.258417 s 2023-02-10 11:11:41 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 2, 0 current java objects, thread 28: Thread-5 2023-02-10 11:11:41 Hail: INFO: Coerced prefix-sorted dataset 2023-02-10 11:11:41 root: INFO: optimize optimize: compileLowerer, initial IR: before: IR size 167: (Let sortedPartData (ArraySort __iruid_789 __iruid_790 (Let __iruid_785 (CollectDistributedArray context globals (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (MakeStruct) (StreamAgg x (StreamAggScan key (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref context)) (MakeStruct (key (Ref key)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (ApplyScanOp PrevNonnull () ((Ref key)))))) (Let n (ApplyAggOp Count () ()) (AggLet key False (GetField key (Ref x)) (MakeStruct (n (Ref n)) (minkey (ApplyAggOp TakeBy ((I32 1)) ((Ref key) (Ref key)))) (maxkey (ApplyAggOp TakeBy ((I32 1)) ((Ref key) (Ref key)))) (ksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref x))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref x)) (GetField key (Ref x))))))) (Ref n))) (pksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields (locus) (GetField prevkey (Ref x)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref x))) (SelectFields (locus) (GetField key (Ref x)))))))) (Ref n))) (sample (ApplyAggOp TakeBy ((I32 20)) ((GetField key (Ref x)) (GetField token (Ref x)))))))))) (StreamMap __iruid_788 (StreamFilter __iruid_787 (StreamMap __iruid_786 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_785)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_785) (Ref __iruid_786)) None (i (Ref __iruid_786)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_787))) (I32 0))) (InsertFields (Ref __iruid_788) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_788)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_788)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_789)) (SelectFields (minkey maxkey) (Ref __iruid_790)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold acc partDataWithIndex (ToStream False (Ref sortedPartData)) (True) (ApplySpecial -1 land () Boolean (Ref acc) (GetField ksorted (Ref partDataWithIndex)))) (StreamFold acc i (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref sortedPartData)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref acc) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref sortedPartData) (Ref i))) (GetField minkey (ArrayRef -1 (Ref sortedPartData) (ApplyBinaryPrimOp Add (Ref i) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold acc partDataWithIndex (ToStream False (Ref sortedPartData)) (True) (ApplySpecial -1 land () Boolean (Ref acc) (GetField pksorted (Ref partDataWithIndex)))) (StreamFold acc i (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref sortedPartData)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref acc) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref sortedPartData) (Ref i)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref sortedPartData) (ApplyBinaryPrimOp Add (Ref i) (I32 1)))))))))) (sortedPartData (Ref sortedPartData)))) 2023-02-10 11:11:41 root: INFO: optimize optimize: compileLowerer, initial IR: after: IR size 167: (Let __iruid_833 (ArraySort __iruid_834 __iruid_835 (Let __iruid_836 (CollectDistributedArray __iruid_837 __iruid_838 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (StreamAgg __iruid_839 (StreamAggScan __iruid_840 (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_837)) (MakeStruct (key (Ref __iruid_840)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (ApplyScanOp PrevNonnull () ((Ref __iruid_840)))))) (Let __iruid_841 (ApplyAggOp Count () ()) (AggLet __iruid_842 False (GetField key (Ref __iruid_839)) (MakeStruct (n (Ref __iruid_841)) (minkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_842) (Ref __iruid_842)))) (maxkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_842) (Ref __iruid_842)))) (ksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_839))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_839)) (GetField key (Ref __iruid_839))))))) (Ref __iruid_841))) (pksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_839)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_839))) (SelectFields (locus) (GetField key (Ref __iruid_839)))))))) (Ref __iruid_841))) (sample (ApplyAggOp TakeBy ((I32 20)) ((GetField key (Ref __iruid_839)) (GetField token (Ref __iruid_839)))))))))) (StreamMap __iruid_843 (StreamFilter __iruid_844 (StreamMap __iruid_845 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_836)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_836) (Ref __iruid_845)) None (i (Ref __iruid_845)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_844))) (I32 0))) (InsertFields (Ref __iruid_843) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_843)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_843)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_834)) (SelectFields (minkey maxkey) (Ref __iruid_835)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_846 __iruid_847 (ToStream False (Ref __iruid_833)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_846) (GetField ksorted (Ref __iruid_847)))) (StreamFold __iruid_848 __iruid_849 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_833)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_848) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_833) (Ref __iruid_849))) (GetField minkey (ArrayRef -1 (Ref __iruid_833) (ApplyBinaryPrimOp Add (Ref __iruid_849) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_850 __iruid_851 (ToStream False (Ref __iruid_833)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_850) (GetField pksorted (Ref __iruid_851)))) (StreamFold __iruid_852 __iruid_853 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_833)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_852) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_833) (Ref __iruid_853)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_833) (ApplyBinaryPrimOp Add (Ref __iruid_853) (I32 1)))))))))) (sortedPartData (Ref __iruid_833)))) 2023-02-10 11:11:41 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: before: IR size 167: (Let __iruid_833 (ArraySort __iruid_834 __iruid_835 (Let __iruid_836 (CollectDistributedArray __iruid_837 __iruid_838 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (StreamAgg __iruid_839 (StreamAggScan __iruid_840 (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_837)) (MakeStruct (key (Ref __iruid_840)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (ApplyScanOp PrevNonnull () ((Ref __iruid_840)))))) (Let __iruid_841 (ApplyAggOp Count () ()) (AggLet __iruid_842 False (GetField key (Ref __iruid_839)) (MakeStruct (n (Ref __iruid_841)) (minkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_842) (Ref __iruid_842)))) (maxkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_842) (Ref __iruid_842)))) (ksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_839))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_839)) (GetField key (Ref __iruid_839))))))) (Ref __iruid_841))) (pksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_839)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_839))) (SelectFields (locus) (GetField key (Ref __iruid_839)))))))) (Ref __iruid_841))) (sample (ApplyAggOp TakeBy ((I32 20)) ((GetField key (Ref __iruid_839)) (GetField token (Ref __iruid_839)))))))))) (StreamMap __iruid_843 (StreamFilter __iruid_844 (StreamMap __iruid_845 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_836)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_836) (Ref __iruid_845)) None (i (Ref __iruid_845)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_844))) (I32 0))) (InsertFields (Ref __iruid_843) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_843)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_843)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_834)) (SelectFields (minkey maxkey) (Ref __iruid_835)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_846 __iruid_847 (ToStream False (Ref __iruid_833)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_846) (GetField ksorted (Ref __iruid_847)))) (StreamFold __iruid_848 __iruid_849 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_833)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_848) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_833) (Ref __iruid_849))) (GetField minkey (ArrayRef -1 (Ref __iruid_833) (ApplyBinaryPrimOp Add (Ref __iruid_849) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_850 __iruid_851 (ToStream False (Ref __iruid_833)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_850) (GetField pksorted (Ref __iruid_851)))) (StreamFold __iruid_852 __iruid_853 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_833)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_852) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_833) (Ref __iruid_853)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_833) (ApplyBinaryPrimOp Add (Ref __iruid_853) (I32 1)))))))))) (sortedPartData (Ref __iruid_833)))) 2023-02-10 11:11:41 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: after: IR size 167: (Let __iruid_896 (ArraySort __iruid_897 __iruid_898 (Let __iruid_899 (CollectDistributedArray __iruid_900 __iruid_901 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (StreamAgg __iruid_902 (StreamAggScan __iruid_903 (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_900)) (MakeStruct (key (Ref __iruid_903)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (ApplyScanOp PrevNonnull () ((Ref __iruid_903)))))) (Let __iruid_904 (ApplyAggOp Count () ()) (AggLet __iruid_905 False (GetField key (Ref __iruid_902)) (MakeStruct (n (Ref __iruid_904)) (minkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_905) (Ref __iruid_905)))) (maxkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_905) (Ref __iruid_905)))) (ksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_902))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_902)) (GetField key (Ref __iruid_902))))))) (Ref __iruid_904))) (pksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_902)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_902))) (SelectFields (locus) (GetField key (Ref __iruid_902)))))))) (Ref __iruid_904))) (sample (ApplyAggOp TakeBy ((I32 20)) ((GetField key (Ref __iruid_902)) (GetField token (Ref __iruid_902)))))))))) (StreamMap __iruid_906 (StreamFilter __iruid_907 (StreamMap __iruid_908 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_899)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_899) (Ref __iruid_908)) None (i (Ref __iruid_908)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_907))) (I32 0))) (InsertFields (Ref __iruid_906) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_906)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_906)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_897)) (SelectFields (minkey maxkey) (Ref __iruid_898)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_909 __iruid_910 (ToStream False (Ref __iruid_896)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_909) (GetField ksorted (Ref __iruid_910)))) (StreamFold __iruid_911 __iruid_912 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_896)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_911) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_896) (Ref __iruid_912))) (GetField minkey (ArrayRef -1 (Ref __iruid_896) (ApplyBinaryPrimOp Add (Ref __iruid_912) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_913 __iruid_914 (ToStream False (Ref __iruid_896)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_913) (GetField pksorted (Ref __iruid_914)))) (StreamFold __iruid_915 __iruid_916 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_896)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_915) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_896) (Ref __iruid_916)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_896) (ApplyBinaryPrimOp Add (Ref __iruid_916) (I32 1)))))))))) (sortedPartData (Ref __iruid_896)))) 2023-02-10 11:11:41 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: before: IR size 205: (Let __iruid_896 (ArraySort __iruid_897 __iruid_898 (Let __iruid_899 (CollectDistributedArray __iruid_900 __iruid_901 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (Let __iruid_918 (RunAgg ((TypedStateSig +PInt64) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}) (TypedStateSig +PInt64) (TypedStateSig +PInt64) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) (Begin (Begin (InitOp 0 (Count (TypedStateSig +PInt64)) ()) (InitOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((I32 1))) (InitOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((I32 1))) (InitOp 3 (Sum (TypedStateSig +PInt64)) ()) (InitOp 4 (Sum (TypedStateSig +PInt64)) ()) (InitOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) ((I32 20)))) (StreamFor __iruid_902 (RunAggScan __iruid_903 ( (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_900)) (Begin (InitOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ())) (Begin (SeqOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_903)))) (Let __iruid_917 (MakeTuple (0) (ResultOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})))) (MakeStruct (key (Ref __iruid_903)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (GetTupleElement 0 (Ref __iruid_917)))))) (Let __iruid_905 (GetField key (Ref __iruid_902)) (Begin (SeqOp 0 (Count (TypedStateSig +PInt64)) ()) (SeqOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_905) (Ref __iruid_905))) (SeqOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_905) (Ref __iruid_905))) (SeqOp 3 (Sum (TypedStateSig +PInt64)) ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_902))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_902)) (GetField key (Ref __iruid_902))))))) (SeqOp 4 (Sum (TypedStateSig +PInt64)) ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_902)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_902))) (SelectFields (locus) (GetField key (Ref __iruid_902)))))))) (SeqOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) ((GetField key (Ref __iruid_902)) (GetField token (Ref __iruid_902)))))))) (MakeTuple (0 1 2 3 4 5) (ResultOp 0 (Count (TypedStateSig +PInt64))) (ResultOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}))) (ResultOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}))) (ResultOp 3 (Sum (TypedStateSig +PInt64))) (ResultOp 4 (Sum (TypedStateSig +PInt64))) (ResultOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64))))) (Let __iruid_904 (GetTupleElement 0 (Ref __iruid_918)) (MakeStruct (n (Ref __iruid_904)) (minkey (GetTupleElement 1 (Ref __iruid_918))) (maxkey (GetTupleElement 2 (Ref __iruid_918))) (ksorted (ApplyComparisonOp EQ (GetTupleElement 3 (Ref __iruid_918)) (Ref __iruid_904))) (pksorted (ApplyComparisonOp EQ (GetTupleElement 4 (Ref __iruid_918)) (Ref __iruid_904))) (sample (GetTupleElement 5 (Ref __iruid_918))))))) (StreamMap __iruid_906 (StreamFilter __iruid_907 (StreamMap __iruid_908 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_899)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_899) (Ref __iruid_908)) None (i (Ref __iruid_908)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_907))) (I32 0))) (InsertFields (Ref __iruid_906) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_906)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_906)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_897)) (SelectFields (minkey maxkey) (Ref __iruid_898)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_909 __iruid_910 (ToStream False (Ref __iruid_896)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_909) (GetField ksorted (Ref __iruid_910)))) (StreamFold __iruid_911 __iruid_912 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_896)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_911) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_896) (Ref __iruid_912))) (GetField minkey (ArrayRef -1 (Ref __iruid_896) (ApplyBinaryPrimOp Add (Ref __iruid_912) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_913 __iruid_914 (ToStream False (Ref __iruid_896)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_913) (GetField pksorted (Ref __iruid_914)))) (StreamFold __iruid_915 __iruid_916 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_896)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_915) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_896) (Ref __iruid_916)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_896) (ApplyBinaryPrimOp Add (Ref __iruid_916) (I32 1)))))))))) (sortedPartData (Ref __iruid_896)))) 2023-02-10 11:11:42 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: after: IR size 205: (Let __iruid_965 (ArraySort __iruid_966 __iruid_967 (Let __iruid_968 (CollectDistributedArray __iruid_969 __iruid_970 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (Let __iruid_971 (RunAgg ((TypedStateSig +PInt64) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}) (TypedStateSig +PInt64) (TypedStateSig +PInt64) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) (Begin (Begin (InitOp 0 (Count (TypedStateSig +PInt64)) ()) (InitOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((I32 1))) (InitOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((I32 1))) (InitOp 3 (Sum (TypedStateSig +PInt64)) ()) (InitOp 4 (Sum (TypedStateSig +PInt64)) ()) (InitOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) ((I32 20)))) (StreamFor __iruid_972 (RunAggScan __iruid_973 ( (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_969)) (Begin (InitOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ())) (Begin (SeqOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_973)))) (Let __iruid_974 (MakeTuple (0) (ResultOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})))) (MakeStruct (key (Ref __iruid_973)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (GetTupleElement 0 (Ref __iruid_974)))))) (Let __iruid_975 (GetField key (Ref __iruid_972)) (Begin (SeqOp 0 (Count (TypedStateSig +PInt64)) ()) (SeqOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_975) (Ref __iruid_975))) (SeqOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_975) (Ref __iruid_975))) (SeqOp 3 (Sum (TypedStateSig +PInt64)) ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_972))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_972)) (GetField key (Ref __iruid_972))))))) (SeqOp 4 (Sum (TypedStateSig +PInt64)) ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_972)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_972))) (SelectFields (locus) (GetField key (Ref __iruid_972)))))))) (SeqOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) ((GetField key (Ref __iruid_972)) (GetField token (Ref __iruid_972)))))))) (MakeTuple (0 1 2 3 4 5) (ResultOp 0 (Count (TypedStateSig +PInt64))) (ResultOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}))) (ResultOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}))) (ResultOp 3 (Sum (TypedStateSig +PInt64))) (ResultOp 4 (Sum (TypedStateSig +PInt64))) (ResultOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64))))) (Let __iruid_976 (GetTupleElement 0 (Ref __iruid_971)) (MakeStruct (n (Ref __iruid_976)) (minkey (GetTupleElement 1 (Ref __iruid_971))) (maxkey (GetTupleElement 2 (Ref __iruid_971))) (ksorted (ApplyComparisonOp EQ (GetTupleElement 3 (Ref __iruid_971)) (Ref __iruid_976))) (pksorted (ApplyComparisonOp EQ (GetTupleElement 4 (Ref __iruid_971)) (Ref __iruid_976))) (sample (GetTupleElement 5 (Ref __iruid_971))))))) (StreamMap __iruid_977 (StreamFilter __iruid_978 (StreamMap __iruid_979 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_968)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_968) (Ref __iruid_979)) None (i (Ref __iruid_979)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_978))) (I32 0))) (InsertFields (Ref __iruid_977) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_977)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_977)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_966)) (SelectFields (minkey maxkey) (Ref __iruid_967)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_980 __iruid_981 (ToStream False (Ref __iruid_965)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_980) (GetField ksorted (Ref __iruid_981)))) (StreamFold __iruid_982 __iruid_983 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_965)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_982) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_965) (Ref __iruid_983))) (GetField minkey (ArrayRef -1 (Ref __iruid_965) (ApplyBinaryPrimOp Add (Ref __iruid_983) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_984 __iruid_985 (ToStream False (Ref __iruid_965)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_984) (GetField pksorted (Ref __iruid_985)))) (StreamFold __iruid_986 __iruid_987 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_965)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_986) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_965) (Ref __iruid_987)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_965) (ApplyBinaryPrimOp Add (Ref __iruid_987) (I32 1)))))))))) (sortedPartData (Ref __iruid_965)))) 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C450HailClassLoaderContainer. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C450HailClassLoaderContainer. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C451FSContainer. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C451FSContainer. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C452collect_distributed_array. 2023-02-10 11:11:42 root: INFO: instruction count: 150: __C452collect_distributed_array.apply 2023-02-10 11:11:42 root: INFO: instruction count: 17: __C452collect_distributed_array.apply 2023-02-10 11:11:42 root: INFO: instruction count: 27: __C452collect_distributed_array.__m453DECODE_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND_TO_SBaseStructPointer 2023-02-10 11:11:42 root: INFO: instruction count: 53: __C452collect_distributed_array.__m454INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:42 root: INFO: instruction count: 10: __C452collect_distributed_array.__m455INPLACE_DECODE_r_int32_TO_r_int32 2023-02-10 11:11:42 root: INFO: instruction count: 31: __C452collect_distributed_array.__m456INPLACE_DECODE_r_binary_TO_r_string 2023-02-10 11:11:42 root: INFO: instruction count: 10: __C452collect_distributed_array.__m457INPLACE_DECODE_r_int64_TO_r_int64 2023-02-10 11:11:42 root: INFO: instruction count: 10: __C452collect_distributed_array.__m458INPLACE_DECODE_r_bool_TO_r_bool 2023-02-10 11:11:42 root: INFO: instruction count: 27: __C452collect_distributed_array.__m460DECODE_r_struct_of_r_struct_of_ENDEND_TO_SBaseStructPointer 2023-02-10 11:11:42 root: INFO: instruction count: 8: __C452collect_distributed_array.__m461INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-02-10 11:11:42 root: INFO: instruction count: 323: __C452collect_distributed_array.__m463split_Let 2023-02-10 11:11:42 root: INFO: instruction count: 17: __C452collect_distributed_array.__m481i_gt_j 2023-02-10 11:11:42 root: INFO: instruction count: 71: __C452collect_distributed_array.__m482ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C452collect_distributed_array.__m483ord_compare 2023-02-10 11:11:42 root: INFO: instruction count: 163: __C452collect_distributed_array.__m484ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 15: __C452collect_distributed_array.__m485ord_compare 2023-02-10 11:11:42 root: INFO: instruction count: 74: __C452collect_distributed_array.__m486ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 9: __C452collect_distributed_array.__m488ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 89: __C452collect_distributed_array.__m489ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 15: __C452collect_distributed_array.__m490ord_compare 2023-02-10 11:11:42 root: INFO: instruction count: 82: __C452collect_distributed_array.__m491ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C452collect_distributed_array.__m492ord_compare 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C452collect_distributed_array.__m493ord_compare 2023-02-10 11:11:42 root: INFO: instruction count: 8: __C452collect_distributed_array.__m494ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 18: __C452collect_distributed_array.__m495swap 2023-02-10 11:11:42 root: INFO: instruction count: 74: __C452collect_distributed_array.__m496rebalance_up 2023-02-10 11:11:42 root: INFO: instruction count: 150: __C452collect_distributed_array.__m497rebalance_down 2023-02-10 11:11:42 root: INFO: instruction count: 17: __C452collect_distributed_array.__m510i_gt_j 2023-02-10 11:11:42 root: INFO: instruction count: 18: __C452collect_distributed_array.__m511swap 2023-02-10 11:11:42 root: INFO: instruction count: 74: __C452collect_distributed_array.__m512rebalance_up 2023-02-10 11:11:42 root: INFO: instruction count: 150: __C452collect_distributed_array.__m513rebalance_down 2023-02-10 11:11:42 root: INFO: instruction count: 17: __C452collect_distributed_array.__m528i_gt_j 2023-02-10 11:11:42 root: INFO: instruction count: 79: __C452collect_distributed_array.__m529ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C452collect_distributed_array.__m530ord_compare 2023-02-10 11:11:42 root: INFO: instruction count: 8: __C452collect_distributed_array.__m531ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 18: __C452collect_distributed_array.__m532swap 2023-02-10 11:11:42 root: INFO: instruction count: 74: __C452collect_distributed_array.__m533rebalance_up 2023-02-10 11:11:42 root: INFO: instruction count: 150: __C452collect_distributed_array.__m534rebalance_down 2023-02-10 11:11:42 root: INFO: instruction count: 9: __C452collect_distributed_array.__m535begin_group_0 2023-02-10 11:11:42 root: INFO: instruction count: 403: __C452collect_distributed_array.__m536begin_group_0 2023-02-10 11:11:42 root: INFO: instruction count: 205: __C452collect_distributed_array.__m537split_StreamFor 2023-02-10 11:11:42 root: INFO: instruction count: 12: __C452collect_distributed_array.__m545setup_null 2023-02-10 11:11:42 root: INFO: instruction count: 216: __C452collect_distributed_array.__m557begin_group_0 2023-02-10 11:11:42 root: INFO: instruction count: 18: __C452collect_distributed_array.__m558begin_group_0 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C452collect_distributed_array.setObjects 2023-02-10 11:11:42 root: INFO: instruction count: 5: __C452collect_distributed_array.__m565split_Begin 2023-02-10 11:11:42 root: INFO: instruction count: 267: __C452collect_distributed_array.__m567begin_group_0 2023-02-10 11:11:42 root: INFO: instruction count: 827: __C452collect_distributed_array.__m568take_by_seqop 2023-02-10 11:11:42 root: INFO: instruction count: 120: __C452collect_distributed_array.__m570take_by_garbage_collect 2023-02-10 11:11:42 root: INFO: instruction count: 827: __C452collect_distributed_array.__m571take_by_seqop 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C452collect_distributed_array.__m573ord_compare 2023-02-10 11:11:42 root: INFO: instruction count: 163: __C452collect_distributed_array.__m574ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 120: __C452collect_distributed_array.__m575take_by_garbage_collect 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C452collect_distributed_array.__m576ord_lteq 2023-02-10 11:11:42 root: INFO: instruction count: 212: __C452collect_distributed_array.__m577ord_lteqNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 15: __C452collect_distributed_array.__m578ord_lteq 2023-02-10 11:11:42 root: INFO: instruction count: 25: __C452collect_distributed_array.__m579ord_lteqNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 15: __C452collect_distributed_array.__m580ord_equiv 2023-02-10 11:11:42 root: INFO: instruction count: 25: __C452collect_distributed_array.__m581ord_equivNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 15: __C452collect_distributed_array.__m582ord_lteq 2023-02-10 11:11:42 root: INFO: instruction count: 99: __C452collect_distributed_array.__m583ord_lteqNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C452collect_distributed_array.__m584ord_lteq 2023-02-10 11:11:42 root: INFO: instruction count: 21: __C452collect_distributed_array.__m585ord_lteqNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C452collect_distributed_array.__m586ord_equiv 2023-02-10 11:11:42 root: INFO: instruction count: 21: __C452collect_distributed_array.__m587ord_equivNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 15: __C452collect_distributed_array.__m588ord_equiv 2023-02-10 11:11:42 root: INFO: instruction count: 81: __C452collect_distributed_array.__m589ord_equivNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 5: __C452collect_distributed_array.__m590toInt64 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C452collect_distributed_array.__m593ord_lteq 2023-02-10 11:11:42 root: INFO: instruction count: 108: __C452collect_distributed_array.__m594ord_lteqNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 370: __C452collect_distributed_array.__m597take_by_seqop 2023-02-10 11:11:42 root: INFO: instruction count: 390: __C452collect_distributed_array.__m599take_by_garbage_collect 2023-02-10 11:11:42 root: INFO: instruction count: 355: __C452collect_distributed_array.__m600take_by_result 2023-02-10 11:11:42 root: INFO: instruction count: 28: __C452collect_distributed_array.__m601result_quicksort 2023-02-10 11:11:42 root: INFO: instruction count: 19: __C452collect_distributed_array.__m602quicksort_swap 2023-02-10 11:11:42 root: INFO: instruction count: 193: __C452collect_distributed_array.__m603quicksort_partition 2023-02-10 11:11:42 root: INFO: instruction count: 355: __C452collect_distributed_array.__m604take_by_result 2023-02-10 11:11:42 root: INFO: instruction count: 28: __C452collect_distributed_array.__m605result_quicksort 2023-02-10 11:11:42 root: INFO: instruction count: 19: __C452collect_distributed_array.__m606quicksort_swap 2023-02-10 11:11:42 root: INFO: instruction count: 193: __C452collect_distributed_array.__m607quicksort_partition 2023-02-10 11:11:42 root: INFO: instruction count: 355: __C452collect_distributed_array.__m608take_by_result 2023-02-10 11:11:42 root: INFO: instruction count: 28: __C452collect_distributed_array.__m609result_quicksort 2023-02-10 11:11:42 root: INFO: instruction count: 19: __C452collect_distributed_array.__m610quicksort_swap 2023-02-10 11:11:42 root: INFO: instruction count: 193: __C452collect_distributed_array.__m611quicksort_partition 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C452collect_distributed_array.__m637ord_equiv 2023-02-10 11:11:42 root: INFO: instruction count: 16: __C452collect_distributed_array.__m638ord_equivNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 9: __C452collect_distributed_array.__m651ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDENDEND 2023-02-10 11:11:42 root: INFO: instruction count: 109: __C452collect_distributed_array.__m652ENCODE_SBaseStructPointer_TO_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDEND 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C452collect_distributed_array.__m653ENCODE_SInt64$_TO_r_int64 2023-02-10 11:11:42 root: INFO: instruction count: 35: __C452collect_distributed_array.__m654ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND 2023-02-10 11:11:42 root: INFO: instruction count: 51: __C452collect_distributed_array.__m655ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND 2023-02-10 11:11:42 root: INFO: instruction count: 25: __C452collect_distributed_array.__m656ENCODE_SCanonicalLocusPointer_TO_r_struct_of_r_binaryANDr_int32END 2023-02-10 11:11:42 root: INFO: instruction count: 16: __C452collect_distributed_array.__m657ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C452collect_distributed_array.__m658ENCODE_SInt32$_TO_r_int32 2023-02-10 11:11:42 root: INFO: instruction count: 39: __C452collect_distributed_array.__m659ENCODE_SIndexablePointer_TO_r_array_of_r_binary 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C452collect_distributed_array.__m660ENCODE_SBoolean$_TO_r_bool 2023-02-10 11:11:42 root: INFO: instruction count: 21: __C452collect_distributed_array.setPartitionIndex 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C452collect_distributed_array.addPartitionRegion 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C452collect_distributed_array.setPool 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C452collect_distributed_array.addHailClassLoader 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C452collect_distributed_array.addFS 2023-02-10 11:11:42 root: INFO: instruction count: 43: __C452collect_distributed_array.addReferenceGenomes 2023-02-10 11:11:42 root: INFO: instruction count: 379: __C452collect_distributed_array.__m463split_Let_region12_17 2023-02-10 11:11:42 root: INFO: instruction count: 322: __C452collect_distributed_array.__m537split_StreamFor_region6_21 2023-02-10 11:11:42 root: INFO: instruction count: 273: __C452collect_distributed_array.__m568take_by_seqop_region15_17 2023-02-10 11:11:42 root: INFO: instruction count: 238: __C452collect_distributed_array.__m568take_by_seqop_region3_3 2023-02-10 11:11:42 root: INFO: instruction count: 521: __C452collect_distributed_array.__m570take_by_garbage_collect_region2_12 2023-02-10 11:11:42 root: INFO: instruction count: 273: __C452collect_distributed_array.__m571take_by_seqop_region15_17 2023-02-10 11:11:42 root: INFO: instruction count: 238: __C452collect_distributed_array.__m571take_by_seqop_region3_3 2023-02-10 11:11:42 root: INFO: instruction count: 521: __C452collect_distributed_array.__m575take_by_garbage_collect_region2_12 2023-02-10 11:11:42 root: INFO: instruction count: 261: __C452collect_distributed_array.__m597take_by_seqop_region9_11 2023-02-10 11:11:42 root: INFO: instruction count: 253: __C452collect_distributed_array.__m597take_by_seqop_region3_5 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C663__m463split_LetSpills. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C666__m537split_StreamForSpills. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C671__m568take_by_seqopSpills. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C686__m570take_by_garbage_collectSpills. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C692__m571take_by_seqopSpills. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C707__m575take_by_garbage_collectSpills. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C713__m597take_by_seqopSpills. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C487RGContainer_GRCh38. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C487RGContainer_GRCh38. 2023-02-10 11:11:42 root: INFO: encoder cache hit 2023-02-10 11:11:42 MemoryStore: INFO: Block broadcast_5 stored as values in memory (estimated size 11.2 KiB, free 79.8 GiB) 2023-02-10 11:11:42 MemoryStore: INFO: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.6 KiB, free 79.8 GiB) 2023-02-10 11:11:42 BlockManagerInfo: INFO: Added broadcast_5_piece0 in memory on 163.152.180.157:46313 (size: 2.6 KiB, free: 79.8 GiB) 2023-02-10 11:11:42 SparkContext: INFO: Created broadcast 5 from broadcast at SparkBackend.scala:280 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C438HailClassLoaderContainer. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C438HailClassLoaderContainer. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C439FSContainer. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C439FSContainer. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C440Compiled. 2023-02-10 11:11:42 root: INFO: instruction count: 519: __C440Compiled.apply 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C440Compiled.setBackend 2023-02-10 11:11:42 root: INFO: instruction count: 9: __C440Compiled.__m731ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND 2023-02-10 11:11:42 root: INFO: instruction count: 61: __C440Compiled.__m732ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C440Compiled.__m733ENCODE_SInt32$_TO_r_int32 2023-02-10 11:11:42 root: INFO: instruction count: 16: __C440Compiled.__m734ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C440Compiled.__m735ENCODE_SInt64$_TO_r_int64 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C440Compiled.__m736ENCODE_SBoolean$_TO_r_bool 2023-02-10 11:11:42 root: INFO: instruction count: 9: __C440Compiled.__m737ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_ENDEND 2023-02-10 11:11:42 root: INFO: instruction count: 1: __C440Compiled.__m738ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C440Compiled.setObjects 2023-02-10 11:11:42 root: INFO: instruction count: 27: __C440Compiled.__m740DECODE_r_struct_of_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDENDEND_TO_SBaseStructPointer 2023-02-10 11:11:42 root: INFO: instruction count: 62: __C440Compiled.__m741INPLACE_DECODE_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDEND_TO_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_locusANDr_array_of_r_stringENDANDr_array_of_r_struct_of_r_locusANDr_array_of_r_stringENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_locusANDr_array_of_r_stringENDEND 2023-02-10 11:11:42 root: INFO: instruction count: 10: __C440Compiled.__m742INPLACE_DECODE_r_int64_TO_r_int64 2023-02-10 11:11:42 root: INFO: instruction count: 58: __C440Compiled.__m743INPLACE_DECODE_r_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND_TO_r_array_of_r_struct_of_r_locusANDr_array_of_r_stringEND 2023-02-10 11:11:42 root: INFO: instruction count: 26: __C440Compiled.__m744INPLACE_DECODE_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND_TO_r_struct_of_r_locusANDr_array_of_r_stringEND 2023-02-10 11:11:42 root: INFO: instruction count: 26: __C440Compiled.__m745INPLACE_DECODE_r_struct_of_r_binaryANDr_int32END_TO_r_locus 2023-02-10 11:11:42 root: INFO: instruction count: 31: __C440Compiled.__m746INPLACE_DECODE_r_binary_TO_r_string 2023-02-10 11:11:42 root: INFO: instruction count: 10: __C440Compiled.__m747INPLACE_DECODE_r_int32_TO_r_int32 2023-02-10 11:11:42 root: INFO: instruction count: 58: __C440Compiled.__m748INPLACE_DECODE_r_array_of_r_binary_TO_r_array_of_r_string 2023-02-10 11:11:42 root: INFO: instruction count: 10: __C440Compiled.__m749INPLACE_DECODE_r_bool_TO_r_bool 2023-02-10 11:11:42 root: INFO: instruction count: 35: __C440Compiled.__m758arrayref_bounds_check 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C440Compiled.__m762ord_gt 2023-02-10 11:11:42 root: INFO: instruction count: 14: __C440Compiled.__m763ord_gtNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 12: __C440Compiled.__m768setup_jab 2023-02-10 11:11:42 root: INFO: instruction count: 31: __C440Compiled.__m771dependent_sorting_func 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C440Compiled.__m774ord_lt 2023-02-10 11:11:42 root: INFO: instruction count: 91: __C440Compiled.__m775ord_ltNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C440Compiled.__m776ord_lt 2023-02-10 11:11:42 root: INFO: instruction count: 215: __C440Compiled.__m777ord_ltNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 15: __C440Compiled.__m778ord_lt 2023-02-10 11:11:42 root: INFO: instruction count: 25: __C440Compiled.__m779ord_ltNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 74: __C440Compiled.__m780ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 9: __C440Compiled.__m782ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 89: __C440Compiled.__m783ord_compareNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 15: __C440Compiled.__m784ord_equiv 2023-02-10 11:11:42 root: INFO: instruction count: 25: __C440Compiled.__m785ord_equivNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 15: __C440Compiled.__m786ord_lt 2023-02-10 11:11:42 root: INFO: instruction count: 102: __C440Compiled.__m787ord_ltNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C440Compiled.__m788ord_lt 2023-02-10 11:11:42 root: INFO: instruction count: 21: __C440Compiled.__m789ord_ltNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C440Compiled.__m790ord_equiv 2023-02-10 11:11:42 root: INFO: instruction count: 21: __C440Compiled.__m791ord_equivNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 15: __C440Compiled.__m792ord_equiv 2023-02-10 11:11:42 root: INFO: instruction count: 81: __C440Compiled.__m793ord_equivNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C440Compiled.__m794ord_equiv 2023-02-10 11:11:42 root: INFO: instruction count: 162: __C440Compiled.__m795ord_equivNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 202: __C440Compiled.__m796arraySorter_outer 2023-02-10 11:11:42 root: INFO: instruction count: 66: __C440Compiled.__m797arraySorter_merge 2023-02-10 11:11:42 root: INFO: instruction count: 36: __C440Compiled.__m798arraySorter_splitMerge 2023-02-10 11:11:42 root: INFO: instruction count: 79: __C440Compiled.__m803split_StreamFold 2023-02-10 11:11:42 root: INFO: instruction count: 146: __C440Compiled.__m813split_StreamFold 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C440Compiled.__m821ord_lteq 2023-02-10 11:11:42 root: INFO: instruction count: 212: __C440Compiled.__m822ord_lteqNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 15: __C440Compiled.__m823ord_lteq 2023-02-10 11:11:42 root: INFO: instruction count: 25: __C440Compiled.__m824ord_lteqNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 15: __C440Compiled.__m825ord_lteq 2023-02-10 11:11:42 root: INFO: instruction count: 99: __C440Compiled.__m826ord_lteqNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C440Compiled.__m827ord_lteq 2023-02-10 11:11:42 root: INFO: instruction count: 21: __C440Compiled.__m828ord_lteqNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 79: __C440Compiled.__m830split_StreamFold 2023-02-10 11:11:42 root: INFO: instruction count: 146: __C440Compiled.__m840split_StreamFold 2023-02-10 11:11:42 root: INFO: instruction count: 11: __C440Compiled.__m848ord_lteq 2023-02-10 11:11:42 root: INFO: instruction count: 108: __C440Compiled.__m849ord_lteqNonnull 2023-02-10 11:11:42 root: INFO: instruction count: 9: __C440Compiled.setPartitionIndex 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C440Compiled.addPartitionRegion 2023-02-10 11:11:42 root: INFO: instruction count: 4: __C440Compiled.setPool 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C440Compiled.addHailClassLoader 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C440Compiled.addFS 2023-02-10 11:11:42 root: INFO: instruction count: 43: __C440Compiled.addReferenceGenomes 2023-02-10 11:11:42 root: INFO: instruction count: 62: __C440Compiled.addLiterals 2023-02-10 11:11:42 root: INFO: instruction count: 36: __C440Compiled.__m854DECODE_r_struct_of_r_struct_of_ENDANDr_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND_TO_SBaseStructPointer 2023-02-10 11:11:42 root: INFO: instruction count: 8: __C440Compiled.__m855INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-02-10 11:11:42 root: INFO: instruction count: 58: __C440Compiled.__m856INPLACE_DECODE_r_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_array_of_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:42 root: INFO: instruction count: 53: __C440Compiled.__m857INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:42 root: INFO: instruction count: 331: __C440Compiled.apply_region14_22 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C858applySpills. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C781RGContainer_GRCh38. 2023-02-10 11:11:42 root: INFO: instruction count: 3: __C781RGContainer_GRCh38. 2023-02-10 11:11:42 MemoryStore: INFO: Block broadcast_6 stored as values in memory (estimated size 64.0 B, free 79.8 GiB) 2023-02-10 11:11:42 MemoryStore: INFO: Block broadcast_6_piece0 stored as bytes in memory (estimated size 49.0 B, free 79.8 GiB) 2023-02-10 11:11:42 BlockManagerInfo: INFO: Added broadcast_6_piece0 in memory on 163.152.180.157:46313 (size: 49.0 B, free: 79.8 GiB) 2023-02-10 11:11:42 SparkContext: INFO: Created broadcast 6 from broadcast at SparkBackend.scala:280 2023-02-10 11:11:42 SparkContext: INFO: Starting job: collect at SparkBackend.scala:288 2023-02-10 11:11:42 DAGScheduler: INFO: Got job 1 (collect at SparkBackend.scala:288) with 144 output partitions 2023-02-10 11:11:42 DAGScheduler: INFO: Final stage: ResultStage 1 (collect at SparkBackend.scala:288) 2023-02-10 11:11:42 DAGScheduler: INFO: Parents of final stage: List() 2023-02-10 11:11:42 DAGScheduler: INFO: Missing parents: List() 2023-02-10 11:11:42 DAGScheduler: INFO: Submitting ResultStage 1 (SparkBackendComputeRDD[1] at RDD at SparkBackend.scala:720), which has no missing parents 2023-02-10 11:11:42 MemoryStore: INFO: Block broadcast_7 stored as values in memory (estimated size 411.8 KiB, free 79.8 GiB) 2023-02-10 11:11:42 MemoryStore: INFO: Block broadcast_7_piece0 stored as bytes in memory (estimated size 198.9 KiB, free 79.8 GiB) 2023-02-10 11:11:42 BlockManagerInfo: INFO: Added broadcast_7_piece0 in memory on 163.152.180.157:46313 (size: 198.9 KiB, free: 79.8 GiB) 2023-02-10 11:11:42 SparkContext: INFO: Created broadcast 7 from broadcast at DAGScheduler.scala:1433 2023-02-10 11:11:42 DAGScheduler: INFO: Submitting 144 missing tasks from ResultStage 1 (SparkBackendComputeRDD[1] at RDD at SparkBackend.scala:720) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)) 2023-02-10 11:11:42 TaskSchedulerImpl: INFO: Adding task set 1.0 with 144 tasks resource profile 0 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 0.0 in stage 1.0 (TID 144) (163.152.180.157, executor driver, partition 0, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 1.0 in stage 1.0 (TID 145) (163.152.180.157, executor driver, partition 1, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 2.0 in stage 1.0 (TID 146) (163.152.180.157, executor driver, partition 2, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 3.0 in stage 1.0 (TID 147) (163.152.180.157, executor driver, partition 3, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 4.0 in stage 1.0 (TID 148) (163.152.180.157, executor driver, partition 4, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 5.0 in stage 1.0 (TID 149) (163.152.180.157, executor driver, partition 5, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 6.0 in stage 1.0 (TID 150) (163.152.180.157, executor driver, partition 6, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 7.0 in stage 1.0 (TID 151) (163.152.180.157, executor driver, partition 7, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 8.0 in stage 1.0 (TID 152) (163.152.180.157, executor driver, partition 8, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 9.0 in stage 1.0 (TID 153) (163.152.180.157, executor driver, partition 9, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 10.0 in stage 1.0 (TID 154) (163.152.180.157, executor driver, partition 10, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 11.0 in stage 1.0 (TID 155) (163.152.180.157, executor driver, partition 11, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 12.0 in stage 1.0 (TID 156) (163.152.180.157, executor driver, partition 12, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 13.0 in stage 1.0 (TID 157) (163.152.180.157, executor driver, partition 13, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 14.0 in stage 1.0 (TID 158) (163.152.180.157, executor driver, partition 14, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 15.0 in stage 1.0 (TID 159) (163.152.180.157, executor driver, partition 15, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 16.0 in stage 1.0 (TID 160) (163.152.180.157, executor driver, partition 16, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 17.0 in stage 1.0 (TID 161) (163.152.180.157, executor driver, partition 17, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 18.0 in stage 1.0 (TID 162) (163.152.180.157, executor driver, partition 18, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 19.0 in stage 1.0 (TID 163) (163.152.180.157, executor driver, partition 19, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 20.0 in stage 1.0 (TID 164) (163.152.180.157, executor driver, partition 20, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 21.0 in stage 1.0 (TID 165) (163.152.180.157, executor driver, partition 21, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 22.0 in stage 1.0 (TID 166) (163.152.180.157, executor driver, partition 22, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 23.0 in stage 1.0 (TID 167) (163.152.180.157, executor driver, partition 23, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 24.0 in stage 1.0 (TID 168) (163.152.180.157, executor driver, partition 24, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 25.0 in stage 1.0 (TID 169) (163.152.180.157, executor driver, partition 25, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 26.0 in stage 1.0 (TID 170) (163.152.180.157, executor driver, partition 26, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 27.0 in stage 1.0 (TID 171) (163.152.180.157, executor driver, partition 27, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 28.0 in stage 1.0 (TID 172) (163.152.180.157, executor driver, partition 28, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 29.0 in stage 1.0 (TID 173) (163.152.180.157, executor driver, partition 29, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 30.0 in stage 1.0 (TID 174) (163.152.180.157, executor driver, partition 30, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 31.0 in stage 1.0 (TID 175) (163.152.180.157, executor driver, partition 31, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 32.0 in stage 1.0 (TID 176) (163.152.180.157, executor driver, partition 32, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 33.0 in stage 1.0 (TID 177) (163.152.180.157, executor driver, partition 33, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 34.0 in stage 1.0 (TID 178) (163.152.180.157, executor driver, partition 34, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 35.0 in stage 1.0 (TID 179) (163.152.180.157, executor driver, partition 35, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 36.0 in stage 1.0 (TID 180) (163.152.180.157, executor driver, partition 36, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 37.0 in stage 1.0 (TID 181) (163.152.180.157, executor driver, partition 37, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 38.0 in stage 1.0 (TID 182) (163.152.180.157, executor driver, partition 38, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 TaskSetManager: INFO: Starting task 39.0 in stage 1.0 (TID 183) (163.152.180.157, executor driver, partition 39, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:42 Executor: INFO: Running task 0.0 in stage 1.0 (TID 144) 2023-02-10 11:11:42 Executor: INFO: Running task 3.0 in stage 1.0 (TID 147) 2023-02-10 11:11:42 Executor: INFO: Running task 2.0 in stage 1.0 (TID 146) 2023-02-10 11:11:42 Executor: INFO: Running task 1.0 in stage 1.0 (TID 145) 2023-02-10 11:11:42 Executor: INFO: Running task 5.0 in stage 1.0 (TID 149) 2023-02-10 11:11:42 Executor: INFO: Running task 8.0 in stage 1.0 (TID 152) 2023-02-10 11:11:42 Executor: INFO: Running task 10.0 in stage 1.0 (TID 154) 2023-02-10 11:11:42 Executor: INFO: Running task 9.0 in stage 1.0 (TID 153) 2023-02-10 11:11:42 Executor: INFO: Running task 13.0 in stage 1.0 (TID 157) 2023-02-10 11:11:42 Executor: INFO: Running task 11.0 in stage 1.0 (TID 155) 2023-02-10 11:11:42 Executor: INFO: Running task 16.0 in stage 1.0 (TID 160) 2023-02-10 11:11:42 Executor: INFO: Running task 4.0 in stage 1.0 (TID 148) 2023-02-10 11:11:42 Executor: INFO: Running task 6.0 in stage 1.0 (TID 150) 2023-02-10 11:11:42 Executor: INFO: Running task 22.0 in stage 1.0 (TID 166) 2023-02-10 11:11:42 Executor: INFO: Running task 19.0 in stage 1.0 (TID 163) 2023-02-10 11:11:42 Executor: INFO: Running task 24.0 in stage 1.0 (TID 168) 2023-02-10 11:11:42 Executor: INFO: Running task 20.0 in stage 1.0 (TID 164) 2023-02-10 11:11:42 Executor: INFO: Running task 18.0 in stage 1.0 (TID 162) 2023-02-10 11:11:42 Executor: INFO: Running task 27.0 in stage 1.0 (TID 171) 2023-02-10 11:11:42 Executor: INFO: Running task 15.0 in stage 1.0 (TID 159) 2023-02-10 11:11:42 Executor: INFO: Running task 7.0 in stage 1.0 (TID 151) 2023-02-10 11:11:42 Executor: INFO: Running task 12.0 in stage 1.0 (TID 156) 2023-02-10 11:11:42 Executor: INFO: Running task 17.0 in stage 1.0 (TID 161) 2023-02-10 11:11:42 Executor: INFO: Running task 14.0 in stage 1.0 (TID 158) 2023-02-10 11:11:42 Executor: INFO: Running task 28.0 in stage 1.0 (TID 172) 2023-02-10 11:11:42 Executor: INFO: Running task 25.0 in stage 1.0 (TID 169) 2023-02-10 11:11:42 Executor: INFO: Running task 31.0 in stage 1.0 (TID 175) 2023-02-10 11:11:42 Executor: INFO: Running task 32.0 in stage 1.0 (TID 176) 2023-02-10 11:11:42 Executor: INFO: Running task 33.0 in stage 1.0 (TID 177) 2023-02-10 11:11:42 Executor: INFO: Running task 29.0 in stage 1.0 (TID 173) 2023-02-10 11:11:42 Executor: INFO: Running task 35.0 in stage 1.0 (TID 179) 2023-02-10 11:11:42 Executor: INFO: Running task 38.0 in stage 1.0 (TID 182) 2023-02-10 11:11:42 Executor: INFO: Running task 26.0 in stage 1.0 (TID 170) 2023-02-10 11:11:42 Executor: INFO: Running task 21.0 in stage 1.0 (TID 165) 2023-02-10 11:11:42 Executor: INFO: Running task 23.0 in stage 1.0 (TID 167) 2023-02-10 11:11:42 Executor: INFO: Running task 34.0 in stage 1.0 (TID 178) 2023-02-10 11:11:42 Executor: INFO: Running task 39.0 in stage 1.0 (TID 183) 2023-02-10 11:11:42 Executor: INFO: Running task 36.0 in stage 1.0 (TID 180) 2023-02-10 11:11:42 Executor: INFO: Running task 37.0 in stage 1.0 (TID 181) 2023-02-10 11:11:42 Executor: INFO: Running task 30.0 in stage 1.0 (TID 174) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 2.0 in stage 1.0 (TID 146) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 20.0 in stage 1.0 (TID 164) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 123: Executor task launch worker for task 25.0 in stage 1.0 (TID 169) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 14.0 in stage 1.0 (TID 158) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 21.0 in stage 1.0 (TID 165) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 129: Executor task launch worker for task 6.0 in stage 1.0 (TID 150) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 158: Executor task launch worker for task 33.0 in stage 1.0 (TID 177) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 31.0 in stage 1.0 (TID 175) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 12.0 in stage 1.0 (TID 156) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 8.0 in stage 1.0 (TID 152) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 10.0 in stage 1.0 (TID 154) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 7.0 in stage 1.0 (TID 151) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 16.0 in stage 1.0 (TID 160) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 22.0 in stage 1.0 (TID 166) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 37.0 in stage 1.0 (TID 181) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 149: Executor task launch worker for task 24.0 in stage 1.0 (TID 168) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 18.0 in stage 1.0 (TID 162) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 19.0 in stage 1.0 (TID 163) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 23.0 in stage 1.0 (TID 167) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 30.0 in stage 1.0 (TID 174) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 121: Executor task launch worker for task 35.0 in stage 1.0 (TID 179) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 13.0 in stage 1.0 (TID 157) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 1.0 in stage 1.0 (TID 145) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 4.0 in stage 1.0 (TID 148) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 138: Executor task launch worker for task 27.0 in stage 1.0 (TID 171) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 36.0 in stage 1.0 (TID 180) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 17.0 in stage 1.0 (TID 161) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 3.0 in stage 1.0 (TID 147) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 26.0 in stage 1.0 (TID 170) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 5.0 in stage 1.0 (TID 149) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 0.0 in stage 1.0 (TID 144) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 125: Executor task launch worker for task 34.0 in stage 1.0 (TID 178) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 9.0 in stage 1.0 (TID 153) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 11.0 in stage 1.0 (TID 155) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 39.0 in stage 1.0 (TID 183) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 15.0 in stage 1.0 (TID 159) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 38.0 in stage 1.0 (TID 182) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 28.0 in stage 1.0 (TID 172) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 32.0 in stage 1.0 (TID 176) 2023-02-10 11:11:42 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 29.0 in stage 1.0 (TID 173) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 122: Executor task launch worker for task 37.0 in stage 1.0 (TID 181) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 115: Executor task launch worker for task 21.0 in stage 1.0 (TID 165) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 114: Executor task launch worker for task 8.0 in stage 1.0 (TID 152) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 123: Executor task launch worker for task 25.0 in stage 1.0 (TID 169) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 144: Executor task launch worker for task 15.0 in stage 1.0 (TID 159) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 141: Executor task launch worker for task 39.0 in stage 1.0 (TID 183) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 134: Executor task launch worker for task 20.0 in stage 1.0 (TID 164) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 121: Executor task launch worker for task 35.0 in stage 1.0 (TID 179) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 149: Executor task launch worker for task 24.0 in stage 1.0 (TID 168) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 150: Executor task launch worker for task 19.0 in stage 1.0 (TID 163) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 140: Executor task launch worker for task 14.0 in stage 1.0 (TID 158) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 148: Executor task launch worker for task 2.0 in stage 1.0 (TID 146) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 128: Executor task launch worker for task 3.0 in stage 1.0 (TID 147) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 158: Executor task launch worker for task 33.0 in stage 1.0 (TID 177) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 133: Executor task launch worker for task 17.0 in stage 1.0 (TID 161) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 126: Executor task launch worker for task 32.0 in stage 1.0 (TID 176) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 145: Executor task launch worker for task 9.0 in stage 1.0 (TID 153) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 118: Executor task launch worker for task 29.0 in stage 1.0 (TID 173) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 132: Executor task launch worker for task 13.0 in stage 1.0 (TID 157) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 137: Executor task launch worker for task 4.0 in stage 1.0 (TID 148) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 153: Executor task launch worker for task 23.0 in stage 1.0 (TID 167) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 116: Executor task launch worker for task 30.0 in stage 1.0 (TID 174) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 138: Executor task launch worker for task 27.0 in stage 1.0 (TID 171) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 139: Executor task launch worker for task 26.0 in stage 1.0 (TID 170) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 124: Executor task launch worker for task 18.0 in stage 1.0 (TID 162) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 130: Executor task launch worker for task 31.0 in stage 1.0 (TID 175) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 129: Executor task launch worker for task 6.0 in stage 1.0 (TID 150) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 117: Executor task launch worker for task 0.0 in stage 1.0 (TID 144) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 143: Executor task launch worker for task 11.0 in stage 1.0 (TID 155) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 152: Executor task launch worker for task 7.0 in stage 1.0 (TID 151) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 119: Executor task launch worker for task 12.0 in stage 1.0 (TID 156) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 146: Executor task launch worker for task 10.0 in stage 1.0 (TID 154) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 147: Executor task launch worker for task 38.0 in stage 1.0 (TID 182) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 131: Executor task launch worker for task 1.0 in stage 1.0 (TID 145) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 142: Executor task launch worker for task 28.0 in stage 1.0 (TID 172) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 151: Executor task launch worker for task 5.0 in stage 1.0 (TID 149) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 136: Executor task launch worker for task 36.0 in stage 1.0 (TID 180) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 125: Executor task launch worker for task 34.0 in stage 1.0 (TID 178) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 120: Executor task launch worker for task 16.0 in stage 1.0 (TID 160) 2023-02-10 11:11:42 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 159: Executor task launch worker for task 22.0 in stage 1.0 (TID 166) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=26, attempt=0, peakBytes=306176, peakBytesReadable=299.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 299.0K allocated (297.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 139: Executor task launch worker for task 26.0 in stage 1.0 (TID 170) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=1, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=6, cache hits=2 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 302.5K allocated (300.0K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 131: Executor task launch worker for task 1.0 in stage 1.0 (TID 145) 2023-02-10 11:11:43 Executor: INFO: Finished task 26.0 in stage 1.0 (TID 170). 1571 bytes result sent to driver 2023-02-10 11:11:43 Executor: INFO: Finished task 1.0 in stage 1.0 (TID 145). 1492 bytes result sent to driver 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 40.0 in stage 1.0 (TID 184) (163.152.180.157, executor driver, partition 40, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 26.0 in stage 1.0 (TID 170) in 1429 ms on 163.152.180.157 (executor driver) (1/144) 2023-02-10 11:11:43 Executor: INFO: Running task 40.0 in stage 1.0 (TID 184) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 41.0 in stage 1.0 (TID 185) (163.152.180.157, executor driver, partition 41, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 1.0 in stage 1.0 (TID 145) in 1439 ms on 163.152.180.157 (executor driver) (2/144) 2023-02-10 11:11:43 Executor: INFO: Running task 41.0 in stage 1.0 (TID 185) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 41.0 in stage 1.0 (TID 185) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 131: Executor task launch worker for task 41.0 in stage 1.0 (TID 185) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=37, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 302.5K allocated (300.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 122: Executor task launch worker for task 37.0 in stage 1.0 (TID 181) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=28, attempt=0, peakBytes=305664, peakBytesReadable=298.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 298.5K allocated (296.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 142: Executor task launch worker for task 28.0 in stage 1.0 (TID 172) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 40.0 in stage 1.0 (TID 184) 2023-02-10 11:11:43 Executor: INFO: Finished task 28.0 in stage 1.0 (TID 172). 1429 bytes result sent to driver 2023-02-10 11:11:43 Executor: INFO: Finished task 37.0 in stage 1.0 (TID 181). 1421 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 127: Executor task launch worker for task 40.0 in stage 1.0 (TID 184) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 42.0 in stage 1.0 (TID 186) (163.152.180.157, executor driver, partition 42, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 Executor: INFO: Running task 42.0 in stage 1.0 (TID 186) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 28.0 in stage 1.0 (TID 172) in 1460 ms on 163.152.180.157 (executor driver) (3/144) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 43.0 in stage 1.0 (TID 187) (163.152.180.157, executor driver, partition 43, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 Executor: INFO: Running task 43.0 in stage 1.0 (TID 187) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 37.0 in stage 1.0 (TID 181) in 1459 ms on 163.152.180.157 (executor driver) (4/144) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=0, attempt=0, peakBytes=377088, peakBytesReadable=368.25 KiB, chunks requested=18, cache hits=5 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 368.3K allocated (363.8K blocks / 4.5K chunks), regions.size = 9, 0 current java objects, thread 117: Executor task launch worker for task 0.0 in stage 1.0 (TID 144) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=34, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 302.0K allocated (300.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 125: Executor task launch worker for task 34.0 in stage 1.0 (TID 178) 2023-02-10 11:11:43 Executor: INFO: Finished task 0.0 in stage 1.0 (TID 144). 1450 bytes result sent to driver 2023-02-10 11:11:43 Executor: INFO: Finished task 34.0 in stage 1.0 (TID 178). 1549 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=20, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 134: Executor task launch worker for task 20.0 in stage 1.0 (TID 164) 2023-02-10 11:11:43 Executor: INFO: Finished task 20.0 in stage 1.0 (TID 164). 1417 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=13, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 132: Executor task launch worker for task 13.0 in stage 1.0 (TID 157) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=12, attempt=0, peakBytes=308992, peakBytesReadable=301.75 KiB, chunks requested=4, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 301.8K allocated (298.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 119: Executor task launch worker for task 12.0 in stage 1.0 (TID 156) 2023-02-10 11:11:43 Executor: INFO: Finished task 13.0 in stage 1.0 (TID 157). 1467 bytes result sent to driver 2023-02-10 11:11:43 Executor: INFO: Finished task 12.0 in stage 1.0 (TID 156). 1451 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=38, attempt=0, peakBytes=306688, peakBytesReadable=299.50 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 299.5K allocated (297.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 147: Executor task launch worker for task 38.0 in stage 1.0 (TID 182) 2023-02-10 11:11:43 Executor: INFO: Finished task 38.0 in stage 1.0 (TID 182). 1426 bytes result sent to driver 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 44.0 in stage 1.0 (TID 188) (163.152.180.157, executor driver, partition 44, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 0.0 in stage 1.0 (TID 144) in 1482 ms on 163.152.180.157 (executor driver) (5/144) 2023-02-10 11:11:43 Executor: INFO: Running task 44.0 in stage 1.0 (TID 188) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 45.0 in stage 1.0 (TID 189) (163.152.180.157, executor driver, partition 45, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 34.0 in stage 1.0 (TID 178) in 1475 ms on 163.152.180.157 (executor driver) (6/144) 2023-02-10 11:11:43 Executor: INFO: Running task 45.0 in stage 1.0 (TID 189) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 46.0 in stage 1.0 (TID 190) (163.152.180.157, executor driver, partition 46, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=21, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=5, cache hits=1 2023-02-10 11:11:43 Executor: INFO: Running task 46.0 in stage 1.0 (TID 190) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 20.0 in stage 1.0 (TID 164) in 1479 ms on 163.152.180.157 (executor driver) (7/144) 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 115: Executor task launch worker for task 21.0 in stage 1.0 (TID 165) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 47.0 in stage 1.0 (TID 191) (163.152.180.157, executor driver, partition 47, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 42.0 in stage 1.0 (TID 186) 2023-02-10 11:11:43 Executor: INFO: Finished task 21.0 in stage 1.0 (TID 165). 1418 bytes result sent to driver 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 13.0 in stage 1.0 (TID 157) in 1481 ms on 163.152.180.157 (executor driver) (8/144) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=31, attempt=0, peakBytes=308992, peakBytesReadable=301.75 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 43.0 in stage 1.0 (TID 187) 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 301.8K allocated (299.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 130: Executor task launch worker for task 31.0 in stage 1.0 (TID 175) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 48.0 in stage 1.0 (TID 192) (163.152.180.157, executor driver, partition 48, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 Executor: INFO: Running task 48.0 in stage 1.0 (TID 192) 2023-02-10 11:11:43 Executor: INFO: Finished task 31.0 in stage 1.0 (TID 175). 1420 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 139: Executor task launch worker for task 42.0 in stage 1.0 (TID 186) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 49.0 in stage 1.0 (TID 193) (163.152.180.157, executor driver, partition 49, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 122: Executor task launch worker for task 43.0 in stage 1.0 (TID 187) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=14, attempt=0, peakBytes=306176, peakBytesReadable=299.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 299.0K allocated (297.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 140: Executor task launch worker for task 14.0 in stage 1.0 (TID 158) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 12.0 in stage 1.0 (TID 156) in 1482 ms on 163.152.180.157 (executor driver) (9/144) 2023-02-10 11:11:43 Executor: INFO: Finished task 14.0 in stage 1.0 (TID 158). 1409 bytes result sent to driver 2023-02-10 11:11:43 Executor: INFO: Running task 47.0 in stage 1.0 (TID 191) 2023-02-10 11:11:43 Executor: INFO: Running task 49.0 in stage 1.0 (TID 193) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 50.0 in stage 1.0 (TID 194) (163.152.180.157, executor driver, partition 50, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 21.0 in stage 1.0 (TID 165) in 1543 ms on 163.152.180.157 (executor driver) (10/144) 2023-02-10 11:11:43 Executor: INFO: Running task 50.0 in stage 1.0 (TID 194) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=29, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 51.0 in stage 1.0 (TID 195) (163.152.180.157, executor driver, partition 51, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 301.3K allocated (299.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 118: Executor task launch worker for task 29.0 in stage 1.0 (TID 173) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 52.0 in stage 1.0 (TID 196) (163.152.180.157, executor driver, partition 52, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 Executor: INFO: Running task 52.0 in stage 1.0 (TID 196) 2023-02-10 11:11:43 Executor: INFO: Finished task 29.0 in stage 1.0 (TID 173). 1560 bytes result sent to driver 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 38.0 in stage 1.0 (TID 182) in 1541 ms on 163.152.180.157 (executor driver) (11/144) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 53.0 in stage 1.0 (TID 197) (163.152.180.157, executor driver, partition 53, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=19, attempt=0, peakBytes=306176, peakBytesReadable=299.00 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 14.0 in stage 1.0 (TID 158) in 1546 ms on 163.152.180.157 (executor driver) (12/144) 2023-02-10 11:11:43 Executor: INFO: Running task 53.0 in stage 1.0 (TID 197) 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 299.0K allocated (297.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 150: Executor task launch worker for task 19.0 in stage 1.0 (TID 163) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 29.0 in stage 1.0 (TID 173) in 1544 ms on 163.152.180.157 (executor driver) (13/144) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 31.0 in stage 1.0 (TID 175) in 1543 ms on 163.152.180.157 (executor driver) (14/144) 2023-02-10 11:11:43 Executor: INFO: Finished task 19.0 in stage 1.0 (TID 163). 1576 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=16, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 300.8K allocated (297.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 120: Executor task launch worker for task 16.0 in stage 1.0 (TID 160) 2023-02-10 11:11:43 Executor: INFO: Finished task 16.0 in stage 1.0 (TID 160). 1456 bytes result sent to driver 2023-02-10 11:11:43 Executor: INFO: Running task 51.0 in stage 1.0 (TID 195) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=33, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=6, cache hits=2 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 302.5K allocated (300.0K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 158: Executor task launch worker for task 33.0 in stage 1.0 (TID 177) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=3, attempt=0, peakBytes=307200, peakBytesReadable=300.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 300.0K allocated (298.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 128: Executor task launch worker for task 3.0 in stage 1.0 (TID 147) 2023-02-10 11:11:43 Executor: INFO: Finished task 33.0 in stage 1.0 (TID 177). 1458 bytes result sent to driver 2023-02-10 11:11:43 Executor: INFO: Finished task 3.0 in stage 1.0 (TID 147). 1452 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=18, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 124: Executor task launch worker for task 18.0 in stage 1.0 (TID 162) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=2, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=5, cache hits=1 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 148: Executor task launch worker for task 2.0 in stage 1.0 (TID 146) 2023-02-10 11:11:43 Executor: INFO: Finished task 18.0 in stage 1.0 (TID 162). 1758 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 45.0 in stage 1.0 (TID 189) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 46.0 in stage 1.0 (TID 190) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 44.0 in stage 1.0 (TID 188) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 119: Executor task launch worker for task 45.0 in stage 1.0 (TID 189) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 132: Executor task launch worker for task 46.0 in stage 1.0 (TID 190) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 147: Executor task launch worker for task 44.0 in stage 1.0 (TID 188) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=4, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 137: Executor task launch worker for task 4.0 in stage 1.0 (TID 148) 2023-02-10 11:11:43 Executor: INFO: Finished task 4.0 in stage 1.0 (TID 148). 1474 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 48.0 in stage 1.0 (TID 192) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 47.0 in stage 1.0 (TID 191) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=7, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 300.8K allocated (298.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 152: Executor task launch worker for task 7.0 in stage 1.0 (TID 151) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 134: Executor task launch worker for task 47.0 in stage 1.0 (TID 191) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 115: Executor task launch worker for task 48.0 in stage 1.0 (TID 192) 2023-02-10 11:11:43 Executor: INFO: Finished task 7.0 in stage 1.0 (TID 151). 1481 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 49.0 in stage 1.0 (TID 193) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 54.0 in stage 1.0 (TID 198) (163.152.180.157, executor driver, partition 54, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 19.0 in stage 1.0 (TID 163) in 1564 ms on 163.152.180.157 (executor driver) (15/144) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 130: Executor task launch worker for task 49.0 in stage 1.0 (TID 193) 2023-02-10 11:11:43 Executor: INFO: Running task 54.0 in stage 1.0 (TID 198) 2023-02-10 11:11:43 Executor: INFO: Finished task 2.0 in stage 1.0 (TID 146). 1506 bytes result sent to driver 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 55.0 in stage 1.0 (TID 199) (163.152.180.157, executor driver, partition 55, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 50.0 in stage 1.0 (TID 194) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 16.0 in stage 1.0 (TID 160) in 1566 ms on 163.152.180.157 (executor driver) (16/144) 2023-02-10 11:11:43 Executor: INFO: Running task 55.0 in stage 1.0 (TID 199) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 140: Executor task launch worker for task 50.0 in stage 1.0 (TID 194) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 56.0 in stage 1.0 (TID 200) (163.152.180.157, executor driver, partition 56, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 33.0 in stage 1.0 (TID 177) in 1563 ms on 163.152.180.157 (executor driver) (17/144) 2023-02-10 11:11:43 Executor: INFO: Running task 56.0 in stage 1.0 (TID 200) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=22, attempt=0, peakBytes=305920, peakBytesReadable=298.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 298.8K allocated (296.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 159: Executor task launch worker for task 22.0 in stage 1.0 (TID 166) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 57.0 in stage 1.0 (TID 201) (163.152.180.157, executor driver, partition 57, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 52.0 in stage 1.0 (TID 196) 2023-02-10 11:11:43 Executor: INFO: Finished task 22.0 in stage 1.0 (TID 166). 1506 bytes result sent to driver 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 58.0 in stage 1.0 (TID 202) (163.152.180.157, executor driver, partition 58, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 53.0 in stage 1.0 (TID 197) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 117: Executor task launch worker for task 52.0 in stage 1.0 (TID 196) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 18.0 in stage 1.0 (TID 162) in 1567 ms on 163.152.180.157 (executor driver) (18/144) 2023-02-10 11:11:43 Executor: INFO: Running task 58.0 in stage 1.0 (TID 202) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 4.0 in stage 1.0 (TID 148) in 1570 ms on 163.152.180.157 (executor driver) (19/144) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=15, attempt=0, peakBytes=310784, peakBytesReadable=303.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 303.5K allocated (301.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 144: Executor task launch worker for task 15.0 in stage 1.0 (TID 159) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 118: Executor task launch worker for task 53.0 in stage 1.0 (TID 197) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 59.0 in stage 1.0 (TID 203) (163.152.180.157, executor driver, partition 59, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 3.0 in stage 1.0 (TID 147) in 1571 ms on 163.152.180.157 (executor driver) (20/144) 2023-02-10 11:11:43 Executor: INFO: Running task 59.0 in stage 1.0 (TID 203) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 60.0 in stage 1.0 (TID 204) (163.152.180.157, executor driver, partition 60, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 Executor: INFO: Finished task 15.0 in stage 1.0 (TID 159). 1459 bytes result sent to driver 2023-02-10 11:11:43 Executor: INFO: Running task 60.0 in stage 1.0 (TID 204) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 61.0 in stage 1.0 (TID 205) (163.152.180.157, executor driver, partition 61, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 125: Executor task launch worker for task 51.0 in stage 1.0 (TID 195) 2023-02-10 11:11:43 Executor: INFO: Running task 61.0 in stage 1.0 (TID 205) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 62.0 in stage 1.0 (TID 206) (163.152.180.157, executor driver, partition 62, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 Executor: INFO: Running task 62.0 in stage 1.0 (TID 206) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 63.0 in stage 1.0 (TID 207) (163.152.180.157, executor driver, partition 63, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 15.0 in stage 1.0 (TID 159) in 1570 ms on 163.152.180.157 (executor driver) (21/144) 2023-02-10 11:11:43 Executor: INFO: Running task 63.0 in stage 1.0 (TID 207) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 22.0 in stage 1.0 (TID 166) in 1569 ms on 163.152.180.157 (executor driver) (22/144) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=8, attempt=0, peakBytes=310272, peakBytesReadable=303.00 KiB, chunks requested=8, cache hits=3 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 303.0K allocated (300.0K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 114: Executor task launch worker for task 8.0 in stage 1.0 (TID 152) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 2.0 in stage 1.0 (TID 146) in 1573 ms on 163.152.180.157 (executor driver) (23/144) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 7.0 in stage 1.0 (TID 151) in 1575 ms on 163.152.180.157 (executor driver) (24/144) 2023-02-10 11:11:43 Executor: INFO: Running task 57.0 in stage 1.0 (TID 201) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=10, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=11, cache hits=3 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 302.0K allocated (299.0K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 146: Executor task launch worker for task 10.0 in stage 1.0 (TID 154) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 54.0 in stage 1.0 (TID 198) 2023-02-10 11:11:43 Executor: INFO: Finished task 10.0 in stage 1.0 (TID 154). 1573 bytes result sent to driver 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 64.0 in stage 1.0 (TID 208) (163.152.180.157, executor driver, partition 64, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 152: Executor task launch worker for task 54.0 in stage 1.0 (TID 198) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 10.0 in stage 1.0 (TID 154) in 1581 ms on 163.152.180.157 (executor driver) (25/144) 2023-02-10 11:11:43 Executor: INFO: Running task 64.0 in stage 1.0 (TID 208) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 125: Executor task launch worker for task 51.0 in stage 1.0 (TID 195) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 55.0 in stage 1.0 (TID 199) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 148: Executor task launch worker for task 55.0 in stage 1.0 (TID 199) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 60.0 in stage 1.0 (TID 204) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 56.0 in stage 1.0 (TID 200) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 144: Executor task launch worker for task 60.0 in stage 1.0 (TID 204) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 62.0 in stage 1.0 (TID 206) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 137: Executor task launch worker for task 56.0 in stage 1.0 (TID 200) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 120: Executor task launch worker for task 62.0 in stage 1.0 (TID 206) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 63.0 in stage 1.0 (TID 207) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 158: Executor task launch worker for task 61.0 in stage 1.0 (TID 205) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=11, attempt=0, peakBytes=310528, peakBytesReadable=303.25 KiB, chunks requested=9, cache hits=2 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 303.3K allocated (300.3K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 143: Executor task launch worker for task 11.0 in stage 1.0 (TID 155) 2023-02-10 11:11:43 Executor: INFO: Finished task 8.0 in stage 1.0 (TID 152). 1475 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 150: Executor task launch worker for task 63.0 in stage 1.0 (TID 207) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=25, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 158: Executor task launch worker for task 61.0 in stage 1.0 (TID 205) 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 301.5K allocated (298.5K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 123: Executor task launch worker for task 25.0 in stage 1.0 (TID 169) 2023-02-10 11:11:43 Executor: INFO: Finished task 11.0 in stage 1.0 (TID 155). 1464 bytes result sent to driver 2023-02-10 11:11:43 Executor: INFO: Finished task 25.0 in stage 1.0 (TID 169). 1453 bytes result sent to driver 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 65.0 in stage 1.0 (TID 209) (163.152.180.157, executor driver, partition 65, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 Executor: INFO: Running task 65.0 in stage 1.0 (TID 209) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=6, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 129: Executor task launch worker for task 6.0 in stage 1.0 (TID 150) 2023-02-10 11:11:43 Executor: INFO: Finished task 6.0 in stage 1.0 (TID 150). 1478 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=5, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 151: Executor task launch worker for task 5.0 in stage 1.0 (TID 149) 2023-02-10 11:11:43 Executor: INFO: Finished task 5.0 in stage 1.0 (TID 149). 1453 bytes result sent to driver 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 58.0 in stage 1.0 (TID 202) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 159: Executor task launch worker for task 58.0 in stage 1.0 (TID 202) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=24, attempt=0, peakBytes=307200, peakBytesReadable=300.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 300.0K allocated (298.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 149: Executor task launch worker for task 24.0 in stage 1.0 (TID 168) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 59.0 in stage 1.0 (TID 203) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 128: Executor task launch worker for task 59.0 in stage 1.0 (TID 203) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=35, attempt=0, peakBytes=308224, peakBytesReadable=301.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 301.0K allocated (299.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 121: Executor task launch worker for task 35.0 in stage 1.0 (TID 179) 2023-02-10 11:11:43 Executor: INFO: Finished task 35.0 in stage 1.0 (TID 179). 1483 bytes result sent to driver 2023-02-10 11:11:43 Executor: INFO: Finished task 24.0 in stage 1.0 (TID 168). 1453 bytes result sent to driver 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 66.0 in stage 1.0 (TID 210) (163.152.180.157, executor driver, partition 66, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 64.0 in stage 1.0 (TID 208) 2023-02-10 11:11:43 Executor: INFO: Running task 66.0 in stage 1.0 (TID 210) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 67.0 in stage 1.0 (TID 211) (163.152.180.157, executor driver, partition 67, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 Executor: INFO: Running task 67.0 in stage 1.0 (TID 211) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 142: Executor task launch worker for task 64.0 in stage 1.0 (TID 208) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 68.0 in stage 1.0 (TID 212) (163.152.180.157, executor driver, partition 68, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 Executor: INFO: Running task 68.0 in stage 1.0 (TID 212) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 69.0 in stage 1.0 (TID 213) (163.152.180.157, executor driver, partition 69, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 Executor: INFO: Running task 69.0 in stage 1.0 (TID 213) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 70.0 in stage 1.0 (TID 214) (163.152.180.157, executor driver, partition 70, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 Executor: INFO: Running task 70.0 in stage 1.0 (TID 214) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 71.0 in stage 1.0 (TID 215) (163.152.180.157, executor driver, partition 71, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 Executor: INFO: Running task 71.0 in stage 1.0 (TID 215) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 57.0 in stage 1.0 (TID 201) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 11.0 in stage 1.0 (TID 155) in 1598 ms on 163.152.180.157 (executor driver) (26/144) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 5.0 in stage 1.0 (TID 149) in 1600 ms on 163.152.180.157 (executor driver) (27/144) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 35.0 in stage 1.0 (TID 179) in 1593 ms on 163.152.180.157 (executor driver) (28/144) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 24.0 in stage 1.0 (TID 168) in 1596 ms on 163.152.180.157 (executor driver) (29/144) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 25.0 in stage 1.0 (TID 169) in 1596 ms on 163.152.180.157 (executor driver) (30/144) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 6.0 in stage 1.0 (TID 150) in 1600 ms on 163.152.180.157 (executor driver) (31/144) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 124: Executor task launch worker for task 57.0 in stage 1.0 (TID 201) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 8.0 in stage 1.0 (TID 152) in 1599 ms on 163.152.180.157 (executor driver) (32/144) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 123: Executor task launch worker for task 65.0 in stage 1.0 (TID 209) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=9, attempt=0, peakBytes=307456, peakBytesReadable=300.25 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 300.3K allocated (297.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 145: Executor task launch worker for task 9.0 in stage 1.0 (TID 153) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 123: Executor task launch worker for task 65.0 in stage 1.0 (TID 209) 2023-02-10 11:11:43 Executor: INFO: Finished task 9.0 in stage 1.0 (TID 153). 1515 bytes result sent to driver 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 72.0 in stage 1.0 (TID 216) (163.152.180.157, executor driver, partition 72, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 9.0 in stage 1.0 (TID 153) in 1604 ms on 163.152.180.157 (executor driver) (33/144) 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=32, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=7, cache hits=1 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 301.3K allocated (298.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 126: Executor task launch worker for task 32.0 in stage 1.0 (TID 176) 2023-02-10 11:11:43 Executor: INFO: Finished task 32.0 in stage 1.0 (TID 176). 1472 bytes result sent to driver 2023-02-10 11:11:43 Executor: INFO: Running task 72.0 in stage 1.0 (TID 216) 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 73.0 in stage 1.0 (TID 217) (163.152.180.157, executor driver, partition 73, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 root: INFO: TaskReport: stage=1, partition=23, attempt=0, peakBytes=305920, peakBytesReadable=298.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:43 root: INFO: RegionPool: FREE: 298.8K allocated (296.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 153: Executor task launch worker for task 23.0 in stage 1.0 (TID 167) 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 32.0 in stage 1.0 (TID 176) in 1603 ms on 163.152.180.157 (executor driver) (34/144) 2023-02-10 11:11:43 Executor: INFO: Running task 73.0 in stage 1.0 (TID 217) 2023-02-10 11:11:43 Executor: INFO: Finished task 23.0 in stage 1.0 (TID 167). 1475 bytes result sent to driver 2023-02-10 11:11:43 TaskSetManager: INFO: Starting task 74.0 in stage 1.0 (TID 218) (163.152.180.157, executor driver, partition 74, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:43 TaskSetManager: INFO: Finished task 23.0 in stage 1.0 (TID 167) in 1606 ms on 163.152.180.157 (executor driver) (35/144) 2023-02-10 11:11:43 Executor: INFO: Running task 74.0 in stage 1.0 (TID 218) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 71.0 in stage 1.0 (TID 215) 2023-02-10 11:11:43 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 68.0 in stage 1.0 (TID 212) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 114: Executor task launch worker for task 71.0 in stage 1.0 (TID 215) 2023-02-10 11:11:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 151: Executor task launch worker for task 68.0 in stage 1.0 (TID 212) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 149: Executor task launch worker for task 66.0 in stage 1.0 (TID 210) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=17, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 149: Executor task launch worker for task 66.0 in stage 1.0 (TID 210) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 72.0 in stage 1.0 (TID 216) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 70.0 in stage 1.0 (TID 214) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 145: Executor task launch worker for task 72.0 in stage 1.0 (TID 216) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 143: Executor task launch worker for task 70.0 in stage 1.0 (TID 214) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 129: Executor task launch worker for task 69.0 in stage 1.0 (TID 213) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 73.0 in stage 1.0 (TID 217) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=39, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=3, cache hits=1 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 141: Executor task launch worker for task 39.0 in stage 1.0 (TID 183) 2023-02-10 11:11:44 Executor: INFO: Finished task 39.0 in stage 1.0 (TID 183). 1467 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 129: Executor task launch worker for task 69.0 in stage 1.0 (TID 213) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 126: Executor task launch worker for task 73.0 in stage 1.0 (TID 217) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 75.0 in stage 1.0 (TID 219) (163.152.180.157, executor driver, partition 75, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 Executor: INFO: Running task 75.0 in stage 1.0 (TID 219) 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 133: Executor task launch worker for task 17.0 in stage 1.0 (TID 161) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 39.0 in stage 1.0 (TID 183) in 1622 ms on 163.152.180.157 (executor driver) (36/144) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 74.0 in stage 1.0 (TID 218) 2023-02-10 11:11:44 Executor: INFO: Finished task 17.0 in stage 1.0 (TID 161). 1458 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 146: Executor task launch worker for task 74.0 in stage 1.0 (TID 218) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 76.0 in stage 1.0 (TID 220) (163.152.180.157, executor driver, partition 76, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 Executor: INFO: Running task 76.0 in stage 1.0 (TID 220) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 17.0 in stage 1.0 (TID 161) in 1629 ms on 163.152.180.157 (executor driver) (37/144) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 121: Executor task launch worker for task 67.0 in stage 1.0 (TID 211) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 121: Executor task launch worker for task 67.0 in stage 1.0 (TID 211) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 75.0 in stage 1.0 (TID 219) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 153: Executor task launch worker for task 75.0 in stage 1.0 (TID 219) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 76.0 in stage 1.0 (TID 220) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 133: Executor task launch worker for task 76.0 in stage 1.0 (TID 220) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=30, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 302.0K allocated (300.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 116: Executor task launch worker for task 30.0 in stage 1.0 (TID 174) 2023-02-10 11:11:44 Executor: INFO: Finished task 30.0 in stage 1.0 (TID 174). 1457 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 77.0 in stage 1.0 (TID 221) (163.152.180.157, executor driver, partition 77, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 30.0 in stage 1.0 (TID 174) in 1678 ms on 163.152.180.157 (executor driver) (38/144) 2023-02-10 11:11:44 Executor: INFO: Running task 77.0 in stage 1.0 (TID 221) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=27, attempt=0, peakBytes=305664, peakBytesReadable=298.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 298.5K allocated (296.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 138: Executor task launch worker for task 27.0 in stage 1.0 (TID 171) 2023-02-10 11:11:44 Executor: INFO: Finished task 27.0 in stage 1.0 (TID 171). 1477 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 78.0 in stage 1.0 (TID 222) (163.152.180.157, executor driver, partition 78, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 27.0 in stage 1.0 (TID 171) in 1692 ms on 163.152.180.157 (executor driver) (39/144) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 77.0 in stage 1.0 (TID 221) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 141: Executor task launch worker for task 77.0 in stage 1.0 (TID 221) 2023-02-10 11:11:44 Executor: INFO: Running task 78.0 in stage 1.0 (TID 222) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=36, attempt=0, peakBytes=306688, peakBytesReadable=299.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 299.5K allocated (297.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 136: Executor task launch worker for task 36.0 in stage 1.0 (TID 180) 2023-02-10 11:11:44 Executor: INFO: Finished task 36.0 in stage 1.0 (TID 180). 1482 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 79.0 in stage 1.0 (TID 223) (163.152.180.157, executor driver, partition 79, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 36.0 in stage 1.0 (TID 180) in 1715 ms on 163.152.180.157 (executor driver) (40/144) 2023-02-10 11:11:44 Executor: INFO: Running task 79.0 in stage 1.0 (TID 223) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 78.0 in stage 1.0 (TID 222) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 116: Executor task launch worker for task 78.0 in stage 1.0 (TID 222) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 138: Executor task launch worker for task 79.0 in stage 1.0 (TID 223) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 138: Executor task launch worker for task 79.0 in stage 1.0 (TID 223) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=41, attempt=0, peakBytes=306176, peakBytesReadable=299.00 KiB, chunks requested=3, cache hits=1 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 299.0K allocated (296.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 131: Executor task launch worker for task 41.0 in stage 1.0 (TID 185) 2023-02-10 11:11:44 Executor: INFO: Finished task 41.0 in stage 1.0 (TID 185). 1475 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 80.0 in stage 1.0 (TID 224) (163.152.180.157, executor driver, partition 80, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 Executor: INFO: Running task 80.0 in stage 1.0 (TID 224) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 41.0 in stage 1.0 (TID 185) in 1005 ms on 163.152.180.157 (executor driver) (41/144) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=43, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 122: Executor task launch worker for task 43.0 in stage 1.0 (TID 187) 2023-02-10 11:11:44 Executor: INFO: Finished task 43.0 in stage 1.0 (TID 187). 1557 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 81.0 in stage 1.0 (TID 225) (163.152.180.157, executor driver, partition 81, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 43.0 in stage 1.0 (TID 187) in 979 ms on 163.152.180.157 (executor driver) (42/144) 2023-02-10 11:11:44 Executor: INFO: Running task 81.0 in stage 1.0 (TID 225) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=42, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 139: Executor task launch worker for task 42.0 in stage 1.0 (TID 186) 2023-02-10 11:11:44 Executor: INFO: Finished task 42.0 in stage 1.0 (TID 186). 1461 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 82.0 in stage 1.0 (TID 226) (163.152.180.157, executor driver, partition 82, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 42.0 in stage 1.0 (TID 186) in 984 ms on 163.152.180.157 (executor driver) (43/144) 2023-02-10 11:11:44 Executor: INFO: Running task 82.0 in stage 1.0 (TID 226) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=40, attempt=0, peakBytes=307456, peakBytesReadable=300.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.3K allocated (298.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 127: Executor task launch worker for task 40.0 in stage 1.0 (TID 184) 2023-02-10 11:11:44 Executor: INFO: Finished task 40.0 in stage 1.0 (TID 184). 1523 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 83.0 in stage 1.0 (TID 227) (163.152.180.157, executor driver, partition 83, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 40.0 in stage 1.0 (TID 184) in 1019 ms on 163.152.180.157 (executor driver) (44/144) 2023-02-10 11:11:44 Executor: INFO: Running task 83.0 in stage 1.0 (TID 227) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 81.0 in stage 1.0 (TID 225) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 131: Executor task launch worker for task 81.0 in stage 1.0 (TID 225) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 82.0 in stage 1.0 (TID 226) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 122: Executor task launch worker for task 82.0 in stage 1.0 (TID 226) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=47, attempt=0, peakBytes=306432, peakBytesReadable=299.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 299.3K allocated (297.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 134: Executor task launch worker for task 47.0 in stage 1.0 (TID 191) 2023-02-10 11:11:44 Executor: INFO: Finished task 47.0 in stage 1.0 (TID 191). 1443 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 84.0 in stage 1.0 (TID 228) (163.152.180.157, executor driver, partition 84, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 Executor: INFO: Running task 84.0 in stage 1.0 (TID 228) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=55, attempt=0, peakBytes=306176, peakBytesReadable=299.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 299.0K allocated (297.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 148: Executor task launch worker for task 55.0 in stage 1.0 (TID 199) 2023-02-10 11:11:44 Executor: INFO: Finished task 55.0 in stage 1.0 (TID 199). 1468 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 80.0 in stage 1.0 (TID 224) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 47.0 in stage 1.0 (TID 191) in 983 ms on 163.152.180.157 (executor driver) (45/144) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 136: Executor task launch worker for task 80.0 in stage 1.0 (TID 224) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 85.0 in stage 1.0 (TID 229) (163.152.180.157, executor driver, partition 85, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 55.0 in stage 1.0 (TID 199) in 900 ms on 163.152.180.157 (executor driver) (46/144) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 83.0 in stage 1.0 (TID 227) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 127: Executor task launch worker for task 83.0 in stage 1.0 (TID 227) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=48, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 115: Executor task launch worker for task 48.0 in stage 1.0 (TID 192) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=63, attempt=0, peakBytes=308224, peakBytesReadable=301.00 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=53, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 301.0K allocated (298.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 150: Executor task launch worker for task 63.0 in stage 1.0 (TID 207) 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 118: Executor task launch worker for task 53.0 in stage 1.0 (TID 197) 2023-02-10 11:11:44 Executor: INFO: Finished task 48.0 in stage 1.0 (TID 192). 1483 bytes result sent to driver 2023-02-10 11:11:44 Executor: INFO: Running task 85.0 in stage 1.0 (TID 229) 2023-02-10 11:11:44 Executor: INFO: Finished task 63.0 in stage 1.0 (TID 207). 1430 bytes result sent to driver 2023-02-10 11:11:44 Executor: INFO: Finished task 53.0 in stage 1.0 (TID 197). 1415 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 86.0 in stage 1.0 (TID 230) (163.152.180.157, executor driver, partition 86, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 48.0 in stage 1.0 (TID 192) in 993 ms on 163.152.180.157 (executor driver) (47/144) 2023-02-10 11:11:44 Executor: INFO: Running task 86.0 in stage 1.0 (TID 230) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 87.0 in stage 1.0 (TID 231) (163.152.180.157, executor driver, partition 87, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 63.0 in stage 1.0 (TID 207) in 904 ms on 163.152.180.157 (executor driver) (48/144) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=52, attempt=0, peakBytes=307200, peakBytesReadable=300.00 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.0K allocated (297.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 117: Executor task launch worker for task 52.0 in stage 1.0 (TID 196) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 88.0 in stage 1.0 (TID 232) (163.152.180.157, executor driver, partition 88, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 Executor: INFO: Finished task 52.0 in stage 1.0 (TID 196). 1484 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 53.0 in stage 1.0 (TID 197) in 929 ms on 163.152.180.157 (executor driver) (49/144) 2023-02-10 11:11:44 Executor: INFO: Running task 88.0 in stage 1.0 (TID 232) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 89.0 in stage 1.0 (TID 233) (163.152.180.157, executor driver, partition 89, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 52.0 in stage 1.0 (TID 196) in 931 ms on 163.152.180.157 (executor driver) (50/144) 2023-02-10 11:11:44 Executor: INFO: Running task 87.0 in stage 1.0 (TID 231) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 84.0 in stage 1.0 (TID 228) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=49, attempt=0, peakBytes=307200, peakBytesReadable=300.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.0K allocated (298.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 130: Executor task launch worker for task 49.0 in stage 1.0 (TID 193) 2023-02-10 11:11:44 Executor: INFO: Finished task 49.0 in stage 1.0 (TID 193). 1501 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=56, attempt=0, peakBytes=309504, peakBytesReadable=302.25 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 302.3K allocated (299.3K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 137: Executor task launch worker for task 56.0 in stage 1.0 (TID 200) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 90.0 in stage 1.0 (TID 234) (163.152.180.157, executor driver, partition 90, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 49.0 in stage 1.0 (TID 193) in 997 ms on 163.152.180.157 (executor driver) (51/144) 2023-02-10 11:11:44 Executor: INFO: Finished task 56.0 in stage 1.0 (TID 200). 1420 bytes result sent to driver 2023-02-10 11:11:44 Executor: INFO: Running task 90.0 in stage 1.0 (TID 234) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=57, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 302.0K allocated (300.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 124: Executor task launch worker for task 57.0 in stage 1.0 (TID 201) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 91.0 in stage 1.0 (TID 235) (163.152.180.157, executor driver, partition 91, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 56.0 in stage 1.0 (TID 200) in 914 ms on 163.152.180.157 (executor driver) (52/144) 2023-02-10 11:11:44 Executor: INFO: Finished task 57.0 in stage 1.0 (TID 201). 1444 bytes result sent to driver 2023-02-10 11:11:44 Executor: INFO: Running task 91.0 in stage 1.0 (TID 235) 2023-02-10 11:11:44 Executor: INFO: Running task 89.0 in stage 1.0 (TID 233) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=65, attempt=0, peakBytes=310016, peakBytesReadable=302.75 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 302.8K allocated (298.8K blocks / 4.0K chunks), regions.size = 9, 0 current java objects, thread 123: Executor task launch worker for task 65.0 in stage 1.0 (TID 209) 2023-02-10 11:11:44 Executor: INFO: Finished task 65.0 in stage 1.0 (TID 209). 1479 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 85.0 in stage 1.0 (TID 229) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 86.0 in stage 1.0 (TID 230) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 148: Executor task launch worker for task 85.0 in stage 1.0 (TID 229) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 150: Executor task launch worker for task 86.0 in stage 1.0 (TID 230) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 88.0 in stage 1.0 (TID 232) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=62, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 120: Executor task launch worker for task 62.0 in stage 1.0 (TID 206) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 117: Executor task launch worker for task 88.0 in stage 1.0 (TID 232) 2023-02-10 11:11:44 Executor: INFO: Finished task 62.0 in stage 1.0 (TID 206). 1566 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 87.0 in stage 1.0 (TID 231) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 139: Executor task launch worker for task 84.0 in stage 1.0 (TID 228) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 92.0 in stage 1.0 (TID 236) (163.152.180.157, executor driver, partition 92, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 118: Executor task launch worker for task 87.0 in stage 1.0 (TID 231) 2023-02-10 11:11:44 Executor: INFO: Running task 92.0 in stage 1.0 (TID 236) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 93.0 in stage 1.0 (TID 237) (163.152.180.157, executor driver, partition 93, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 94.0 in stage 1.0 (TID 238) (163.152.180.157, executor driver, partition 94, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 Executor: INFO: Running task 94.0 in stage 1.0 (TID 238) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 57.0 in stage 1.0 (TID 201) in 924 ms on 163.152.180.157 (executor driver) (53/144) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 62.0 in stage 1.0 (TID 206) in 921 ms on 163.152.180.157 (executor driver) (54/144) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 65.0 in stage 1.0 (TID 209) in 907 ms on 163.152.180.157 (executor driver) (55/144) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=64, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 142: Executor task launch worker for task 64.0 in stage 1.0 (TID 208) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 91.0 in stage 1.0 (TID 235) 2023-02-10 11:11:44 Executor: INFO: Finished task 64.0 in stage 1.0 (TID 208). 1460 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 90.0 in stage 1.0 (TID 234) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 130: Executor task launch worker for task 91.0 in stage 1.0 (TID 235) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=70, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 95.0 in stage 1.0 (TID 239) (163.152.180.157, executor driver, partition 95, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 143: Executor task launch worker for task 70.0 in stage 1.0 (TID 214) 2023-02-10 11:11:44 Executor: INFO: Running task 95.0 in stage 1.0 (TID 239) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 134: Executor task launch worker for task 90.0 in stage 1.0 (TID 234) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 64.0 in stage 1.0 (TID 208) in 914 ms on 163.152.180.157 (executor driver) (56/144) 2023-02-10 11:11:44 Executor: INFO: Running task 93.0 in stage 1.0 (TID 237) 2023-02-10 11:11:44 Executor: INFO: Finished task 70.0 in stage 1.0 (TID 214). 1514 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 96.0 in stage 1.0 (TID 240) (163.152.180.157, executor driver, partition 96, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 70.0 in stage 1.0 (TID 214) in 899 ms on 163.152.180.157 (executor driver) (57/144) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=59, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=11, cache hits=1 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.8K allocated (297.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 128: Executor task launch worker for task 59.0 in stage 1.0 (TID 203) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=50, attempt=0, peakBytes=308992, peakBytesReadable=301.75 KiB, chunks requested=4, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 301.8K allocated (298.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 140: Executor task launch worker for task 50.0 in stage 1.0 (TID 194) 2023-02-10 11:11:44 Executor: INFO: Finished task 59.0 in stage 1.0 (TID 203). 1453 bytes result sent to driver 2023-02-10 11:11:44 Executor: INFO: Finished task 50.0 in stage 1.0 (TID 194). 1418 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 97.0 in stage 1.0 (TID 241) (163.152.180.157, executor driver, partition 97, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 Executor: INFO: Running task 97.0 in stage 1.0 (TID 241) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 59.0 in stage 1.0 (TID 203) in 933 ms on 163.152.180.157 (executor driver) (58/144) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=60, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 144: Executor task launch worker for task 60.0 in stage 1.0 (TID 204) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 98.0 in stage 1.0 (TID 242) (163.152.180.157, executor driver, partition 98, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 Executor: INFO: Finished task 60.0 in stage 1.0 (TID 204). 1429 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 50.0 in stage 1.0 (TID 194) in 962 ms on 163.152.180.157 (executor driver) (59/144) 2023-02-10 11:11:44 Executor: INFO: Running task 98.0 in stage 1.0 (TID 242) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 99.0 in stage 1.0 (TID 243) (163.152.180.157, executor driver, partition 99, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 92.0 in stage 1.0 (TID 236) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 60.0 in stage 1.0 (TID 204) in 935 ms on 163.152.180.157 (executor driver) (60/144) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 120: Executor task launch worker for task 92.0 in stage 1.0 (TID 236) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 94.0 in stage 1.0 (TID 238) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=58, attempt=0, peakBytes=315392, peakBytesReadable=308.00 KiB, chunks requested=12, cache hits=2 2023-02-10 11:11:44 Executor: INFO: Running task 96.0 in stage 1.0 (TID 240) 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 308.0K allocated (304.0K blocks / 4.0K chunks), regions.size = 9, 0 current java objects, thread 159: Executor task launch worker for task 58.0 in stage 1.0 (TID 202) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=54, attempt=0, peakBytes=306688, peakBytesReadable=299.50 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 299.5K allocated (297.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 152: Executor task launch worker for task 54.0 in stage 1.0 (TID 198) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 124: Executor task launch worker for task 94.0 in stage 1.0 (TID 238) 2023-02-10 11:11:44 Executor: INFO: Running task 99.0 in stage 1.0 (TID 243) 2023-02-10 11:11:44 Executor: INFO: Finished task 54.0 in stage 1.0 (TID 198). 1410 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 89.0 in stage 1.0 (TID 233) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 95.0 in stage 1.0 (TID 239) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=75, attempt=0, peakBytes=305920, peakBytesReadable=298.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 298.8K allocated (296.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 153: Executor task launch worker for task 75.0 in stage 1.0 (TID 219) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=61, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=6, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 302.0K allocated (299.0K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 158: Executor task launch worker for task 61.0 in stage 1.0 (TID 205) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 100.0 in stage 1.0 (TID 244) (163.152.180.157, executor driver, partition 100, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 137: Executor task launch worker for task 95.0 in stage 1.0 (TID 239) 2023-02-10 11:11:44 Executor: INFO: Finished task 75.0 in stage 1.0 (TID 219). 1410 bytes result sent to driver 2023-02-10 11:11:44 Executor: INFO: Running task 100.0 in stage 1.0 (TID 244) 2023-02-10 11:11:44 Executor: INFO: Finished task 61.0 in stage 1.0 (TID 205). 1459 bytes result sent to driver 2023-02-10 11:11:44 Executor: INFO: Finished task 58.0 in stage 1.0 (TID 202). 1475 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=44, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 54.0 in stage 1.0 (TID 198) in 944 ms on 163.152.180.157 (executor driver) (61/144) 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 147: Executor task launch worker for task 44.0 in stage 1.0 (TID 188) 2023-02-10 11:11:44 Executor: INFO: Finished task 44.0 in stage 1.0 (TID 188). 1537 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 101.0 in stage 1.0 (TID 245) (163.152.180.157, executor driver, partition 101, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 115: Executor task launch worker for task 89.0 in stage 1.0 (TID 233) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 75.0 in stage 1.0 (TID 219) in 884 ms on 163.152.180.157 (executor driver) (62/144) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=72, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 145: Executor task launch worker for task 72.0 in stage 1.0 (TID 216) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 102.0 in stage 1.0 (TID 246) (163.152.180.157, executor driver, partition 102, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 61.0 in stage 1.0 (TID 205) in 943 ms on 163.152.180.157 (executor driver) (63/144) 2023-02-10 11:11:44 Executor: INFO: Running task 102.0 in stage 1.0 (TID 246) 2023-02-10 11:11:44 Executor: INFO: Finished task 72.0 in stage 1.0 (TID 216). 1481 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=73, attempt=0, peakBytes=306432, peakBytesReadable=299.25 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 299.3K allocated (296.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 126: Executor task launch worker for task 73.0 in stage 1.0 (TID 217) 2023-02-10 11:11:44 Executor: INFO: Finished task 73.0 in stage 1.0 (TID 217). 1428 bytes result sent to driver 2023-02-10 11:11:44 Executor: INFO: Running task 101.0 in stage 1.0 (TID 245) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 103.0 in stage 1.0 (TID 247) (163.152.180.157, executor driver, partition 103, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 104.0 in stage 1.0 (TID 248) (163.152.180.157, executor driver, partition 104, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 105.0 in stage 1.0 (TID 249) (163.152.180.157, executor driver, partition 105, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 Executor: INFO: Running task 105.0 in stage 1.0 (TID 249) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 106.0 in stage 1.0 (TID 250) (163.152.180.157, executor driver, partition 106, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 Executor: INFO: Running task 106.0 in stage 1.0 (TID 250) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 58.0 in stage 1.0 (TID 202) in 948 ms on 163.152.180.157 (executor driver) (64/144) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 44.0 in stage 1.0 (TID 188) in 1046 ms on 163.152.180.157 (executor driver) (65/144) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 72.0 in stage 1.0 (TID 216) in 914 ms on 163.152.180.157 (executor driver) (66/144) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 73.0 in stage 1.0 (TID 217) in 910 ms on 163.152.180.157 (executor driver) (67/144) 2023-02-10 11:11:44 Executor: INFO: Running task 103.0 in stage 1.0 (TID 247) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 98.0 in stage 1.0 (TID 242) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=74, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.8K allocated (297.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 146: Executor task launch worker for task 74.0 in stage 1.0 (TID 218) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 128: Executor task launch worker for task 98.0 in stage 1.0 (TID 242) 2023-02-10 11:11:44 Executor: INFO: Finished task 74.0 in stage 1.0 (TID 218). 1434 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 123: Executor task launch worker for task 93.0 in stage 1.0 (TID 237) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 97.0 in stage 1.0 (TID 241) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 107.0 in stage 1.0 (TID 251) (163.152.180.157, executor driver, partition 107, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 123: Executor task launch worker for task 93.0 in stage 1.0 (TID 237) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 143: Executor task launch worker for task 97.0 in stage 1.0 (TID 241) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 74.0 in stage 1.0 (TID 218) in 912 ms on 163.152.180.157 (executor driver) (68/144) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=69, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 129: Executor task launch worker for task 69.0 in stage 1.0 (TID 213) 2023-02-10 11:11:44 Executor: INFO: Finished task 69.0 in stage 1.0 (TID 213). 1450 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 99.0 in stage 1.0 (TID 243) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 108.0 in stage 1.0 (TID 252) (163.152.180.157, executor driver, partition 108, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 Executor: INFO: Running task 104.0 in stage 1.0 (TID 248) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 100.0 in stage 1.0 (TID 244) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 69.0 in stage 1.0 (TID 213) in 926 ms on 163.152.180.157 (executor driver) (69/144) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 144: Executor task launch worker for task 99.0 in stage 1.0 (TID 243) 2023-02-10 11:11:44 Executor: INFO: Running task 108.0 in stage 1.0 (TID 252) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 102.0 in stage 1.0 (TID 246) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 159: Executor task launch worker for task 102.0 in stage 1.0 (TID 246) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=51, attempt=0, peakBytes=307200, peakBytesReadable=300.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.0K allocated (298.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 125: Executor task launch worker for task 51.0 in stage 1.0 (TID 195) 2023-02-10 11:11:44 Executor: INFO: Finished task 51.0 in stage 1.0 (TID 195). 1410 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 96.0 in stage 1.0 (TID 240) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 142: Executor task launch worker for task 96.0 in stage 1.0 (TID 240) 2023-02-10 11:11:44 Executor: INFO: Running task 107.0 in stage 1.0 (TID 251) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 106.0 in stage 1.0 (TID 250) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 101.0 in stage 1.0 (TID 245) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 152: Executor task launch worker for task 100.0 in stage 1.0 (TID 244) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 109.0 in stage 1.0 (TID 253) (163.152.180.157, executor driver, partition 109, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 147: Executor task launch worker for task 101.0 in stage 1.0 (TID 245) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 158: Executor task launch worker for task 105.0 in stage 1.0 (TID 249) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 158: Executor task launch worker for task 105.0 in stage 1.0 (TID 249) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=66, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 149: Executor task launch worker for task 66.0 in stage 1.0 (TID 210) 2023-02-10 11:11:44 root: INFO: TaskReport: stage=1, partition=76, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:44 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 133: Executor task launch worker for task 76.0 in stage 1.0 (TID 220) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 129: Executor task launch worker for task 108.0 in stage 1.0 (TID 252) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 104.0 in stage 1.0 (TID 248) 2023-02-10 11:11:44 Executor: INFO: Running task 109.0 in stage 1.0 (TID 253) 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 51.0 in stage 1.0 (TID 195) in 991 ms on 163.152.180.157 (executor driver) (70/144) 2023-02-10 11:11:44 Executor: INFO: Finished task 76.0 in stage 1.0 (TID 220). 1420 bytes result sent to driver 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 145: Executor task launch worker for task 104.0 in stage 1.0 (TID 248) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 129: Executor task launch worker for task 108.0 in stage 1.0 (TID 252) 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 110.0 in stage 1.0 (TID 254) (163.152.180.157, executor driver, partition 110, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 76.0 in stage 1.0 (TID 220) in 908 ms on 163.152.180.157 (executor driver) (71/144) 2023-02-10 11:11:44 Executor: INFO: Running task 110.0 in stage 1.0 (TID 254) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 103.0 in stage 1.0 (TID 247) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 126: Executor task launch worker for task 103.0 in stage 1.0 (TID 247) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 107.0 in stage 1.0 (TID 251) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 146: Executor task launch worker for task 107.0 in stage 1.0 (TID 251) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 153: Executor task launch worker for task 106.0 in stage 1.0 (TID 250) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 125: Executor task launch worker for task 109.0 in stage 1.0 (TID 253) 2023-02-10 11:11:44 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 110.0 in stage 1.0 (TID 254) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 125: Executor task launch worker for task 109.0 in stage 1.0 (TID 253) 2023-02-10 11:11:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 133: Executor task launch worker for task 110.0 in stage 1.0 (TID 254) 2023-02-10 11:11:44 Executor: INFO: Finished task 66.0 in stage 1.0 (TID 210). 1439 bytes result sent to driver 2023-02-10 11:11:44 TaskSetManager: INFO: Starting task 111.0 in stage 1.0 (TID 255) (163.152.180.157, executor driver, partition 111, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:44 TaskSetManager: INFO: Finished task 66.0 in stage 1.0 (TID 210) in 1022 ms on 163.152.180.157 (executor driver) (72/144) 2023-02-10 11:11:44 Executor: INFO: Running task 111.0 in stage 1.0 (TID 255) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 149: Executor task launch worker for task 111.0 in stage 1.0 (TID 255) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 149: Executor task launch worker for task 111.0 in stage 1.0 (TID 255) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=67, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=9, cache hits=4 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 301.5K allocated (299.0K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 121: Executor task launch worker for task 67.0 in stage 1.0 (TID 211) 2023-02-10 11:11:45 Executor: INFO: Finished task 67.0 in stage 1.0 (TID 211). 1474 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 112.0 in stage 1.0 (TID 256) (163.152.180.157, executor driver, partition 112, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 67.0 in stage 1.0 (TID 211) in 1029 ms on 163.152.180.157 (executor driver) (73/144) 2023-02-10 11:11:45 Executor: INFO: Running task 112.0 in stage 1.0 (TID 256) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=71, attempt=0, peakBytes=306176, peakBytesReadable=299.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 299.0K allocated (297.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 114: Executor task launch worker for task 71.0 in stage 1.0 (TID 215) 2023-02-10 11:11:45 Executor: INFO: Finished task 71.0 in stage 1.0 (TID 215). 1525 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 113.0 in stage 1.0 (TID 257) (163.152.180.157, executor driver, partition 113, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 71.0 in stage 1.0 (TID 215) in 1046 ms on 163.152.180.157 (executor driver) (74/144) 2023-02-10 11:11:45 Executor: INFO: Running task 113.0 in stage 1.0 (TID 257) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=77, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 301.3K allocated (299.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 141: Executor task launch worker for task 77.0 in stage 1.0 (TID 221) 2023-02-10 11:11:45 Executor: INFO: Finished task 77.0 in stage 1.0 (TID 221). 1545 bytes result sent to driver 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 112.0 in stage 1.0 (TID 256) 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 114.0 in stage 1.0 (TID 258) (163.152.180.157, executor driver, partition 114, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 77.0 in stage 1.0 (TID 221) in 964 ms on 163.152.180.157 (executor driver) (75/144) 2023-02-10 11:11:45 Executor: INFO: Running task 114.0 in stage 1.0 (TID 258) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 140: Executor task launch worker for task 112.0 in stage 1.0 (TID 256) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=78, attempt=0, peakBytes=310016, peakBytesReadable=302.75 KiB, chunks requested=9, cache hits=1 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 302.5K allocated (299.5K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 116: Executor task launch worker for task 78.0 in stage 1.0 (TID 222) 2023-02-10 11:11:45 Executor: INFO: Finished task 78.0 in stage 1.0 (TID 222). 1452 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 115.0 in stage 1.0 (TID 259) (163.152.180.157, executor driver, partition 115, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 78.0 in stage 1.0 (TID 222) in 974 ms on 163.152.180.157 (executor driver) (76/144) 2023-02-10 11:11:45 Executor: INFO: Running task 115.0 in stage 1.0 (TID 259) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 113.0 in stage 1.0 (TID 257) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 114: Executor task launch worker for task 113.0 in stage 1.0 (TID 257) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 121: Executor task launch worker for task 114.0 in stage 1.0 (TID 258) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 121: Executor task launch worker for task 114.0 in stage 1.0 (TID 258) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=79, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 301.3K allocated (298.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 138: Executor task launch worker for task 79.0 in stage 1.0 (TID 223) 2023-02-10 11:11:45 Executor: INFO: Finished task 79.0 in stage 1.0 (TID 223). 1471 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 116.0 in stage 1.0 (TID 260) (163.152.180.157, executor driver, partition 116, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 79.0 in stage 1.0 (TID 223) in 965 ms on 163.152.180.157 (executor driver) (77/144) 2023-02-10 11:11:45 Executor: INFO: Running task 116.0 in stage 1.0 (TID 260) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=46, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=4, cache hits=1 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 132: Executor task launch worker for task 46.0 in stage 1.0 (TID 190) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=45, attempt=0, peakBytes=305920, peakBytesReadable=298.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 298.8K allocated (296.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 119: Executor task launch worker for task 45.0 in stage 1.0 (TID 189) 2023-02-10 11:11:45 Executor: INFO: Finished task 46.0 in stage 1.0 (TID 190). 1716 bytes result sent to driver 2023-02-10 11:11:45 Executor: INFO: Finished task 45.0 in stage 1.0 (TID 189). 1536 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 117.0 in stage 1.0 (TID 261) (163.152.180.157, executor driver, partition 117, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 46.0 in stage 1.0 (TID 190) in 1216 ms on 163.152.180.157 (executor driver) (78/144) 2023-02-10 11:11:45 Executor: INFO: Running task 117.0 in stage 1.0 (TID 261) 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 118.0 in stage 1.0 (TID 262) (163.152.180.157, executor driver, partition 118, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 Executor: INFO: Running task 118.0 in stage 1.0 (TID 262) 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 45.0 in stage 1.0 (TID 189) in 1218 ms on 163.152.180.157 (executor driver) (79/144) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 116.0 in stage 1.0 (TID 260) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 115.0 in stage 1.0 (TID 259) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 141: Executor task launch worker for task 116.0 in stage 1.0 (TID 260) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 116: Executor task launch worker for task 115.0 in stage 1.0 (TID 259) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 138: Executor task launch worker for task 117.0 in stage 1.0 (TID 261) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 138: Executor task launch worker for task 117.0 in stage 1.0 (TID 261) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 118.0 in stage 1.0 (TID 262) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 119: Executor task launch worker for task 118.0 in stage 1.0 (TID 262) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=68, attempt=0, peakBytes=304640, peakBytesReadable=297.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 297.5K allocated (295.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 151: Executor task launch worker for task 68.0 in stage 1.0 (TID 212) 2023-02-10 11:11:45 Executor: INFO: Finished task 68.0 in stage 1.0 (TID 212). 1468 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 119.0 in stage 1.0 (TID 263) (163.152.180.157, executor driver, partition 119, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 68.0 in stage 1.0 (TID 212) in 1211 ms on 163.152.180.157 (executor driver) (80/144) 2023-02-10 11:11:45 Executor: INFO: Running task 119.0 in stage 1.0 (TID 263) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 119.0 in stage 1.0 (TID 263) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 132: Executor task launch worker for task 119.0 in stage 1.0 (TID 263) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=82, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 305.8K allocated (303.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 122: Executor task launch worker for task 82.0 in stage 1.0 (TID 226) 2023-02-10 11:11:45 Executor: INFO: Finished task 82.0 in stage 1.0 (TID 226). 1484 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 120.0 in stage 1.0 (TID 264) (163.152.180.157, executor driver, partition 120, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 Executor: INFO: Running task 120.0 in stage 1.0 (TID 264) 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 82.0 in stage 1.0 (TID 226) in 919 ms on 163.152.180.157 (executor driver) (81/144) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=80, attempt=0, peakBytes=310272, peakBytesReadable=303.00 KiB, chunks requested=15, cache hits=7 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 303.0K allocated (301.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 136: Executor task launch worker for task 80.0 in stage 1.0 (TID 224) 2023-02-10 11:11:45 Executor: INFO: Finished task 80.0 in stage 1.0 (TID 224). 1510 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 121.0 in stage 1.0 (TID 265) (163.152.180.157, executor driver, partition 121, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 80.0 in stage 1.0 (TID 224) in 933 ms on 163.152.180.157 (executor driver) (82/144) 2023-02-10 11:11:45 Executor: INFO: Running task 121.0 in stage 1.0 (TID 265) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=97, attempt=0, peakBytes=310784, peakBytesReadable=303.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 303.5K allocated (301.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 143: Executor task launch worker for task 97.0 in stage 1.0 (TID 241) 2023-02-10 11:11:45 Executor: INFO: Finished task 97.0 in stage 1.0 (TID 241). 1477 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 122.0 in stage 1.0 (TID 266) (163.152.180.157, executor driver, partition 122, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 97.0 in stage 1.0 (TID 241) in 881 ms on 163.152.180.157 (executor driver) (83/144) 2023-02-10 11:11:45 Executor: INFO: Running task 122.0 in stage 1.0 (TID 266) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 120.0 in stage 1.0 (TID 264) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 151: Executor task launch worker for task 120.0 in stage 1.0 (TID 264) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=83, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 305.0K allocated (303.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 127: Executor task launch worker for task 83.0 in stage 1.0 (TID 227) 2023-02-10 11:11:45 Executor: INFO: Finished task 83.0 in stage 1.0 (TID 227). 1499 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 123.0 in stage 1.0 (TID 267) (163.152.180.157, executor driver, partition 123, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 83.0 in stage 1.0 (TID 227) in 937 ms on 163.152.180.157 (executor driver) (84/144) 2023-02-10 11:11:45 Executor: INFO: Running task 123.0 in stage 1.0 (TID 267) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=85, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=7, cache hits=2 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 305.5K allocated (303.0K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 148: Executor task launch worker for task 85.0 in stage 1.0 (TID 229) 2023-02-10 11:11:45 Executor: INFO: Finished task 85.0 in stage 1.0 (TID 229). 1520 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 124.0 in stage 1.0 (TID 268) (163.152.180.157, executor driver, partition 124, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 85.0 in stage 1.0 (TID 229) in 930 ms on 163.152.180.157 (executor driver) (85/144) 2023-02-10 11:11:45 Executor: INFO: Running task 124.0 in stage 1.0 (TID 268) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 121.0 in stage 1.0 (TID 265) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 136: Executor task launch worker for task 121.0 in stage 1.0 (TID 265) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=91, attempt=0, peakBytes=312064, peakBytesReadable=304.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 304.8K allocated (302.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 130: Executor task launch worker for task 91.0 in stage 1.0 (TID 235) 2023-02-10 11:11:45 Executor: INFO: Finished task 91.0 in stage 1.0 (TID 235). 1479 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 125.0 in stage 1.0 (TID 269) (163.152.180.157, executor driver, partition 125, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 91.0 in stage 1.0 (TID 235) in 927 ms on 163.152.180.157 (executor driver) (86/144) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 122.0 in stage 1.0 (TID 266) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 123.0 in stage 1.0 (TID 267) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 143: Executor task launch worker for task 123.0 in stage 1.0 (TID 267) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 122: Executor task launch worker for task 122.0 in stage 1.0 (TID 266) 2023-02-10 11:11:45 Executor: INFO: Running task 125.0 in stage 1.0 (TID 269) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 124.0 in stage 1.0 (TID 268) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=87, attempt=0, peakBytes=318976, peakBytesReadable=311.50 KiB, chunks requested=15, cache hits=5 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=95, attempt=0, peakBytes=311296, peakBytesReadable=304.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 311.5K allocated (308.0K blocks / 3.5K chunks), regions.size = 9, 0 current java objects, thread 118: Executor task launch worker for task 87.0 in stage 1.0 (TID 231) 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 304.0K allocated (302.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 137: Executor task launch worker for task 95.0 in stage 1.0 (TID 239) 2023-02-10 11:11:45 Executor: INFO: Finished task 87.0 in stage 1.0 (TID 231). 1498 bytes result sent to driver 2023-02-10 11:11:45 Executor: INFO: Finished task 95.0 in stage 1.0 (TID 239). 1519 bytes result sent to driver 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=92, attempt=0, peakBytes=311040, peakBytesReadable=303.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 303.8K allocated (301.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 120: Executor task launch worker for task 92.0 in stage 1.0 (TID 236) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 127: Executor task launch worker for task 124.0 in stage 1.0 (TID 268) 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 126.0 in stage 1.0 (TID 270) (163.152.180.157, executor driver, partition 126, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 Executor: INFO: Finished task 92.0 in stage 1.0 (TID 236). 1476 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 87.0 in stage 1.0 (TID 231) in 951 ms on 163.152.180.157 (executor driver) (87/144) 2023-02-10 11:11:45 Executor: INFO: Running task 126.0 in stage 1.0 (TID 270) 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 127.0 in stage 1.0 (TID 271) (163.152.180.157, executor driver, partition 127, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 Executor: INFO: Running task 127.0 in stage 1.0 (TID 271) 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 128.0 in stage 1.0 (TID 272) (163.152.180.157, executor driver, partition 128, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 Executor: INFO: Running task 128.0 in stage 1.0 (TID 272) 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 92.0 in stage 1.0 (TID 236) in 936 ms on 163.152.180.157 (executor driver) (88/144) 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 95.0 in stage 1.0 (TID 239) in 932 ms on 163.152.180.157 (executor driver) (89/144) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=88, attempt=0, peakBytes=312576, peakBytesReadable=305.25 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 305.3K allocated (302.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 117: Executor task launch worker for task 88.0 in stage 1.0 (TID 232) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=98, attempt=0, peakBytes=312064, peakBytesReadable=304.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 304.8K allocated (302.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 128: Executor task launch worker for task 98.0 in stage 1.0 (TID 242) 2023-02-10 11:11:45 Executor: INFO: Finished task 88.0 in stage 1.0 (TID 232). 1487 bytes result sent to driver 2023-02-10 11:11:45 Executor: INFO: Finished task 98.0 in stage 1.0 (TID 242). 1503 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 129.0 in stage 1.0 (TID 273) (163.152.180.157, executor driver, partition 129, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 88.0 in stage 1.0 (TID 232) in 960 ms on 163.152.180.157 (executor driver) (90/144) 2023-02-10 11:11:45 Executor: INFO: Running task 129.0 in stage 1.0 (TID 273) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=89, attempt=0, peakBytes=316160, peakBytesReadable=308.75 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 308.8K allocated (306.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 115: Executor task launch worker for task 89.0 in stage 1.0 (TID 233) 2023-02-10 11:11:45 Executor: INFO: Finished task 89.0 in stage 1.0 (TID 233). 1550 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 130.0 in stage 1.0 (TID 274) (163.152.180.157, executor driver, partition 130, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 89.0 in stage 1.0 (TID 233) in 963 ms on 163.152.180.157 (executor driver) (91/144) 2023-02-10 11:11:45 Executor: INFO: Running task 130.0 in stage 1.0 (TID 274) 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 131.0 in stage 1.0 (TID 275) (163.152.180.157, executor driver, partition 131, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 98.0 in stage 1.0 (TID 242) in 936 ms on 163.152.180.157 (executor driver) (92/144) 2023-02-10 11:11:45 Executor: INFO: Running task 131.0 in stage 1.0 (TID 275) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=103, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 126: Executor task launch worker for task 103.0 in stage 1.0 (TID 247) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 125.0 in stage 1.0 (TID 269) 2023-02-10 11:11:45 Executor: INFO: Finished task 103.0 in stage 1.0 (TID 247). 1510 bytes result sent to driver 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=81, attempt=0, peakBytes=317696, peakBytesReadable=310.25 KiB, chunks requested=10, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 309.8K allocated (306.3K blocks / 3.5K chunks), regions.size = 9, 0 current java objects, thread 131: Executor task launch worker for task 81.0 in stage 1.0 (TID 225) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 130: Executor task launch worker for task 125.0 in stage 1.0 (TID 269) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=104, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 305.0K allocated (303.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 145: Executor task launch worker for task 104.0 in stage 1.0 (TID 248) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=96, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 142: Executor task launch worker for task 96.0 in stage 1.0 (TID 240) 2023-02-10 11:11:45 Executor: INFO: Finished task 96.0 in stage 1.0 (TID 240). 1476 bytes result sent to driver 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 128.0 in stage 1.0 (TID 272) 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 132.0 in stage 1.0 (TID 276) (163.152.180.157, executor driver, partition 132, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 103.0 in stage 1.0 (TID 247) in 936 ms on 163.152.180.157 (executor driver) (93/144) 2023-02-10 11:11:45 Executor: INFO: Finished task 81.0 in stage 1.0 (TID 225). 1614 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 133.0 in stage 1.0 (TID 277) (163.152.180.157, executor driver, partition 133, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 Executor: INFO: Finished task 104.0 in stage 1.0 (TID 248). 1474 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 96.0 in stage 1.0 (TID 240) in 956 ms on 163.152.180.157 (executor driver) (94/144) 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 134.0 in stage 1.0 (TID 278) (163.152.180.157, executor driver, partition 134, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 118: Executor task launch worker for task 128.0 in stage 1.0 (TID 272) 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 104.0 in stage 1.0 (TID 248) in 936 ms on 163.152.180.157 (executor driver) (95/144) 2023-02-10 11:11:45 Executor: INFO: Running task 134.0 in stage 1.0 (TID 278) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 127.0 in stage 1.0 (TID 271) 2023-02-10 11:11:45 Executor: INFO: Running task 133.0 in stage 1.0 (TID 277) 2023-02-10 11:11:45 Executor: INFO: Running task 132.0 in stage 1.0 (TID 276) 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 135.0 in stage 1.0 (TID 279) (163.152.180.157, executor driver, partition 135, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 81.0 in stage 1.0 (TID 225) in 1012 ms on 163.152.180.157 (executor driver) (96/144) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 120: Executor task launch worker for task 127.0 in stage 1.0 (TID 271) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=94, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 124: Executor task launch worker for task 94.0 in stage 1.0 (TID 238) 2023-02-10 11:11:45 Executor: INFO: Finished task 94.0 in stage 1.0 (TID 238). 1492 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 136.0 in stage 1.0 (TID 280) (163.152.180.157, executor driver, partition 136, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 Executor: INFO: Running task 136.0 in stage 1.0 (TID 280) 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 94.0 in stage 1.0 (TID 238) in 965 ms on 163.152.180.157 (executor driver) (97/144) 2023-02-10 11:11:45 Executor: INFO: Running task 135.0 in stage 1.0 (TID 279) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 130.0 in stage 1.0 (TID 274) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 128: Executor task launch worker for task 130.0 in stage 1.0 (TID 274) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 129.0 in stage 1.0 (TID 273) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 148: Executor task launch worker for task 129.0 in stage 1.0 (TID 273) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 131.0 in stage 1.0 (TID 275) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 115: Executor task launch worker for task 131.0 in stage 1.0 (TID 275) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 126.0 in stage 1.0 (TID 270) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=99, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 305.0K allocated (303.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 144: Executor task launch worker for task 99.0 in stage 1.0 (TID 243) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 137: Executor task launch worker for task 126.0 in stage 1.0 (TID 270) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=102, attempt=0, peakBytes=314112, peakBytesReadable=306.75 KiB, chunks requested=6, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 306.5K allocated (304.0K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 159: Executor task launch worker for task 102.0 in stage 1.0 (TID 246) 2023-02-10 11:11:45 Executor: INFO: Finished task 99.0 in stage 1.0 (TID 243). 1513 bytes result sent to driver 2023-02-10 11:11:45 Executor: INFO: Finished task 102.0 in stage 1.0 (TID 246). 1526 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 137.0 in stage 1.0 (TID 281) (163.152.180.157, executor driver, partition 137, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 99.0 in stage 1.0 (TID 243) in 965 ms on 163.152.180.157 (executor driver) (98/144) 2023-02-10 11:11:45 Executor: INFO: Running task 137.0 in stage 1.0 (TID 281) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=100, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 135.0 in stage 1.0 (TID 279) 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 305.8K allocated (303.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 152: Executor task launch worker for task 100.0 in stage 1.0 (TID 244) 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 138.0 in stage 1.0 (TID 282) (163.152.180.157, executor driver, partition 138, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 131: Executor task launch worker for task 135.0 in stage 1.0 (TID 279) 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 102.0 in stage 1.0 (TID 246) in 963 ms on 163.152.180.157 (executor driver) (99/144) 2023-02-10 11:11:45 Executor: INFO: Finished task 100.0 in stage 1.0 (TID 244). 1491 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 139.0 in stage 1.0 (TID 283) (163.152.180.157, executor driver, partition 139, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 100.0 in stage 1.0 (TID 244) in 966 ms on 163.152.180.157 (executor driver) (100/144) 2023-02-10 11:11:45 Executor: INFO: Running task 139.0 in stage 1.0 (TID 283) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 132.0 in stage 1.0 (TID 276) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=108, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 129: Executor task launch worker for task 108.0 in stage 1.0 (TID 252) 2023-02-10 11:11:45 Executor: INFO: Running task 138.0 in stage 1.0 (TID 282) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 134.0 in stage 1.0 (TID 278) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 142: Executor task launch worker for task 132.0 in stage 1.0 (TID 276) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 145: Executor task launch worker for task 134.0 in stage 1.0 (TID 278) 2023-02-10 11:11:45 Executor: INFO: Finished task 108.0 in stage 1.0 (TID 252). 1476 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 140.0 in stage 1.0 (TID 284) (163.152.180.157, executor driver, partition 140, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 Executor: INFO: Running task 140.0 in stage 1.0 (TID 284) 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 108.0 in stage 1.0 (TID 252) in 962 ms on 163.152.180.157 (executor driver) (101/144) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 136.0 in stage 1.0 (TID 280) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 117: Executor task launch worker for task 136.0 in stage 1.0 (TID 280) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=110, attempt=0, peakBytes=312576, peakBytesReadable=305.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 305.3K allocated (303.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 133: Executor task launch worker for task 110.0 in stage 1.0 (TID 254) 2023-02-10 11:11:45 Executor: INFO: Finished task 110.0 in stage 1.0 (TID 254). 1659 bytes result sent to driver 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=107, attempt=0, peakBytes=311296, peakBytesReadable=304.00 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 304.0K allocated (302.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 146: Executor task launch worker for task 107.0 in stage 1.0 (TID 251) 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 141.0 in stage 1.0 (TID 285) (163.152.180.157, executor driver, partition 141, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 Executor: INFO: Finished task 107.0 in stage 1.0 (TID 251). 1502 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 110.0 in stage 1.0 (TID 254) in 952 ms on 163.152.180.157 (executor driver) (102/144) 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 142.0 in stage 1.0 (TID 286) (163.152.180.157, executor driver, partition 142, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 Executor: INFO: Running task 142.0 in stage 1.0 (TID 286) 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 107.0 in stage 1.0 (TID 251) in 969 ms on 163.152.180.157 (executor driver) (103/144) 2023-02-10 11:11:45 Executor: INFO: Running task 141.0 in stage 1.0 (TID 285) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=101, attempt=0, peakBytes=311552, peakBytesReadable=304.25 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 304.3K allocated (301.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 147: Executor task launch worker for task 101.0 in stage 1.0 (TID 245) 2023-02-10 11:11:45 Executor: INFO: Finished task 101.0 in stage 1.0 (TID 245). 1487 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Starting task 143.0 in stage 1.0 (TID 287) (163.152.180.157, executor driver, partition 143, PROCESS_LOCAL, 4378 bytes) taskResourceAssignments Map() 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 101.0 in stage 1.0 (TID 245) in 986 ms on 163.152.180.157 (executor driver) (104/144) 2023-02-10 11:11:45 Executor: INFO: Running task 143.0 in stage 1.0 (TID 287) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 137.0 in stage 1.0 (TID 281) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=93, attempt=0, peakBytes=313600, peakBytesReadable=306.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 306.3K allocated (304.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 123: Executor task launch worker for task 93.0 in stage 1.0 (TID 237) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 124: Executor task launch worker for task 137.0 in stage 1.0 (TID 281) 2023-02-10 11:11:45 Executor: INFO: Finished task 93.0 in stage 1.0 (TID 237). 1486 bytes result sent to driver 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 139.0 in stage 1.0 (TID 283) 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 93.0 in stage 1.0 (TID 237) in 1013 ms on 163.152.180.157 (executor driver) (105/144) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 144: Executor task launch worker for task 139.0 in stage 1.0 (TID 283) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=86, attempt=0, peakBytes=312064, peakBytesReadable=304.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 304.8K allocated (302.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 150: Executor task launch worker for task 86.0 in stage 1.0 (TID 230) 2023-02-10 11:11:45 Executor: INFO: Finished task 86.0 in stage 1.0 (TID 230). 1482 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 86.0 in stage 1.0 (TID 230) in 1034 ms on 163.152.180.157 (executor driver) (106/144) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 133.0 in stage 1.0 (TID 277) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 126: Executor task launch worker for task 133.0 in stage 1.0 (TID 277) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 129: Executor task launch worker for task 143.0 in stage 1.0 (TID 287) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 129: Executor task launch worker for task 143.0 in stage 1.0 (TID 287) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 142.0 in stage 1.0 (TID 286) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 133: Executor task launch worker for task 142.0 in stage 1.0 (TID 286) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=105, attempt=0, peakBytes=311552, peakBytesReadable=304.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 304.3K allocated (302.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 158: Executor task launch worker for task 105.0 in stage 1.0 (TID 249) 2023-02-10 11:11:45 Executor: INFO: Finished task 105.0 in stage 1.0 (TID 249). 1504 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 105.0 in stage 1.0 (TID 249) in 1003 ms on 163.152.180.157 (executor driver) (107/144) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 138.0 in stage 1.0 (TID 282) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=109, attempt=0, peakBytes=314112, peakBytesReadable=306.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 306.8K allocated (304.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 125: Executor task launch worker for task 109.0 in stage 1.0 (TID 253) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 140.0 in stage 1.0 (TID 284) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 152: Executor task launch worker for task 140.0 in stage 1.0 (TID 284) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 159: Executor task launch worker for task 138.0 in stage 1.0 (TID 282) 2023-02-10 11:11:45 Executor: INFO: Finished task 109.0 in stage 1.0 (TID 253). 1502 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 109.0 in stage 1.0 (TID 253) in 998 ms on 163.152.180.157 (executor driver) (108/144) 2023-02-10 11:11:45 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 141.0 in stage 1.0 (TID 285) 2023-02-10 11:11:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 146: Executor task launch worker for task 141.0 in stage 1.0 (TID 285) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=106, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 305.0K allocated (303.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 153: Executor task launch worker for task 106.0 in stage 1.0 (TID 250) 2023-02-10 11:11:45 Executor: INFO: Finished task 106.0 in stage 1.0 (TID 250). 1659 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 106.0 in stage 1.0 (TID 250) in 1024 ms on 163.152.180.157 (executor driver) (109/144) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=112, attempt=0, peakBytes=312064, peakBytesReadable=304.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 304.8K allocated (302.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 140: Executor task launch worker for task 112.0 in stage 1.0 (TID 256) 2023-02-10 11:11:45 Executor: INFO: Finished task 112.0 in stage 1.0 (TID 256). 1437 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 112.0 in stage 1.0 (TID 256) in 922 ms on 163.152.180.157 (executor driver) (110/144) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=113, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 305.0K allocated (303.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 114: Executor task launch worker for task 113.0 in stage 1.0 (TID 257) 2023-02-10 11:11:45 Executor: INFO: Finished task 113.0 in stage 1.0 (TID 257). 1460 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 113.0 in stage 1.0 (TID 257) in 906 ms on 163.152.180.157 (executor driver) (111/144) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=111, attempt=0, peakBytes=311296, peakBytesReadable=304.00 KiB, chunks requested=4, cache hits=1 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 303.8K allocated (301.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 149: Executor task launch worker for task 111.0 in stage 1.0 (TID 255) 2023-02-10 11:11:45 Executor: INFO: Finished task 111.0 in stage 1.0 (TID 255). 1435 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 111.0 in stage 1.0 (TID 255) in 976 ms on 163.152.180.157 (executor driver) (112/144) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=84, attempt=0, peakBytes=316416, peakBytesReadable=309.00 KiB, chunks requested=4, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 309.0K allocated (306.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 139: Executor task launch worker for task 84.0 in stage 1.0 (TID 228) 2023-02-10 11:11:45 Executor: INFO: Finished task 84.0 in stage 1.0 (TID 228). 1661 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 84.0 in stage 1.0 (TID 228) in 1129 ms on 163.152.180.157 (executor driver) (113/144) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=115, attempt=0, peakBytes=313600, peakBytesReadable=306.25 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 306.3K allocated (303.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 116: Executor task launch worker for task 115.0 in stage 1.0 (TID 259) 2023-02-10 11:11:45 root: INFO: TaskReport: stage=1, partition=118, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:45 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 119: Executor task launch worker for task 118.0 in stage 1.0 (TID 262) 2023-02-10 11:11:45 Executor: INFO: Finished task 115.0 in stage 1.0 (TID 259). 1556 bytes result sent to driver 2023-02-10 11:11:45 Executor: INFO: Finished task 118.0 in stage 1.0 (TID 262). 1502 bytes result sent to driver 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 115.0 in stage 1.0 (TID 259) in 942 ms on 163.152.180.157 (executor driver) (114/144) 2023-02-10 11:11:45 TaskSetManager: INFO: Finished task 118.0 in stage 1.0 (TID 262) in 912 ms on 163.152.180.157 (executor driver) (115/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=90, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 305.8K allocated (303.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 134: Executor task launch worker for task 90.0 in stage 1.0 (TID 234) 2023-02-10 11:11:46 Executor: INFO: Finished task 90.0 in stage 1.0 (TID 234). 1474 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 90.0 in stage 1.0 (TID 234) in 1145 ms on 163.152.180.157 (executor driver) (116/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=114, attempt=0, peakBytes=313344, peakBytesReadable=306.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 306.0K allocated (304.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 121: Executor task launch worker for task 114.0 in stage 1.0 (TID 258) 2023-02-10 11:11:46 Executor: INFO: Finished task 114.0 in stage 1.0 (TID 258). 1434 bytes result sent to driver 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=116, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 114.0 in stage 1.0 (TID 258) in 990 ms on 163.152.180.157 (executor driver) (117/144) 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 305.8K allocated (303.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 141: Executor task launch worker for task 116.0 in stage 1.0 (TID 260) 2023-02-10 11:11:46 Executor: INFO: Finished task 116.0 in stage 1.0 (TID 260). 1483 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 116.0 in stage 1.0 (TID 260) in 952 ms on 163.152.180.157 (executor driver) (118/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=117, attempt=0, peakBytes=311040, peakBytesReadable=303.75 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 303.8K allocated (301.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 138: Executor task launch worker for task 117.0 in stage 1.0 (TID 261) 2023-02-10 11:11:46 Executor: INFO: Finished task 117.0 in stage 1.0 (TID 261). 1457 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 117.0 in stage 1.0 (TID 261) in 968 ms on 163.152.180.157 (executor driver) (119/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=119, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 302.5K allocated (300.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 132: Executor task launch worker for task 119.0 in stage 1.0 (TID 263) 2023-02-10 11:11:46 Executor: INFO: Finished task 119.0 in stage 1.0 (TID 263). 1439 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 119.0 in stage 1.0 (TID 263) in 930 ms on 163.152.180.157 (executor driver) (120/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=122, attempt=0, peakBytes=314112, peakBytesReadable=306.75 KiB, chunks requested=3, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 306.8K allocated (304.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 122: Executor task launch worker for task 122.0 in stage 1.0 (TID 266) 2023-02-10 11:11:46 Executor: INFO: Finished task 122.0 in stage 1.0 (TID 266). 1441 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 122.0 in stage 1.0 (TID 266) in 811 ms on 163.152.180.157 (executor driver) (121/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=121, attempt=0, peakBytes=314624, peakBytesReadable=307.25 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 307.0K allocated (305.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 136: Executor task launch worker for task 121.0 in stage 1.0 (TID 265) 2023-02-10 11:11:46 Executor: INFO: Finished task 121.0 in stage 1.0 (TID 265). 1453 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 121.0 in stage 1.0 (TID 265) in 840 ms on 163.152.180.157 (executor driver) (122/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=126, attempt=0, peakBytes=312064, peakBytesReadable=304.75 KiB, chunks requested=4, cache hits=1 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 304.8K allocated (302.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 137: Executor task launch worker for task 126.0 in stage 1.0 (TID 270) 2023-02-10 11:11:46 Executor: INFO: Finished task 126.0 in stage 1.0 (TID 270). 1468 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 126.0 in stage 1.0 (TID 270) in 797 ms on 163.152.180.157 (executor driver) (123/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=120, attempt=0, peakBytes=312576, peakBytesReadable=305.25 KiB, chunks requested=9, cache hits=2 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 305.3K allocated (302.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 151: Executor task launch worker for task 120.0 in stage 1.0 (TID 264) 2023-02-10 11:11:46 Executor: INFO: Finished task 120.0 in stage 1.0 (TID 264). 1468 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 120.0 in stage 1.0 (TID 264) in 864 ms on 163.152.180.157 (executor driver) (124/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=134, attempt=0, peakBytes=315648, peakBytesReadable=308.25 KiB, chunks requested=9, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 308.3K allocated (305.3K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 145: Executor task launch worker for task 134.0 in stage 1.0 (TID 278) 2023-02-10 11:11:46 Executor: INFO: Finished task 134.0 in stage 1.0 (TID 278). 1431 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 134.0 in stage 1.0 (TID 278) in 782 ms on 163.152.180.157 (executor driver) (125/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=127, attempt=0, peakBytes=314112, peakBytesReadable=306.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 306.8K allocated (304.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 120: Executor task launch worker for task 127.0 in stage 1.0 (TID 271) 2023-02-10 11:11:46 Executor: INFO: Finished task 127.0 in stage 1.0 (TID 271). 1438 bytes result sent to driver 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=138, attempt=0, peakBytes=315136, peakBytesReadable=307.75 KiB, chunks requested=7, cache hits=1 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 127.0 in stage 1.0 (TID 271) in 814 ms on 163.152.180.157 (executor driver) (126/144) 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 307.8K allocated (303.8K blocks / 4.0K chunks), regions.size = 9, 0 current java objects, thread 159: Executor task launch worker for task 138.0 in stage 1.0 (TID 282) 2023-02-10 11:11:46 Executor: INFO: Finished task 138.0 in stage 1.0 (TID 282). 1482 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 138.0 in stage 1.0 (TID 282) in 767 ms on 163.152.180.157 (executor driver) (127/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=132, attempt=0, peakBytes=315136, peakBytesReadable=307.75 KiB, chunks requested=8, cache hits=2 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 307.8K allocated (304.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 142: Executor task launch worker for task 132.0 in stage 1.0 (TID 276) 2023-02-10 11:11:46 Executor: INFO: Finished task 132.0 in stage 1.0 (TID 276). 1445 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 132.0 in stage 1.0 (TID 276) in 815 ms on 163.152.180.157 (executor driver) (128/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=128, attempt=0, peakBytes=325376, peakBytesReadable=317.75 KiB, chunks requested=19, cache hits=3 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 317.8K allocated (315.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 118: Executor task launch worker for task 128.0 in stage 1.0 (TID 272) 2023-02-10 11:11:46 Executor: INFO: Finished task 128.0 in stage 1.0 (TID 272). 1453 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 128.0 in stage 1.0 (TID 272) in 861 ms on 163.152.180.157 (executor driver) (129/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=143, attempt=0, peakBytes=322816, peakBytesReadable=315.25 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 315.3K allocated (313.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 129: Executor task launch worker for task 143.0 in stage 1.0 (TID 287) 2023-02-10 11:11:46 Executor: INFO: Finished task 143.0 in stage 1.0 (TID 287). 1728 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 143.0 in stage 1.0 (TID 287) in 814 ms on 163.152.180.157 (executor driver) (130/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=142, attempt=0, peakBytes=318976, peakBytesReadable=311.50 KiB, chunks requested=5, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 311.5K allocated (309.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 133: Executor task launch worker for task 142.0 in stage 1.0 (TID 286) 2023-02-10 11:11:46 Executor: INFO: Finished task 142.0 in stage 1.0 (TID 286). 1563 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 142.0 in stage 1.0 (TID 286) in 825 ms on 163.152.180.157 (executor driver) (131/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=141, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 299.8K allocated (297.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 146: Executor task launch worker for task 141.0 in stage 1.0 (TID 285) 2023-02-10 11:11:46 Executor: INFO: Finished task 141.0 in stage 1.0 (TID 285). 1440 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 141.0 in stage 1.0 (TID 285) in 827 ms on 163.152.180.157 (executor driver) (132/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=123, attempt=0, peakBytes=313344, peakBytesReadable=306.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 306.0K allocated (304.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 143: Executor task launch worker for task 123.0 in stage 1.0 (TID 267) 2023-02-10 11:11:46 Executor: INFO: Finished task 123.0 in stage 1.0 (TID 267). 1445 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 123.0 in stage 1.0 (TID 267) in 1008 ms on 163.152.180.157 (executor driver) (133/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=124, attempt=0, peakBytes=317696, peakBytesReadable=310.25 KiB, chunks requested=11, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 310.3K allocated (306.8K blocks / 3.5K chunks), regions.size = 9, 0 current java objects, thread 127: Executor task launch worker for task 124.0 in stage 1.0 (TID 268) 2023-02-10 11:11:46 Executor: INFO: Finished task 124.0 in stage 1.0 (TID 268). 1453 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 124.0 in stage 1.0 (TID 268) in 1004 ms on 163.152.180.157 (executor driver) (134/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=135, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 305.8K allocated (303.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 131: Executor task launch worker for task 135.0 in stage 1.0 (TID 279) 2023-02-10 11:11:46 Executor: INFO: Finished task 135.0 in stage 1.0 (TID 279). 1567 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 135.0 in stage 1.0 (TID 279) in 1020 ms on 163.152.180.157 (executor driver) (135/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=131, attempt=0, peakBytes=313344, peakBytesReadable=306.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 306.0K allocated (304.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 115: Executor task launch worker for task 131.0 in stage 1.0 (TID 275) 2023-02-10 11:11:46 Executor: INFO: Finished task 131.0 in stage 1.0 (TID 275). 1550 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 131.0 in stage 1.0 (TID 275) in 1041 ms on 163.152.180.157 (executor driver) (136/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=129, attempt=0, peakBytes=317184, peakBytesReadable=309.75 KiB, chunks requested=7, cache hits=1 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 309.8K allocated (307.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 148: Executor task launch worker for task 129.0 in stage 1.0 (TID 273) 2023-02-10 11:11:46 Executor: INFO: Finished task 129.0 in stage 1.0 (TID 273). 1482 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 129.0 in stage 1.0 (TID 273) in 1053 ms on 163.152.180.157 (executor driver) (137/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=136, attempt=0, peakBytes=316416, peakBytesReadable=309.00 KiB, chunks requested=8, cache hits=1 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 308.8K allocated (305.8K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 117: Executor task launch worker for task 136.0 in stage 1.0 (TID 280) 2023-02-10 11:11:46 Executor: INFO: Finished task 136.0 in stage 1.0 (TID 280). 1532 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 136.0 in stage 1.0 (TID 280) in 1038 ms on 163.152.180.157 (executor driver) (138/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=125, attempt=0, peakBytes=314112, peakBytesReadable=306.75 KiB, chunks requested=5, cache hits=2 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 306.8K allocated (304.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 130: Executor task launch worker for task 125.0 in stage 1.0 (TID 269) 2023-02-10 11:11:46 Executor: INFO: Finished task 125.0 in stage 1.0 (TID 269). 1532 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 125.0 in stage 1.0 (TID 269) in 1089 ms on 163.152.180.157 (executor driver) (139/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=130, attempt=0, peakBytes=314624, peakBytesReadable=307.25 KiB, chunks requested=2, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 307.3K allocated (305.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 128: Executor task launch worker for task 130.0 in stage 1.0 (TID 274) 2023-02-10 11:11:46 Executor: INFO: Finished task 130.0 in stage 1.0 (TID 274). 1554 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 130.0 in stage 1.0 (TID 274) in 1061 ms on 163.152.180.157 (executor driver) (140/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=137, attempt=0, peakBytes=311040, peakBytesReadable=303.75 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 303.8K allocated (301.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 124: Executor task launch worker for task 137.0 in stage 1.0 (TID 281) 2023-02-10 11:11:46 Executor: INFO: Finished task 137.0 in stage 1.0 (TID 281). 1485 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 137.0 in stage 1.0 (TID 281) in 1047 ms on 163.152.180.157 (executor driver) (141/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=133, attempt=0, peakBytes=314112, peakBytesReadable=306.75 KiB, chunks requested=8, cache hits=3 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 306.8K allocated (304.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 126: Executor task launch worker for task 133.0 in stage 1.0 (TID 277) 2023-02-10 11:11:46 Executor: INFO: Finished task 133.0 in stage 1.0 (TID 277). 1519 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 133.0 in stage 1.0 (TID 277) in 1072 ms on 163.152.180.157 (executor driver) (142/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=140, attempt=0, peakBytes=308224, peakBytesReadable=301.00 KiB, chunks requested=1, cache hits=0 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 301.0K allocated (299.0K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 152: Executor task launch worker for task 140.0 in stage 1.0 (TID 284) 2023-02-10 11:11:46 Executor: INFO: Finished task 140.0 in stage 1.0 (TID 284). 1459 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 140.0 in stage 1.0 (TID 284) in 1042 ms on 163.152.180.157 (executor driver) (143/144) 2023-02-10 11:11:46 root: INFO: TaskReport: stage=1, partition=139, attempt=0, peakBytes=311552, peakBytesReadable=304.25 KiB, chunks requested=14, cache hits=8 2023-02-10 11:11:46 root: INFO: RegionPool: FREE: 304.3K allocated (300.8K blocks / 3.5K chunks), regions.size = 9, 0 current java objects, thread 144: Executor task launch worker for task 139.0 in stage 1.0 (TID 283) 2023-02-10 11:11:46 Executor: INFO: Finished task 139.0 in stage 1.0 (TID 283). 1462 bytes result sent to driver 2023-02-10 11:11:46 TaskSetManager: INFO: Finished task 139.0 in stage 1.0 (TID 283) in 1074 ms on 163.152.180.157 (executor driver) (144/144) 2023-02-10 11:11:46 TaskSchedulerImpl: INFO: Removed TaskSet 1.0, whose tasks have all completed, from pool 2023-02-10 11:11:46 DAGScheduler: INFO: ResultStage 1 (collect at SparkBackend.scala:288) finished in 4.577 s 2023-02-10 11:11:46 DAGScheduler: INFO: Job 1 is finished. Cancelling potential speculative or zombie tasks for this job 2023-02-10 11:11:46 TaskSchedulerImpl: INFO: Killing all running tasks in stage 1: Stage finished 2023-02-10 11:11:46 DAGScheduler: INFO: Job 1 finished: collect at SparkBackend.scala:288, took 4.582289 s 2023-02-10 11:11:46 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 2, 0 current java objects, thread 28: Thread-5 2023-02-10 11:11:46 Hail: INFO: Coerced prefix-sorted dataset 2023-02-10 11:11:46 root: INFO: optimize optimize: compileLowerer, initial IR: before: IR size 12: (Let __iruid_989 (Literal Struct{__cols:Array[Struct{s:String}]} ) (MakeStruct (globals (Ref __iruid_989)) (broadcastVals (MakeStruct (__iruid_989 (Ref __iruid_989)))) (contexts (ToArray (StreamMap __iruid_999 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (MakeStruct (context (Ref __iruid_999)))))))) 2023-02-10 11:11:46 root: INFO: optimize optimize: compileLowerer, initial IR: after: IR size 9: (MakeStruct (globals (Literal Struct{__cols:Array[Struct{s:String}]} )) (broadcastVals (Literal Struct{__iruid_989:Struct{__cols:Array[Struct{s:String}]}} )) (contexts (ToArray (StreamMap __iruid_1004 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (MakeStruct (context (Ref __iruid_1004))))))) 2023-02-10 11:11:46 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: before: IR size 9: (MakeStruct (globals (Literal Struct{__cols:Array[Struct{s:String}]} )) (broadcastVals (Literal Struct{__iruid_989:Struct{__cols:Array[Struct{s:String}]}} )) (contexts (ToArray (StreamMap __iruid_1004 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (MakeStruct (context (Ref __iruid_1004))))))) 2023-02-10 11:11:46 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: after: IR size 9: (MakeStruct (globals (Literal Struct{__cols:Array[Struct{s:String}]} )) (broadcastVals (Literal Struct{__iruid_989:Struct{__cols:Array[Struct{s:String}]}} )) (contexts (ToArray (StreamMap __iruid_1007 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (MakeStruct (context (Ref __iruid_1007))))))) 2023-02-10 11:11:46 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: before: IR size 9: (MakeStruct (globals (Literal Struct{__cols:Array[Struct{s:String}]} )) (broadcastVals (Literal Struct{__iruid_989:Struct{__cols:Array[Struct{s:String}]}} )) (contexts (ToArray (StreamMap __iruid_1007 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (MakeStruct (context (Ref __iruid_1007))))))) 2023-02-10 11:11:46 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: after: IR size 9: (MakeStruct (globals (Literal Struct{__cols:Array[Struct{s:String}]} )) (broadcastVals (Literal Struct{__iruid_989:Struct{__cols:Array[Struct{s:String}]}} )) (contexts (ToArray (StreamMap __iruid_1010 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (MakeStruct (context (Ref __iruid_1010))))))) 2023-02-10 11:11:46 root: INFO: encoder cache miss (1 hits, 2 misses, 0.333) 2023-02-10 11:11:46 root: INFO: instruction count: 3: __C897HailClassLoaderContainer. 2023-02-10 11:11:46 root: INFO: instruction count: 3: __C897HailClassLoaderContainer. 2023-02-10 11:11:46 root: INFO: instruction count: 3: __C898FSContainer. 2023-02-10 11:11:46 root: INFO: instruction count: 3: __C898FSContainer. 2023-02-10 11:11:46 root: INFO: instruction count: 3: __C899etypeEncode. 2023-02-10 11:11:46 root: INFO: instruction count: 7: __C899etypeEncode.apply 2023-02-10 11:11:46 root: INFO: instruction count: 41: __C899etypeEncode.__m900ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_struct_of_r_array_of_r_struct_of_r_binaryENDENDENDANDr_struct_of_r_array_of_r_struct_of_r_binaryENDENDANDr_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND 2023-02-10 11:11:46 root: INFO: instruction count: 9: __C899etypeEncode.__m901ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_array_of_r_struct_of_r_binaryENDENDEND 2023-02-10 11:11:46 root: INFO: instruction count: 25: __C899etypeEncode.__m902ENCODE_SBaseStructPointer_TO_r_struct_of_r_array_of_r_struct_of_r_binaryENDEND 2023-02-10 11:11:46 root: INFO: instruction count: 35: __C899etypeEncode.__m903ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_binaryEND 2023-02-10 11:11:46 root: INFO: instruction count: 13: __C899etypeEncode.__m904ENCODE_SBaseStructPointer_TO_r_struct_of_r_binaryEND 2023-02-10 11:11:46 root: INFO: instruction count: 16: __C899etypeEncode.__m905ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:11:46 root: INFO: instruction count: 35: __C899etypeEncode.__m906ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:46 root: INFO: instruction count: 61: __C899etypeEncode.__m907ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:46 root: INFO: instruction count: 4: __C899etypeEncode.__m908ENCODE_SInt32$_TO_r_int32 2023-02-10 11:11:46 root: INFO: instruction count: 4: __C899etypeEncode.__m909ENCODE_SInt64$_TO_r_int64 2023-02-10 11:11:46 root: INFO: instruction count: 4: __C899etypeEncode.__m910ENCODE_SBoolean$_TO_r_bool 2023-02-10 11:11:46 MemoryStore: INFO: Block broadcast_8 stored as values in memory (estimated size 11.5 KiB, free 79.8 GiB) 2023-02-10 11:11:47 MemoryStore: INFO: Block broadcast_8_piece0 stored as bytes in memory (estimated size 2.7 KiB, free 79.8 GiB) 2023-02-10 11:11:47 BlockManagerInfo: INFO: Added broadcast_8_piece0 in memory on 163.152.180.157:46313 (size: 2.7 KiB, free: 79.8 GiB) 2023-02-10 11:11:47 SparkContext: INFO: Created broadcast 8 from broadcast at SparkBackend.scala:280 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C864HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C864HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C865FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C865FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C866Compiled. 2023-02-10 11:11:47 root: INFO: instruction count: 55: __C866Compiled.apply 2023-02-10 11:11:47 root: INFO: instruction count: 144: __C866Compiled.__m869split_ToArray 2023-02-10 11:11:47 root: INFO: instruction count: 9: __C866Compiled.setPartitionIndex 2023-02-10 11:11:47 root: INFO: instruction count: 4: __C866Compiled.addPartitionRegion 2023-02-10 11:11:47 root: INFO: instruction count: 4: __C866Compiled.setPool 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C866Compiled.addHailClassLoader 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C866Compiled.addFS 2023-02-10 11:11:47 root: INFO: instruction count: 69: __C866Compiled.addLiterals 2023-02-10 11:11:47 root: INFO: instruction count: 45: __C866Compiled.__m886DECODE_r_struct_of_r_struct_of_r_struct_of_r_array_of_r_struct_of_r_binaryENDENDENDANDr_struct_of_r_array_of_r_struct_of_r_binaryENDENDANDr_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND_TO_SBaseStructPointer 2023-02-10 11:11:47 root: INFO: instruction count: 17: __C866Compiled.__m887INPLACE_DECODE_r_struct_of_r_struct_of_r_array_of_r_struct_of_r_binaryENDENDEND_TO_r_struct_of_r_struct_of_r_array_of_r_struct_of_r_stringENDENDEND 2023-02-10 11:11:47 root: INFO: instruction count: 17: __C866Compiled.__m888INPLACE_DECODE_r_struct_of_r_array_of_r_struct_of_r_binaryENDEND_TO_r_struct_of_r_array_of_r_struct_of_r_stringENDEND 2023-02-10 11:11:47 root: INFO: instruction count: 58: __C866Compiled.__m889INPLACE_DECODE_r_array_of_r_struct_of_r_binaryEND_TO_r_array_of_r_struct_of_r_stringEND 2023-02-10 11:11:47 root: INFO: instruction count: 17: __C866Compiled.__m890INPLACE_DECODE_r_struct_of_r_binaryEND_TO_r_struct_of_r_stringEND 2023-02-10 11:11:47 root: INFO: instruction count: 31: __C866Compiled.__m891INPLACE_DECODE_r_binary_TO_r_string 2023-02-10 11:11:47 root: INFO: instruction count: 58: __C866Compiled.__m892INPLACE_DECODE_r_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_array_of_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:47 root: INFO: instruction count: 53: __C866Compiled.__m893INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:47 root: INFO: instruction count: 10: __C866Compiled.__m894INPLACE_DECODE_r_int32_TO_r_int32 2023-02-10 11:11:47 root: INFO: instruction count: 10: __C866Compiled.__m895INPLACE_DECODE_r_int64_TO_r_int64 2023-02-10 11:11:47 root: INFO: instruction count: 10: __C866Compiled.__m896INPLACE_DECODE_r_bool_TO_r_bool 2023-02-10 11:11:47 root: INFO: encoder cache miss (1 hits, 3 misses, 0.250) 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C911HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C911HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C912FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C912FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C913etypeEncode. 2023-02-10 11:11:47 root: INFO: instruction count: 7: __C913etypeEncode.apply 2023-02-10 11:11:47 root: INFO: instruction count: 9: __C913etypeEncode.__m914ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_array_of_r_struct_of_r_binaryENDENDEND 2023-02-10 11:11:47 root: INFO: instruction count: 25: __C913etypeEncode.__m915ENCODE_SBaseStructPointer_TO_r_struct_of_r_array_of_r_struct_of_r_binaryENDEND 2023-02-10 11:11:47 root: INFO: instruction count: 35: __C913etypeEncode.__m916ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_binaryEND 2023-02-10 11:11:47 root: INFO: instruction count: 13: __C913etypeEncode.__m917ENCODE_SBaseStructPointer_TO_r_struct_of_r_binaryEND 2023-02-10 11:11:47 root: INFO: instruction count: 16: __C913etypeEncode.__m918ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:11:47 MemoryStore: INFO: Block broadcast_9 stored as values in memory (estimated size 200.0 B, free 79.8 GiB) 2023-02-10 11:11:47 MemoryStore: INFO: Block broadcast_9_piece0 stored as bytes in memory (estimated size 114.0 B, free 79.8 GiB) 2023-02-10 11:11:47 BlockManagerInfo: INFO: Added broadcast_9_piece0 in memory on 163.152.180.157:46313 (size: 114.0 B, free: 79.8 GiB) 2023-02-10 11:11:47 SparkContext: INFO: Created broadcast 9 from broadcast at RVDToTableStage.scala:64 2023-02-10 11:11:47 root: INFO: decoder cache miss (0 hits, 1 misses, 0.000 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C919HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C919HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C920FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C920FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C921etypeDecode. 2023-02-10 11:11:47 root: INFO: instruction count: 7: __C921etypeDecode.apply 2023-02-10 11:11:47 root: INFO: instruction count: 27: __C921etypeDecode.__m922DECODE_r_struct_of_r_struct_of_r_array_of_r_struct_of_r_binaryENDENDEND_TO_SBaseStructPointer 2023-02-10 11:11:47 root: INFO: instruction count: 17: __C921etypeDecode.__m923INPLACE_DECODE_r_struct_of_r_array_of_r_struct_of_r_binaryENDEND_TO_r_struct_of_r_array_of_r_struct_of_r_stringENDEND 2023-02-10 11:11:47 root: INFO: instruction count: 58: __C921etypeDecode.__m924INPLACE_DECODE_r_array_of_r_struct_of_r_binaryEND_TO_r_array_of_r_struct_of_r_stringEND 2023-02-10 11:11:47 root: INFO: instruction count: 17: __C921etypeDecode.__m925INPLACE_DECODE_r_struct_of_r_binaryEND_TO_r_struct_of_r_stringEND 2023-02-10 11:11:47 root: INFO: instruction count: 31: __C921etypeDecode.__m926INPLACE_DECODE_r_binary_TO_r_string 2023-02-10 11:11:47 root: INFO: decoder cache miss (0 hits, 2 misses, 0.000 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C927HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C927HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C928FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C928FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C929etypeDecode. 2023-02-10 11:11:47 root: INFO: instruction count: 7: __C929etypeDecode.apply 2023-02-10 11:11:47 root: INFO: instruction count: 27: __C929etypeDecode.__m930DECODE_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND_TO_SBaseStructPointer 2023-02-10 11:11:47 root: INFO: instruction count: 53: __C929etypeDecode.__m931INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:47 root: INFO: instruction count: 10: __C929etypeDecode.__m932INPLACE_DECODE_r_int32_TO_r_int32 2023-02-10 11:11:47 root: INFO: instruction count: 31: __C929etypeDecode.__m933INPLACE_DECODE_r_binary_TO_r_string 2023-02-10 11:11:47 root: INFO: instruction count: 10: __C929etypeDecode.__m934INPLACE_DECODE_r_int64_TO_r_int64 2023-02-10 11:11:47 root: INFO: instruction count: 10: __C929etypeDecode.__m935INPLACE_DECODE_r_bool_TO_r_bool 2023-02-10 11:11:47 root: INFO: encoder cache miss (1 hits, 4 misses, 0.200) 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C936HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C936HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C937FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C937FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C938etypeEncode. 2023-02-10 11:11:47 root: INFO: instruction count: 7: __C938etypeEncode.apply 2023-02-10 11:11:47 root: INFO: instruction count: 9: __C938etypeEncode.__m939ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND 2023-02-10 11:11:47 root: INFO: instruction count: 61: __C938etypeEncode.__m940ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:11:47 root: INFO: instruction count: 4: __C938etypeEncode.__m941ENCODE_SInt32$_TO_r_int32 2023-02-10 11:11:47 root: INFO: instruction count: 16: __C938etypeEncode.__m942ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:11:47 root: INFO: instruction count: 4: __C938etypeEncode.__m943ENCODE_SInt64$_TO_r_int64 2023-02-10 11:11:47 root: INFO: instruction count: 4: __C938etypeEncode.__m944ENCODE_SBoolean$_TO_r_bool 2023-02-10 11:11:47 root: INFO: optimize optimize: compileLowerer, initial IR: before: IR size 124: (Let __iruid_989 (GetField __iruid_989 (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{__iruid_989:+PCStruct{__cols:+PCArray[+PCStruct{s:+PCString}]}})) 1)) (Let __iruid_1000 (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{context:+PCStruct{index:+PInt32,file:+PCString,start:+PInt64,end:+PInt64,split:+PBoolean}})) 0) (Let __iruid_990 (GetField context (Ref __iruid_1000)) (Let global (Ref __iruid_989) (StreamMap __iruid_998 (StreamFlatMap __iruid_995 (Let global (Ref __iruid_989) (StreamMap __iruid_994 (StreamFlatMap __iruid_991 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_990))) (ToStream False (ArraySort __iruid_992 __iruid_993 (Ref __iruid_991) (ApplyComparisonOp LT (Ref __iruid_992) (Ref __iruid_993))))) (Let row (Ref __iruid_994) (InsertFields (Let __iruid_518 (GetField alleles (Ref row)) (Let __iruid_519 (GetField locus (Ref row)) (InsertFields (SelectFields (locus alleles rsid qual filters info) (Ref row)) None (__uid_3 (ArraySort __iruid_520 __iruid_521 (StreamFlatMap __iruid_522 (StreamFilter __iruid_523 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_518)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_518) (Ref __iruid_523)) (Str "*"))) (ToStream False (Let __iruid_524 (Apply 14 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_519) (MakeArray Array[String] (ArrayRef 12 (Ref __iruid_518) (I32 0)) (ApplyIR 13 indexArray () String (Ref __iruid_518) (Ref __iruid_522)))) (If (ApplyComparisonOp NEQ (GetField locus (Ref __iruid_524)) (Ref __iruid_519)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_524))) (locus (GetField locus (Ref __iruid_524))) (a_index (Ref __iruid_522)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref row))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_520)) (False) (If (IsNA (Ref __iruid_521)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_520) (Ref __iruid_521)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row))))))) (Let __iruid_996 (GetField __uid_3 (Ref __iruid_995)) (StreamMap __iruid_997 (ToStream False (Ref __iruid_996)) (InsertFields (Ref __iruid_995) None (__uid_3 (Ref __iruid_997)))))) (Let row (Ref __iruid_998) (InsertFields (Let __iruid_526 (GetField __uid_3 (Ref row)) (InsertFields (SelectFields (locus alleles rsid qual filters info) (Ref row)) None (locus (GetField locus (Ref __iruid_526))) (alleles (GetField alleles (Ref __iruid_526))) (a_index (GetField a_index (Ref __iruid_526))) (was_split (GetField was_split (Ref __iruid_526))) (old_alleles (GetField alleles (Ref row))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row)))))))))) 2023-02-10 11:11:47 root: INFO: optimize optimize: compileLowerer, initial IR: after: IR size 97: (StreamFlatMap __iruid_1076 (StreamFlatMap __iruid_1077 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetField context (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{context:+PCStruct{index:+PInt32,file:+PCString,start:+PInt64,end:+PInt64,split:+PBoolean}})) 0)))) (StreamMap __iruid_1078 (ToStream False (ArraySort __iruid_1079 __iruid_1080 (Ref __iruid_1077) (ApplyComparisonOp LT (Ref __iruid_1079) (Ref __iruid_1080)))) (InsertFields (Let __iruid_1081 (GetField alleles (Ref __iruid_1078)) (Let __iruid_1082 (GetField locus (Ref __iruid_1078)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_1078)) None (__uid_3 (ArraySort __iruid_1083 __iruid_1084 (StreamFlatMap __iruid_1085 (StreamFilter __iruid_1086 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_1081)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_1081) (Ref __iruid_1086)) (Str "*"))) (ToStream False (Let __iruid_1087 (Apply 14 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_1082) (MakeArray Array[String] (ArrayRef 12 (Ref __iruid_1081) (I32 0)) (ApplyIR 13 indexArray () String (Ref __iruid_1081) (Ref __iruid_1085)))) (If (ApplyComparisonOp NEQ (GetField locus (Ref __iruid_1087)) (Ref __iruid_1082)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_1087))) (locus (GetField locus (Ref __iruid_1087))) (a_index (Ref __iruid_1085)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_1078))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_1083)) (False) (If (IsNA (Ref __iruid_1084)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_1083) (Ref __iruid_1084)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1078)))))) (StreamMap __iruid_1088 (ToStream False (GetField __uid_3 (Ref __iruid_1076))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_1076)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_1088))) (alleles (GetField alleles (Ref __iruid_1088))) (a_index (GetField a_index (Ref __iruid_1088))) (was_split (GetField was_split (Ref __iruid_1088))) (old_alleles (GetField alleles (Ref __iruid_1076)))))) 2023-02-10 11:11:47 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: before: IR size 121: (StreamFlatMap __iruid_1076 (StreamFlatMap __iruid_1077 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetField context (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{context:+PCStruct{index:+PInt32,file:+PCString,start:+PInt64,end:+PInt64,split:+PBoolean}})) 0)))) (StreamMap __iruid_1078 (ToStream False (ArraySort __iruid_1079 __iruid_1080 (Ref __iruid_1077) (ApplyComparisonOp LT (Ref __iruid_1079) (Ref __iruid_1080)))) (InsertFields (Let __iruid_1081 (GetField alleles (Ref __iruid_1078)) (Let __iruid_1082 (GetField locus (Ref __iruid_1078)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_1078)) None (__uid_3 (ArraySort __iruid_1083 __iruid_1084 (StreamFlatMap __iruid_1085 (StreamFilter __iruid_1086 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_1081)) (I32 1)) (ApplyComparisonOp NEQ (Let __iruid_1093 (Ref __iruid_1081) (Let __iruid_1094 (Ref __iruid_1086) (ArrayRef 2 (Ref __iruid_1093) (If (ApplyComparisonOp LT (Ref __iruid_1094) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_1093)) (Ref __iruid_1094)) (Ref __iruid_1094))))) (Str "*"))) (ToStream False (Let __iruid_1087 (Apply 14 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_1082) (MakeArray Array[String] (ArrayRef 12 (Ref __iruid_1081) (I32 0)) (Let __iruid_1091 (Ref __iruid_1081) (Let __iruid_1092 (Ref __iruid_1085) (ArrayRef 13 (Ref __iruid_1091) (If (ApplyComparisonOp LT (Ref __iruid_1092) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_1091)) (Ref __iruid_1092)) (Ref __iruid_1092))))))) (If (ApplyComparisonOp NEQ (GetField locus (Ref __iruid_1087)) (Ref __iruid_1082)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_1087))) (locus (GetField locus (Ref __iruid_1087))) (a_index (Ref __iruid_1085)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_1078))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_1083)) (False) (If (IsNA (Ref __iruid_1084)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_1083) (Ref __iruid_1084)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1078)))))) (StreamMap __iruid_1088 (ToStream False (GetField __uid_3 (Ref __iruid_1076))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_1076)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_1088))) (alleles (GetField alleles (Ref __iruid_1088))) (a_index (GetField a_index (Ref __iruid_1088))) (was_split (GetField was_split (Ref __iruid_1088))) (old_alleles (GetField alleles (Ref __iruid_1076)))))) 2023-02-10 11:11:47 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: after: IR size 113: (StreamFlatMap __iruid_1125 (StreamFlatMap __iruid_1126 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetField context (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{context:+PCStruct{index:+PInt32,file:+PCString,start:+PInt64,end:+PInt64,split:+PBoolean}})) 0)))) (StreamMap __iruid_1127 (ToStream False (ArraySort __iruid_1128 __iruid_1129 (Ref __iruid_1126) (ApplyComparisonOp LT (Ref __iruid_1128) (Ref __iruid_1129)))) (InsertFields (Let __iruid_1130 (GetField alleles (Ref __iruid_1127)) (Let __iruid_1131 (GetField locus (Ref __iruid_1127)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_1127)) None (__uid_3 (ArraySort __iruid_1132 __iruid_1133 (StreamFlatMap __iruid_1134 (StreamFilter __iruid_1135 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_1130)) (I32 1)) (ApplyComparisonOp NEQ (ArrayRef 2 (Ref __iruid_1130) (If (ApplyComparisonOp LT (Ref __iruid_1135) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_1130)) (Ref __iruid_1135)) (Ref __iruid_1135))) (Str "*"))) (ToStream False (Let __iruid_1136 (Apply 14 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_1131) (MakeArray Array[String] (ArrayRef 12 (Ref __iruid_1130) (I32 0)) (ArrayRef 13 (Ref __iruid_1130) (If (ApplyComparisonOp LT (Ref __iruid_1134) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_1130)) (Ref __iruid_1134)) (Ref __iruid_1134))))) (If (ApplyComparisonOp NEQ (GetField locus (Ref __iruid_1136)) (Ref __iruid_1131)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_1136))) (locus (GetField locus (Ref __iruid_1136))) (a_index (Ref __iruid_1134)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_1127))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_1132)) (False) (If (IsNA (Ref __iruid_1133)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_1132) (Ref __iruid_1133)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1127)))))) (StreamMap __iruid_1137 (ToStream False (GetField __uid_3 (Ref __iruid_1125))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_1125)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_1137))) (alleles (GetField alleles (Ref __iruid_1137))) (a_index (GetField a_index (Ref __iruid_1137))) (was_split (GetField was_split (Ref __iruid_1137))) (old_alleles (GetField alleles (Ref __iruid_1125)))))) 2023-02-10 11:11:47 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: before: IR size 113: (StreamFlatMap __iruid_1125 (StreamFlatMap __iruid_1126 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetField context (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{context:+PCStruct{index:+PInt32,file:+PCString,start:+PInt64,end:+PInt64,split:+PBoolean}})) 0)))) (StreamMap __iruid_1127 (ToStream False (ArraySort __iruid_1128 __iruid_1129 (Ref __iruid_1126) (ApplyComparisonOp LT (Ref __iruid_1128) (Ref __iruid_1129)))) (InsertFields (Let __iruid_1130 (GetField alleles (Ref __iruid_1127)) (Let __iruid_1131 (GetField locus (Ref __iruid_1127)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_1127)) None (__uid_3 (ArraySort __iruid_1132 __iruid_1133 (StreamFlatMap __iruid_1134 (StreamFilter __iruid_1135 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_1130)) (I32 1)) (ApplyComparisonOp NEQ (ArrayRef 2 (Ref __iruid_1130) (If (ApplyComparisonOp LT (Ref __iruid_1135) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_1130)) (Ref __iruid_1135)) (Ref __iruid_1135))) (Str "*"))) (ToStream False (Let __iruid_1136 (Apply 14 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_1131) (MakeArray Array[String] (ArrayRef 12 (Ref __iruid_1130) (I32 0)) (ArrayRef 13 (Ref __iruid_1130) (If (ApplyComparisonOp LT (Ref __iruid_1134) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_1130)) (Ref __iruid_1134)) (Ref __iruid_1134))))) (If (ApplyComparisonOp NEQ (GetField locus (Ref __iruid_1136)) (Ref __iruid_1131)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_1136))) (locus (GetField locus (Ref __iruid_1136))) (a_index (Ref __iruid_1134)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_1127))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_1132)) (False) (If (IsNA (Ref __iruid_1133)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_1132) (Ref __iruid_1133)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1127)))))) (StreamMap __iruid_1137 (ToStream False (GetField __uid_3 (Ref __iruid_1125))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_1125)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_1137))) (alleles (GetField alleles (Ref __iruid_1137))) (a_index (GetField a_index (Ref __iruid_1137))) (was_split (GetField was_split (Ref __iruid_1137))) (old_alleles (GetField alleles (Ref __iruid_1125)))))) 2023-02-10 11:11:47 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: after: IR size 113: (StreamFlatMap __iruid_1164 (StreamFlatMap __iruid_1165 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetField context (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{context:+PCStruct{index:+PInt32,file:+PCString,start:+PInt64,end:+PInt64,split:+PBoolean}})) 0)))) (StreamMap __iruid_1166 (ToStream False (ArraySort __iruid_1167 __iruid_1168 (Ref __iruid_1165) (ApplyComparisonOp LT (Ref __iruid_1167) (Ref __iruid_1168)))) (InsertFields (Let __iruid_1169 (GetField alleles (Ref __iruid_1166)) (Let __iruid_1170 (GetField locus (Ref __iruid_1166)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_1166)) None (__uid_3 (ArraySort __iruid_1171 __iruid_1172 (StreamFlatMap __iruid_1173 (StreamFilter __iruid_1174 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_1169)) (I32 1)) (ApplyComparisonOp NEQ (ArrayRef 2 (Ref __iruid_1169) (If (ApplyComparisonOp LT (Ref __iruid_1174) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_1169)) (Ref __iruid_1174)) (Ref __iruid_1174))) (Str "*"))) (ToStream False (Let __iruid_1175 (Apply 14 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_1170) (MakeArray Array[String] (ArrayRef 12 (Ref __iruid_1169) (I32 0)) (ArrayRef 13 (Ref __iruid_1169) (If (ApplyComparisonOp LT (Ref __iruid_1173) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_1169)) (Ref __iruid_1173)) (Ref __iruid_1173))))) (If (ApplyComparisonOp NEQ (GetField locus (Ref __iruid_1175)) (Ref __iruid_1170)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_1175))) (locus (GetField locus (Ref __iruid_1175))) (a_index (Ref __iruid_1173)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_1166))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_1171)) (False) (If (IsNA (Ref __iruid_1172)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_1171) (Ref __iruid_1172)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1166)))))) (StreamMap __iruid_1176 (ToStream False (GetField __uid_3 (Ref __iruid_1164))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_1164)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_1176))) (alleles (GetField alleles (Ref __iruid_1176))) (a_index (GetField a_index (Ref __iruid_1176))) (was_split (GetField was_split (Ref __iruid_1176))) (old_alleles (GetField alleles (Ref __iruid_1164)))))) 2023-02-10 11:11:47 root: INFO: encoder cache miss (1 hits, 5 misses, 0.167) 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C1156HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C1156HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C1157FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C1157FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C1158etypeEncode. 2023-02-10 11:11:47 root: INFO: instruction count: 7: __C1158etypeEncode.apply 2023-02-10 11:11:47 root: INFO: instruction count: 13: __C1158etypeEncode.__m1159ENCODE_SBaseStructPointer_TO_r_struct_of_r_binaryEND 2023-02-10 11:11:47 root: INFO: instruction count: 16: __C1158etypeEncode.__m1160ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:11:47 MemoryStore: INFO: Block broadcast_10 stored as values in memory (estimated size 104.0 B, free 79.8 GiB) 2023-02-10 11:11:47 MemoryStore: INFO: Block broadcast_10_piece0 stored as bytes in memory (estimated size 62.0 B, free 79.8 GiB) 2023-02-10 11:11:47 BlockManagerInfo: INFO: Added broadcast_10_piece0 in memory on 163.152.180.157:46313 (size: 62.0 B, free: 79.8 GiB) 2023-02-10 11:11:47 SparkContext: INFO: Created broadcast 10 from broadcast at SparkBackend.scala:280 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C945HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C945HailClassLoaderContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C946FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C946FSContainer. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C947stream. 2023-02-10 11:11:47 root: INFO: instruction count: 156: __C947stream.apply 2023-02-10 11:11:47 root: INFO: instruction count: 7: __C947stream.setRegions 2023-02-10 11:11:47 root: INFO: instruction count: 12: __C947stream.__m956setup_null 2023-02-10 11:11:47 root: INFO: instruction count: 63: __C947stream.__m972ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 15: __C947stream.__m973ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 25: __C947stream.__m974ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 74: __C947stream.__m975ord_compareNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 9: __C947stream.__m977ord_compareNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 89: __C947stream.__m978ord_compareNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 12: __C947stream.__m983setup_jab 2023-02-10 11:11:47 root: INFO: instruction count: 31: __C947stream.__m986dependent_sorting_func 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m989ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 620: __C947stream.__m990ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 15: __C947stream.__m991ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 25: __C947stream.__m992ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 15: __C947stream.__m993ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 15: __C947stream.__m994ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 102: __C947stream.__m995ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m996ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 21: __C947stream.__m997ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m998ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 21: __C947stream.__m999ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 15: __C947stream.__m1000ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 81: __C947stream.__m1001ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 24: __C947stream.__m1002ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 30: __C947stream.__m1003ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 24: __C947stream.__m1004ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 16: __C947stream.__m1005ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 30: __C947stream.__m1006ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 16: __C947stream.__m1007ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 28: __C947stream.__m1008ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 102: __C947stream.__m1009ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 34: __C947stream.__m1010ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 81: __C947stream.__m1011ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1012ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 253: __C947stream.__m1013ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 28: __C947stream.__m1014ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 232: __C947stream.__m1015ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 24: __C947stream.__m1016ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 14: __C947stream.__m1017ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 30: __C947stream.__m1018ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 14: __C947stream.__m1019ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 34: __C947stream.__m1020ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 187: __C947stream.__m1021ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 28: __C947stream.__m1022ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 232: __C947stream.__m1023ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 34: __C947stream.__m1024ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 187: __C947stream.__m1025ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1026ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 195: __C947stream.__m1027ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 15: __C947stream.__m1028ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 94: __C947stream.__m1029ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1030ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 231: __C947stream.__m1031ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 28: __C947stream.__m1032ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 102: __C947stream.__m1033ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1034ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1035ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 34: __C947stream.__m1036ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 81: __C947stream.__m1037ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 28: __C947stream.__m1038ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 102: __C947stream.__m1039ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1040ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1041ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 34: __C947stream.__m1042ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 81: __C947stream.__m1043ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 24: __C947stream.__m1044ord_lt 2023-02-10 11:11:47 root: INFO: instruction count: 21: __C947stream.__m1045ord_ltNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 8: __C947stream.__m1046ord_compareNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 30: __C947stream.__m1047ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 21: __C947stream.__m1048ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1049ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 173: __C947stream.__m1050ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 15: __C947stream.__m1051ord_equiv 2023-02-10 11:11:47 root: INFO: instruction count: 73: __C947stream.__m1052ord_equivNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 202: __C947stream.__m1053arraySorter_outer 2023-02-10 11:11:47 root: INFO: instruction count: 66: __C947stream.__m1054arraySorter_merge 2023-02-10 11:11:47 root: INFO: instruction count: 36: __C947stream.__m1055arraySorter_splitMerge 2023-02-10 11:11:47 root: INFO: instruction count: 389: __C947stream.__m1069split_ArraySort 2023-02-10 11:11:47 root: INFO: instruction count: 35: __C947stream.__m1077arrayref_bounds_check 2023-02-10 11:11:47 root: INFO: instruction count: 451: __C947stream.__m1082split_Let 2023-02-10 11:11:47 root: INFO: instruction count: 284: __C947stream.__m1084min_rep 2023-02-10 11:11:47 root: INFO: instruction count: 12: __C947stream.__m1087setup_null 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1093ord_gt 2023-02-10 11:11:47 root: INFO: instruction count: 14: __C947stream.__m1094ord_gtNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 12: __C947stream.__m1107setup_jab 2023-02-10 11:11:47 root: INFO: instruction count: 70: __C947stream.__m1110dependent_sorting_func 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1113ord_compare 2023-02-10 11:11:47 root: INFO: instruction count: 241: __C947stream.__m1114ord_compareNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 15: __C947stream.__m1115ord_compare 2023-02-10 11:11:47 root: INFO: instruction count: 82: __C947stream.__m1116ord_compareNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1117ord_compare 2023-02-10 11:11:47 root: INFO: instruction count: 15: __C947stream.__m1118ord_compare 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1119ord_compare 2023-02-10 11:11:47 root: INFO: instruction count: 8: __C947stream.__m1120ord_compareNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 11: __C947stream.__m1121ord_compare 2023-02-10 11:11:47 root: INFO: instruction count: 8: __C947stream.__m1122ord_compareNonnull 2023-02-10 11:11:47 root: INFO: instruction count: 202: __C947stream.__m1123arraySorter_outer 2023-02-10 11:11:47 root: INFO: instruction count: 66: __C947stream.__m1124arraySorter_merge 2023-02-10 11:11:47 root: INFO: instruction count: 36: __C947stream.__m1125arraySorter_splitMerge 2023-02-10 11:11:47 root: INFO: instruction count: 4: __C947stream.setObjects 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C947stream.loadAddress 2023-02-10 11:11:47 root: INFO: instruction count: 9: __C947stream.setPartitionIndex 2023-02-10 11:11:47 root: INFO: instruction count: 4: __C947stream.addPartitionRegion 2023-02-10 11:11:47 root: INFO: instruction count: 4: __C947stream.setPool 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C947stream.addHailClassLoader 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C947stream.addFS 2023-02-10 11:11:47 root: INFO: instruction count: 43: __C947stream.addReferenceGenomes 2023-02-10 11:11:47 root: INFO: instruction count: 39: __C947stream.addLiterals 2023-02-10 11:11:47 root: INFO: instruction count: 27: __C947stream.__m1154DECODE_r_struct_of_r_binaryEND_TO_SBaseStructPointer 2023-02-10 11:11:47 root: INFO: instruction count: 31: __C947stream.__m1155INPLACE_DECODE_r_binary_TO_r_string 2023-02-10 11:11:47 root: INFO: instruction count: 109: __C947stream.apply_region67_73 2023-02-10 11:11:47 root: INFO: instruction count: 79: __C947stream.apply_region109_115 2023-02-10 11:11:47 root: INFO: instruction count: 478: __C947stream.apply_region66_123 2023-02-10 11:11:47 root: INFO: instruction count: 240: __C947stream.apply_region155_162 2023-02-10 11:11:47 root: INFO: instruction count: 160: __C947stream.apply_region46_55 2023-02-10 11:11:47 root: INFO: instruction count: 153: __C947stream.apply_region63_65 2023-02-10 11:11:47 root: INFO: instruction count: 112: __C947stream.apply_region56_62 2023-02-10 11:11:47 root: INFO: instruction count: 93: __C947stream.apply_region32_38 2023-02-10 11:11:47 root: INFO: instruction count: 1157: __C947stream.apply_region5_168 2023-02-10 11:11:47 root: INFO: instruction count: 119: __C947stream.__m990ord_ltNonnull_region0_0 2023-02-10 11:11:47 root: INFO: instruction count: 112: __C947stream.__m990ord_ltNonnull_region2_2 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m990ord_ltNonnull_region54_61 2023-02-10 11:11:47 root: INFO: instruction count: 118: __C947stream.__m1013ord_ltNonnull_region26_33 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1013ord_ltNonnull_region226_233 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1013ord_ltNonnull_region201_208 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1013ord_ltNonnull_region176_183 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1013ord_ltNonnull_region151_158 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1013ord_ltNonnull_region126_133 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1013ord_ltNonnull_region101_108 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1013ord_ltNonnull_region76_83 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1013ord_ltNonnull_region51_58 2023-02-10 11:11:47 root: INFO: instruction count: 70: __C947stream.__m1013ord_ltNonnull_region34_41 2023-02-10 11:11:47 root: INFO: instruction count: 75: __C947stream.__m1013ord_ltNonnull_region42_49 2023-02-10 11:11:47 root: INFO: instruction count: 46: __C947stream.__m1013ord_ltNonnull_region234_241 2023-02-10 11:11:47 root: INFO: instruction count: 46: __C947stream.__m1013ord_ltNonnull_region209_216 2023-02-10 11:11:47 root: INFO: instruction count: 46: __C947stream.__m1013ord_ltNonnull_region184_191 2023-02-10 11:11:47 root: INFO: instruction count: 46: __C947stream.__m1013ord_ltNonnull_region159_166 2023-02-10 11:11:47 root: INFO: instruction count: 46: __C947stream.__m1013ord_ltNonnull_region134_141 2023-02-10 11:11:47 root: INFO: instruction count: 46: __C947stream.__m1013ord_ltNonnull_region109_116 2023-02-10 11:11:47 root: INFO: instruction count: 46: __C947stream.__m1013ord_ltNonnull_region84_91 2023-02-10 11:11:47 root: INFO: instruction count: 520: __C947stream.__m1013ord_ltNonnull_region24_250 2023-02-10 11:11:47 root: INFO: instruction count: 118: __C947stream.__m1027ord_equivNonnull_region17_24 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1027ord_equivNonnull_region145_152 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1027ord_equivNonnull_region129_136 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1027ord_equivNonnull_region113_120 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1027ord_equivNonnull_region97_104 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1027ord_equivNonnull_region81_88 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1027ord_equivNonnull_region65_72 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1027ord_equivNonnull_region49_56 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1027ord_equivNonnull_region33_40 2023-02-10 11:11:47 root: INFO: instruction count: 505: __C947stream.__m1027ord_equivNonnull_region16_161 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m1031ord_ltNonnull_region301_308 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m1031ord_ltNonnull_region251_258 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m1031ord_ltNonnull_region151_158 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m1031ord_ltNonnull_region101_108 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m1031ord_ltNonnull_region76_83 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m1031ord_ltNonnull_region26_33 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1031ord_ltNonnull_region276_283 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1031ord_ltNonnull_region226_233 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1031ord_ltNonnull_region201_208 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1031ord_ltNonnull_region176_183 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1031ord_ltNonnull_region126_133 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1031ord_ltNonnull_region51_58 2023-02-10 11:11:47 root: INFO: instruction count: 70: __C947stream.__m1031ord_ltNonnull_region309_316 2023-02-10 11:11:47 root: INFO: instruction count: 70: __C947stream.__m1031ord_ltNonnull_region259_266 2023-02-10 11:11:47 root: INFO: instruction count: 70: __C947stream.__m1031ord_ltNonnull_region159_166 2023-02-10 11:11:47 root: INFO: instruction count: 70: __C947stream.__m1031ord_ltNonnull_region109_116 2023-02-10 11:11:47 root: INFO: instruction count: 70: __C947stream.__m1031ord_ltNonnull_region84_91 2023-02-10 11:11:47 root: INFO: instruction count: 70: __C947stream.__m1031ord_ltNonnull_region34_41 2023-02-10 11:11:47 root: INFO: instruction count: 75: __C947stream.__m1031ord_ltNonnull_region267_274 2023-02-10 11:11:47 root: INFO: instruction count: 75: __C947stream.__m1031ord_ltNonnull_region167_174 2023-02-10 11:11:47 root: INFO: instruction count: 75: __C947stream.__m1031ord_ltNonnull_region117_124 2023-02-10 11:11:47 root: INFO: instruction count: 75: __C947stream.__m1031ord_ltNonnull_region92_99 2023-02-10 11:11:47 root: INFO: instruction count: 75: __C947stream.__m1031ord_ltNonnull_region42_49 2023-02-10 11:11:47 root: INFO: instruction count: 67: __C947stream.__m1031ord_ltNonnull_region317_324 2023-02-10 11:11:47 root: INFO: instruction count: 46: __C947stream.__m1031ord_ltNonnull_region284_291 2023-02-10 11:11:47 root: INFO: instruction count: 46: __C947stream.__m1031ord_ltNonnull_region234_241 2023-02-10 11:11:47 root: INFO: instruction count: 46: __C947stream.__m1031ord_ltNonnull_region209_216 2023-02-10 11:11:47 root: INFO: instruction count: 46: __C947stream.__m1031ord_ltNonnull_region184_191 2023-02-10 11:11:47 root: INFO: instruction count: 534: __C947stream.__m1031ord_ltNonnull_region24_325 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m1050ord_equivNonnull_region193_200 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m1050ord_equivNonnull_region161_168 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m1050ord_equivNonnull_region97_104 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m1050ord_equivNonnull_region65_72 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m1050ord_equivNonnull_region49_56 2023-02-10 11:11:47 root: INFO: instruction count: 96: __C947stream.__m1050ord_equivNonnull_region17_24 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1050ord_equivNonnull_region177_184 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1050ord_equivNonnull_region145_152 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1050ord_equivNonnull_region129_136 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1050ord_equivNonnull_region113_120 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1050ord_equivNonnull_region81_88 2023-02-10 11:11:47 root: INFO: instruction count: 64: __C947stream.__m1050ord_equivNonnull_region33_40 2023-02-10 11:11:47 root: INFO: instruction count: 77: __C947stream.__m1050ord_equivNonnull_region169_176 2023-02-10 11:11:47 root: INFO: instruction count: 77: __C947stream.__m1050ord_equivNonnull_region105_112 2023-02-10 11:11:47 root: INFO: instruction count: 77: __C947stream.__m1050ord_equivNonnull_region73_80 2023-02-10 11:11:47 root: INFO: instruction count: 77: __C947stream.__m1050ord_equivNonnull_region57_64 2023-02-10 11:11:47 root: INFO: instruction count: 512: __C947stream.__m1050ord_equivNonnull_region16_209 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C1161applySpills. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C1192__m990ord_ltNonnullSpills. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C1230__m1013ord_ltNonnullSpills. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C1320__m1027ord_equivNonnullSpills. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C1386__m1031ord_ltNonnullSpills. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C1564__m1050ord_equivNonnullSpills. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C976RGContainer_GRCh38. 2023-02-10 11:11:47 root: INFO: instruction count: 3: __C976RGContainer_GRCh38. 2023-02-10 11:11:47 SparkContext: INFO: Starting job: runJob at ContextRDD.scala:238 2023-02-10 11:11:47 DAGScheduler: INFO: Got job 2 (runJob at ContextRDD.scala:238) with 144 output partitions 2023-02-10 11:11:47 DAGScheduler: INFO: Final stage: ResultStage 2 (runJob at ContextRDD.scala:238) 2023-02-10 11:11:47 DAGScheduler: INFO: Parents of final stage: List() 2023-02-10 11:11:47 DAGScheduler: INFO: Missing parents: List() 2023-02-10 11:11:47 DAGScheduler: INFO: Submitting ResultStage 2 (MapPartitionsRDD[5] at mapPartitions at ContextRDD.scala:222), which has no missing parents 2023-02-10 11:11:47 MemoryStore: INFO: Block broadcast_11 stored as values in memory (estimated size 502.9 KiB, free 79.8 GiB) 2023-02-10 11:11:47 MemoryStore: INFO: Block broadcast_11_piece0 stored as bytes in memory (estimated size 236.5 KiB, free 79.8 GiB) 2023-02-10 11:11:47 BlockManagerInfo: INFO: Added broadcast_11_piece0 in memory on 163.152.180.157:46313 (size: 236.5 KiB, free: 79.8 GiB) 2023-02-10 11:11:47 SparkContext: INFO: Created broadcast 11 from broadcast at DAGScheduler.scala:1433 2023-02-10 11:11:47 DAGScheduler: INFO: Submitting 144 missing tasks from ResultStage 2 (MapPartitionsRDD[5] at mapPartitions at ContextRDD.scala:222) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)) 2023-02-10 11:11:47 TaskSchedulerImpl: INFO: Adding task set 2.0 with 144 tasks resource profile 0 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 0.0 in stage 2.0 (TID 288) (163.152.180.157, executor driver, partition 0, PROCESS_LOCAL, 4363 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 1.0 in stage 2.0 (TID 289) (163.152.180.157, executor driver, partition 1, PROCESS_LOCAL, 4366 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 2.0 in stage 2.0 (TID 290) (163.152.180.157, executor driver, partition 2, PROCESS_LOCAL, 4366 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 3.0 in stage 2.0 (TID 291) (163.152.180.157, executor driver, partition 3, PROCESS_LOCAL, 4366 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 4.0 in stage 2.0 (TID 292) (163.152.180.157, executor driver, partition 4, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 5.0 in stage 2.0 (TID 293) (163.152.180.157, executor driver, partition 5, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 6.0 in stage 2.0 (TID 294) (163.152.180.157, executor driver, partition 6, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 7.0 in stage 2.0 (TID 295) (163.152.180.157, executor driver, partition 7, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 8.0 in stage 2.0 (TID 296) (163.152.180.157, executor driver, partition 8, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 9.0 in stage 2.0 (TID 297) (163.152.180.157, executor driver, partition 9, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 10.0 in stage 2.0 (TID 298) (163.152.180.157, executor driver, partition 10, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 11.0 in stage 2.0 (TID 299) (163.152.180.157, executor driver, partition 11, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 12.0 in stage 2.0 (TID 300) (163.152.180.157, executor driver, partition 12, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 13.0 in stage 2.0 (TID 301) (163.152.180.157, executor driver, partition 13, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 14.0 in stage 2.0 (TID 302) (163.152.180.157, executor driver, partition 14, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 15.0 in stage 2.0 (TID 303) (163.152.180.157, executor driver, partition 15, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 16.0 in stage 2.0 (TID 304) (163.152.180.157, executor driver, partition 16, PROCESS_LOCAL, 4367 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 17.0 in stage 2.0 (TID 305) (163.152.180.157, executor driver, partition 17, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 18.0 in stage 2.0 (TID 306) (163.152.180.157, executor driver, partition 18, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 19.0 in stage 2.0 (TID 307) (163.152.180.157, executor driver, partition 19, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 20.0 in stage 2.0 (TID 308) (163.152.180.157, executor driver, partition 20, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 21.0 in stage 2.0 (TID 309) (163.152.180.157, executor driver, partition 21, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 22.0 in stage 2.0 (TID 310) (163.152.180.157, executor driver, partition 22, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 23.0 in stage 2.0 (TID 311) (163.152.180.157, executor driver, partition 23, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 24.0 in stage 2.0 (TID 312) (163.152.180.157, executor driver, partition 24, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 25.0 in stage 2.0 (TID 313) (163.152.180.157, executor driver, partition 25, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 26.0 in stage 2.0 (TID 314) (163.152.180.157, executor driver, partition 26, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 27.0 in stage 2.0 (TID 315) (163.152.180.157, executor driver, partition 27, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 28.0 in stage 2.0 (TID 316) (163.152.180.157, executor driver, partition 28, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 29.0 in stage 2.0 (TID 317) (163.152.180.157, executor driver, partition 29, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 30.0 in stage 2.0 (TID 318) (163.152.180.157, executor driver, partition 30, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 31.0 in stage 2.0 (TID 319) (163.152.180.157, executor driver, partition 31, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 32.0 in stage 2.0 (TID 320) (163.152.180.157, executor driver, partition 32, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 33.0 in stage 2.0 (TID 321) (163.152.180.157, executor driver, partition 33, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 34.0 in stage 2.0 (TID 322) (163.152.180.157, executor driver, partition 34, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 35.0 in stage 2.0 (TID 323) (163.152.180.157, executor driver, partition 35, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 36.0 in stage 2.0 (TID 324) (163.152.180.157, executor driver, partition 36, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 37.0 in stage 2.0 (TID 325) (163.152.180.157, executor driver, partition 37, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 38.0 in stage 2.0 (TID 326) (163.152.180.157, executor driver, partition 38, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 TaskSetManager: INFO: Starting task 39.0 in stage 2.0 (TID 327) (163.152.180.157, executor driver, partition 39, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:47 Executor: INFO: Running task 1.0 in stage 2.0 (TID 289) 2023-02-10 11:11:47 Executor: INFO: Running task 3.0 in stage 2.0 (TID 291) 2023-02-10 11:11:47 Executor: INFO: Running task 0.0 in stage 2.0 (TID 288) 2023-02-10 11:11:47 Executor: INFO: Running task 7.0 in stage 2.0 (TID 295) 2023-02-10 11:11:47 Executor: INFO: Running task 2.0 in stage 2.0 (TID 290) 2023-02-10 11:11:47 Executor: INFO: Running task 11.0 in stage 2.0 (TID 299) 2023-02-10 11:11:47 Executor: INFO: Running task 5.0 in stage 2.0 (TID 293) 2023-02-10 11:11:47 Executor: INFO: Running task 4.0 in stage 2.0 (TID 292) 2023-02-10 11:11:47 Executor: INFO: Running task 19.0 in stage 2.0 (TID 307) 2023-02-10 11:11:47 Executor: INFO: Running task 18.0 in stage 2.0 (TID 306) 2023-02-10 11:11:47 Executor: INFO: Running task 15.0 in stage 2.0 (TID 303) 2023-02-10 11:11:47 Executor: INFO: Running task 13.0 in stage 2.0 (TID 301) 2023-02-10 11:11:47 Executor: INFO: Running task 17.0 in stage 2.0 (TID 305) 2023-02-10 11:11:47 Executor: INFO: Running task 33.0 in stage 2.0 (TID 321) 2023-02-10 11:11:47 Executor: INFO: Running task 16.0 in stage 2.0 (TID 304) 2023-02-10 11:11:47 Executor: INFO: Running task 35.0 in stage 2.0 (TID 323) 2023-02-10 11:11:47 Executor: INFO: Running task 39.0 in stage 2.0 (TID 327) 2023-02-10 11:11:47 Executor: INFO: Running task 14.0 in stage 2.0 (TID 302) 2023-02-10 11:11:47 Executor: INFO: Running task 10.0 in stage 2.0 (TID 298) 2023-02-10 11:11:47 Executor: INFO: Running task 12.0 in stage 2.0 (TID 300) 2023-02-10 11:11:47 Executor: INFO: Running task 8.0 in stage 2.0 (TID 296) 2023-02-10 11:11:47 Executor: INFO: Running task 9.0 in stage 2.0 (TID 297) 2023-02-10 11:11:47 Executor: INFO: Running task 6.0 in stage 2.0 (TID 294) 2023-02-10 11:11:47 Executor: INFO: Running task 38.0 in stage 2.0 (TID 326) 2023-02-10 11:11:47 Executor: INFO: Running task 37.0 in stage 2.0 (TID 325) 2023-02-10 11:11:47 Executor: INFO: Running task 36.0 in stage 2.0 (TID 324) 2023-02-10 11:11:47 Executor: INFO: Running task 34.0 in stage 2.0 (TID 322) 2023-02-10 11:11:47 Executor: INFO: Running task 32.0 in stage 2.0 (TID 320) 2023-02-10 11:11:47 Executor: INFO: Running task 30.0 in stage 2.0 (TID 318) 2023-02-10 11:11:47 Executor: INFO: Running task 31.0 in stage 2.0 (TID 319) 2023-02-10 11:11:47 Executor: INFO: Running task 29.0 in stage 2.0 (TID 317) 2023-02-10 11:11:47 Executor: INFO: Running task 27.0 in stage 2.0 (TID 315) 2023-02-10 11:11:47 Executor: INFO: Running task 28.0 in stage 2.0 (TID 316) 2023-02-10 11:11:47 Executor: INFO: Running task 23.0 in stage 2.0 (TID 311) 2023-02-10 11:11:47 Executor: INFO: Running task 21.0 in stage 2.0 (TID 309) 2023-02-10 11:11:47 Executor: INFO: Running task 26.0 in stage 2.0 (TID 314) 2023-02-10 11:11:47 Executor: INFO: Running task 25.0 in stage 2.0 (TID 313) 2023-02-10 11:11:47 Executor: INFO: Running task 24.0 in stage 2.0 (TID 312) 2023-02-10 11:11:47 Executor: INFO: Running task 22.0 in stage 2.0 (TID 310) 2023-02-10 11:11:47 Executor: INFO: Running task 20.0 in stage 2.0 (TID 308) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 138: Executor task launch worker for task 25.0 in stage 2.0 (TID 313) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 29.0 in stage 2.0 (TID 317) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 21.0 in stage 2.0 (TID 309) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 34.0 in stage 2.0 (TID 322) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 2.0 in stage 2.0 (TID 290) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 17.0 in stage 2.0 (TID 305) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 125: Executor task launch worker for task 36.0 in stage 2.0 (TID 324) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 121: Executor task launch worker for task 27.0 in stage 2.0 (TID 315) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 12.0 in stage 2.0 (TID 300) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 22.0 in stage 2.0 (TID 310) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 7.0 in stage 2.0 (TID 295) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 1.0 in stage 2.0 (TID 289) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 38.0 in stage 2.0 (TID 326) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 11.0 in stage 2.0 (TID 299) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 4.0 in stage 2.0 (TID 292) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 0.0 in stage 2.0 (TID 288) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 13.0 in stage 2.0 (TID 301) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 30.0 in stage 2.0 (TID 318) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 28.0 in stage 2.0 (TID 316) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 24.0 in stage 2.0 (TID 312) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 26.0 in stage 2.0 (TID 314) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 20.0 in stage 2.0 (TID 308) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 23.0 in stage 2.0 (TID 311) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 18.0 in stage 2.0 (TID 306) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 6.0 in stage 2.0 (TID 294) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 31.0 in stage 2.0 (TID 319) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 19.0 in stage 2.0 (TID 307) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 149: Executor task launch worker for task 32.0 in stage 2.0 (TID 320) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 3.0 in stage 2.0 (TID 291) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 33.0 in stage 2.0 (TID 321) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 8.0 in stage 2.0 (TID 296) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 16.0 in stage 2.0 (TID 304) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 129: Executor task launch worker for task 14.0 in stage 2.0 (TID 302) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 35.0 in stage 2.0 (TID 323) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 9.0 in stage 2.0 (TID 297) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 158: Executor task launch worker for task 37.0 in stage 2.0 (TID 325) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 10.0 in stage 2.0 (TID 298) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 39.0 in stage 2.0 (TID 327) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 5.0 in stage 2.0 (TID 293) 2023-02-10 11:11:48 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 15.0 in stage 2.0 (TID 303) 2023-02-10 11:11:48 BlockManagerInfo: INFO: Removed broadcast_4_piece0 on 163.152.180.157:46313 in memory (size: 198.8 KiB, free: 79.8 GiB) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 141: Executor task launch worker for task 26.0 in stage 2.0 (TID 314) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 140: Executor task launch worker for task 34.0 in stage 2.0 (TID 322) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 151: Executor task launch worker for task 20.0 in stage 2.0 (TID 308) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 128: Executor task launch worker for task 4.0 in stage 2.0 (TID 292) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 129: Executor task launch worker for task 14.0 in stage 2.0 (TID 302) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 121: Executor task launch worker for task 27.0 in stage 2.0 (TID 315) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 143: Executor task launch worker for task 11.0 in stage 2.0 (TID 299) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 125: Executor task launch worker for task 36.0 in stage 2.0 (TID 324) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 122: Executor task launch worker for task 23.0 in stage 2.0 (TID 311) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 114: Executor task launch worker for task 33.0 in stage 2.0 (TID 321) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 131: Executor task launch worker for task 9.0 in stage 2.0 (TID 297) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 149: Executor task launch worker for task 32.0 in stage 2.0 (TID 320) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 115: Executor task launch worker for task 8.0 in stage 2.0 (TID 296) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 119: Executor task launch worker for task 29.0 in stage 2.0 (TID 317) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 117: Executor task launch worker for task 6.0 in stage 2.0 (TID 294) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 142: Executor task launch worker for task 16.0 in stage 2.0 (TID 304) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 139: Executor task launch worker for task 31.0 in stage 2.0 (TID 319) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 120: Executor task launch worker for task 18.0 in stage 2.0 (TID 306) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 126: Executor task launch worker for task 2.0 in stage 2.0 (TID 290) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 138: Executor task launch worker for task 25.0 in stage 2.0 (TID 313) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 136: Executor task launch worker for task 22.0 in stage 2.0 (TID 310) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 150: Executor task launch worker for task 39.0 in stage 2.0 (TID 327) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 145: Executor task launch worker for task 19.0 in stage 2.0 (TID 307) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 116: Executor task launch worker for task 30.0 in stage 2.0 (TID 318) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 152: Executor task launch worker for task 1.0 in stage 2.0 (TID 289) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 132: Executor task launch worker for task 24.0 in stage 2.0 (TID 312) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 159: Executor task launch worker for task 17.0 in stage 2.0 (TID 305) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 127: Executor task launch worker for task 10.0 in stage 2.0 (TID 298) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 147: Executor task launch worker for task 38.0 in stage 2.0 (TID 326) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 118: Executor task launch worker for task 15.0 in stage 2.0 (TID 303) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 146: Executor task launch worker for task 12.0 in stage 2.0 (TID 300) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 148: Executor task launch worker for task 7.0 in stage 2.0 (TID 295) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 134: Executor task launch worker for task 28.0 in stage 2.0 (TID 316) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 124: Executor task launch worker for task 3.0 in stage 2.0 (TID 291) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 137: Executor task launch worker for task 21.0 in stage 2.0 (TID 309) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 130: Executor task launch worker for task 5.0 in stage 2.0 (TID 293) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 153: Executor task launch worker for task 35.0 in stage 2.0 (TID 323) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 144: Executor task launch worker for task 0.0 in stage 2.0 (TID 288) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 158: Executor task launch worker for task 37.0 in stage 2.0 (TID 325) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 133: Executor task launch worker for task 13.0 in stage 2.0 (TID 301) 2023-02-10 11:11:48 BlockManagerInfo: INFO: Removed broadcast_7_piece0 on 163.152.180.157:46313 in memory (size: 198.9 KiB, free: 79.8 GiB) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 144: Executor task launch worker for task 0.0 in stage 2.0 (TID 288) 2023-02-10 11:11:48 BlockManagerInfo: INFO: Removed broadcast_6_piece0 on 163.152.180.157:46313 in memory (size: 49.0 B, free: 79.8 GiB) 2023-02-10 11:11:48 BlockManagerInfo: INFO: Removed broadcast_2_piece0 on 163.152.180.157:46313 in memory (size: 49.0 B, free: 79.8 GiB) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 137: Executor task launch worker for task 21.0 in stage 2.0 (TID 309) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 130: Executor task launch worker for task 5.0 in stage 2.0 (TID 293) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 126: Executor task launch worker for task 2.0 in stage 2.0 (TID 290) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 159: Executor task launch worker for task 17.0 in stage 2.0 (TID 305) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 122: Executor task launch worker for task 23.0 in stage 2.0 (TID 311) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 136: Executor task launch worker for task 22.0 in stage 2.0 (TID 310) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 143: Executor task launch worker for task 11.0 in stage 2.0 (TID 299) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 141: Executor task launch worker for task 26.0 in stage 2.0 (TID 314) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 151: Executor task launch worker for task 20.0 in stage 2.0 (TID 308) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 152: Executor task launch worker for task 1.0 in stage 2.0 (TID 289) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 128: Executor task launch worker for task 4.0 in stage 2.0 (TID 292) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 149: Executor task launch worker for task 32.0 in stage 2.0 (TID 320) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 118: Executor task launch worker for task 15.0 in stage 2.0 (TID 303) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 131: Executor task launch worker for task 9.0 in stage 2.0 (TID 297) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 150: Executor task launch worker for task 39.0 in stage 2.0 (TID 327) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 134: Executor task launch worker for task 28.0 in stage 2.0 (TID 316) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 119: Executor task launch worker for task 29.0 in stage 2.0 (TID 317) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 133: Executor task launch worker for task 13.0 in stage 2.0 (TID 301) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 124: Executor task launch worker for task 3.0 in stage 2.0 (TID 291) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 117: Executor task launch worker for task 6.0 in stage 2.0 (TID 294) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 139: Executor task launch worker for task 31.0 in stage 2.0 (TID 319) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 153: Executor task launch worker for task 35.0 in stage 2.0 (TID 323) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 129: Executor task launch worker for task 14.0 in stage 2.0 (TID 302) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 121: Executor task launch worker for task 27.0 in stage 2.0 (TID 315) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 138: Executor task launch worker for task 25.0 in stage 2.0 (TID 313) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 120: Executor task launch worker for task 18.0 in stage 2.0 (TID 306) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 145: Executor task launch worker for task 19.0 in stage 2.0 (TID 307) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 114: Executor task launch worker for task 33.0 in stage 2.0 (TID 321) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 146: Executor task launch worker for task 12.0 in stage 2.0 (TID 300) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 115: Executor task launch worker for task 8.0 in stage 2.0 (TID 296) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 147: Executor task launch worker for task 38.0 in stage 2.0 (TID 326) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 125: Executor task launch worker for task 36.0 in stage 2.0 (TID 324) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 132: Executor task launch worker for task 24.0 in stage 2.0 (TID 312) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 140: Executor task launch worker for task 34.0 in stage 2.0 (TID 322) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 158: Executor task launch worker for task 37.0 in stage 2.0 (TID 325) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 116: Executor task launch worker for task 30.0 in stage 2.0 (TID 318) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 142: Executor task launch worker for task 16.0 in stage 2.0 (TID 304) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 127: Executor task launch worker for task 10.0 in stage 2.0 (TID 298) 2023-02-10 11:11:48 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 148: Executor task launch worker for task 7.0 in stage 2.0 (TID 295) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=23, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 122: Executor task launch worker for task 23.0 in stage 2.0 (TID 311) 2023-02-10 11:11:52 Executor: INFO: Finished task 23.0 in stage 2.0 (TID 311). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 40.0 in stage 2.0 (TID 328) (163.152.180.157, executor driver, partition 40, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 23.0 in stage 2.0 (TID 311) in 4574 ms on 163.152.180.157 (executor driver) (1/144) 2023-02-10 11:11:52 Executor: INFO: Running task 40.0 in stage 2.0 (TID 328) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 40.0 in stage 2.0 (TID 328) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 122: Executor task launch worker for task 40.0 in stage 2.0 (TID 328) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 122: Executor task launch worker for task 40.0 in stage 2.0 (TID 328) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=14, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 129: Executor task launch worker for task 14.0 in stage 2.0 (TID 302) 2023-02-10 11:11:52 Executor: INFO: Finished task 14.0 in stage 2.0 (TID 302). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 41.0 in stage 2.0 (TID 329) (163.152.180.157, executor driver, partition 41, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 14.0 in stage 2.0 (TID 302) in 4662 ms on 163.152.180.157 (executor driver) (2/144) 2023-02-10 11:11:52 Executor: INFO: Running task 41.0 in stage 2.0 (TID 329) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 123: Executor task launch worker for task 41.0 in stage 2.0 (TID 329) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 123: Executor task launch worker for task 41.0 in stage 2.0 (TID 329) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 123: Executor task launch worker for task 41.0 in stage 2.0 (TID 329) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=16, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 142: Executor task launch worker for task 16.0 in stage 2.0 (TID 304) 2023-02-10 11:11:52 Executor: INFO: Finished task 16.0 in stage 2.0 (TID 304). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 42.0 in stage 2.0 (TID 330) (163.152.180.157, executor driver, partition 42, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 Executor: INFO: Running task 42.0 in stage 2.0 (TID 330) 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 16.0 in stage 2.0 (TID 304) in 4773 ms on 163.152.180.157 (executor driver) (3/144) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=8, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 115: Executor task launch worker for task 8.0 in stage 2.0 (TID 296) 2023-02-10 11:11:52 Executor: INFO: Finished task 8.0 in stage 2.0 (TID 296). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 43.0 in stage 2.0 (TID 331) (163.152.180.157, executor driver, partition 43, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 8.0 in stage 2.0 (TID 296) in 4787 ms on 163.152.180.157 (executor driver) (4/144) 2023-02-10 11:11:52 Executor: INFO: Running task 43.0 in stage 2.0 (TID 331) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 129: Executor task launch worker for task 42.0 in stage 2.0 (TID 330) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 129: Executor task launch worker for task 42.0 in stage 2.0 (TID 330) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=22, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 136: Executor task launch worker for task 22.0 in stage 2.0 (TID 310) 2023-02-10 11:11:52 Executor: INFO: Finished task 22.0 in stage 2.0 (TID 310). 839 bytes result sent to driver 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 129: Executor task launch worker for task 42.0 in stage 2.0 (TID 330) 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 44.0 in stage 2.0 (TID 332) (163.152.180.157, executor driver, partition 44, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 22.0 in stage 2.0 (TID 310) in 4816 ms on 163.152.180.157 (executor driver) (5/144) 2023-02-10 11:11:52 Executor: INFO: Running task 44.0 in stage 2.0 (TID 332) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=3, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 124: Executor task launch worker for task 3.0 in stage 2.0 (TID 291) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 43.0 in stage 2.0 (TID 331) 2023-02-10 11:11:52 Executor: INFO: Finished task 3.0 in stage 2.0 (TID 291). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 45.0 in stage 2.0 (TID 333) (163.152.180.157, executor driver, partition 45, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 142: Executor task launch worker for task 43.0 in stage 2.0 (TID 331) 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 3.0 in stage 2.0 (TID 291) in 4822 ms on 163.152.180.157 (executor driver) (6/144) 2023-02-10 11:11:52 Executor: INFO: Running task 45.0 in stage 2.0 (TID 333) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 142: Executor task launch worker for task 43.0 in stage 2.0 (TID 331) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 45.0 in stage 2.0 (TID 333) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=7, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 148: Executor task launch worker for task 7.0 in stage 2.0 (TID 295) 2023-02-10 11:11:52 Executor: INFO: Finished task 7.0 in stage 2.0 (TID 295). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 46.0 in stage 2.0 (TID 334) (163.152.180.157, executor driver, partition 46, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 7.0 in stage 2.0 (TID 295) in 4843 ms on 163.152.180.157 (executor driver) (7/144) 2023-02-10 11:11:52 Executor: INFO: Running task 46.0 in stage 2.0 (TID 334) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 124: Executor task launch worker for task 45.0 in stage 2.0 (TID 333) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 124: Executor task launch worker for task 45.0 in stage 2.0 (TID 333) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 44.0 in stage 2.0 (TID 332) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 115: Executor task launch worker for task 44.0 in stage 2.0 (TID 332) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=24, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 132: Executor task launch worker for task 24.0 in stage 2.0 (TID 312) 2023-02-10 11:11:52 Executor: INFO: Finished task 24.0 in stage 2.0 (TID 312). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 47.0 in stage 2.0 (TID 335) (163.152.180.157, executor driver, partition 47, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 24.0 in stage 2.0 (TID 312) in 4851 ms on 163.152.180.157 (executor driver) (8/144) 2023-02-10 11:11:52 Executor: INFO: Running task 47.0 in stage 2.0 (TID 335) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 115: Executor task launch worker for task 44.0 in stage 2.0 (TID 332) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=10, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 127: Executor task launch worker for task 10.0 in stage 2.0 (TID 298) 2023-02-10 11:11:52 Executor: INFO: Finished task 10.0 in stage 2.0 (TID 298). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 48.0 in stage 2.0 (TID 336) (163.152.180.157, executor driver, partition 48, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 47.0 in stage 2.0 (TID 335) 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 10.0 in stage 2.0 (TID 298) in 4867 ms on 163.152.180.157 (executor driver) (9/144) 2023-02-10 11:11:52 Executor: INFO: Running task 48.0 in stage 2.0 (TID 336) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 148: Executor task launch worker for task 47.0 in stage 2.0 (TID 335) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 148: Executor task launch worker for task 47.0 in stage 2.0 (TID 335) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 46.0 in stage 2.0 (TID 334) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 136: Executor task launch worker for task 46.0 in stage 2.0 (TID 334) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 136: Executor task launch worker for task 46.0 in stage 2.0 (TID 334) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=27, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 121: Executor task launch worker for task 27.0 in stage 2.0 (TID 315) 2023-02-10 11:11:52 Executor: INFO: Finished task 27.0 in stage 2.0 (TID 315). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 49.0 in stage 2.0 (TID 337) (163.152.180.157, executor driver, partition 49, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 27.0 in stage 2.0 (TID 315) in 4877 ms on 163.152.180.157 (executor driver) (10/144) 2023-02-10 11:11:52 Executor: INFO: Running task 49.0 in stage 2.0 (TID 337) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 48.0 in stage 2.0 (TID 336) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 49.0 in stage 2.0 (TID 337) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=28, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 134: Executor task launch worker for task 28.0 in stage 2.0 (TID 316) 2023-02-10 11:11:52 Executor: INFO: Finished task 28.0 in stage 2.0 (TID 316). 839 bytes result sent to driver 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=29, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 119: Executor task launch worker for task 29.0 in stage 2.0 (TID 317) 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 50.0 in stage 2.0 (TID 338) (163.152.180.157, executor driver, partition 50, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 28.0 in stage 2.0 (TID 316) in 4896 ms on 163.152.180.157 (executor driver) (11/144) 2023-02-10 11:11:52 Executor: INFO: Finished task 29.0 in stage 2.0 (TID 317). 839 bytes result sent to driver 2023-02-10 11:11:52 Executor: INFO: Running task 50.0 in stage 2.0 (TID 338) 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 51.0 in stage 2.0 (TID 339) (163.152.180.157, executor driver, partition 51, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 29.0 in stage 2.0 (TID 317) in 4897 ms on 163.152.180.157 (executor driver) (12/144) 2023-02-10 11:11:52 Executor: INFO: Running task 51.0 in stage 2.0 (TID 339) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 132: Executor task launch worker for task 48.0 in stage 2.0 (TID 336) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 127: Executor task launch worker for task 49.0 in stage 2.0 (TID 337) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 132: Executor task launch worker for task 48.0 in stage 2.0 (TID 336) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 127: Executor task launch worker for task 49.0 in stage 2.0 (TID 337) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 121: Executor task launch worker for task 51.0 in stage 2.0 (TID 339) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 50.0 in stage 2.0 (TID 338) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 121: Executor task launch worker for task 51.0 in stage 2.0 (TID 339) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 134: Executor task launch worker for task 50.0 in stage 2.0 (TID 338) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 121: Executor task launch worker for task 51.0 in stage 2.0 (TID 339) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 134: Executor task launch worker for task 50.0 in stage 2.0 (TID 338) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=26, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 141: Executor task launch worker for task 26.0 in stage 2.0 (TID 314) 2023-02-10 11:11:52 Executor: INFO: Finished task 26.0 in stage 2.0 (TID 314). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 52.0 in stage 2.0 (TID 340) (163.152.180.157, executor driver, partition 52, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 26.0 in stage 2.0 (TID 314) in 4926 ms on 163.152.180.157 (executor driver) (13/144) 2023-02-10 11:11:52 Executor: INFO: Running task 52.0 in stage 2.0 (TID 340) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=37, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 158: Executor task launch worker for task 37.0 in stage 2.0 (TID 325) 2023-02-10 11:11:52 Executor: INFO: Finished task 37.0 in stage 2.0 (TID 325). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 53.0 in stage 2.0 (TID 341) (163.152.180.157, executor driver, partition 53, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 37.0 in stage 2.0 (TID 325) in 4930 ms on 163.152.180.157 (executor driver) (14/144) 2023-02-10 11:11:52 Executor: INFO: Running task 53.0 in stage 2.0 (TID 341) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=9, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 131: Executor task launch worker for task 9.0 in stage 2.0 (TID 297) 2023-02-10 11:11:52 Executor: INFO: Finished task 9.0 in stage 2.0 (TID 297). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 54.0 in stage 2.0 (TID 342) (163.152.180.157, executor driver, partition 54, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 9.0 in stage 2.0 (TID 297) in 4936 ms on 163.152.180.157 (executor driver) (15/144) 2023-02-10 11:11:52 Executor: INFO: Running task 54.0 in stage 2.0 (TID 342) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 52.0 in stage 2.0 (TID 340) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 119: Executor task launch worker for task 52.0 in stage 2.0 (TID 340) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 119: Executor task launch worker for task 52.0 in stage 2.0 (TID 340) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=35, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 153: Executor task launch worker for task 35.0 in stage 2.0 (TID 323) 2023-02-10 11:11:52 Executor: INFO: Finished task 35.0 in stage 2.0 (TID 323). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 55.0 in stage 2.0 (TID 343) (163.152.180.157, executor driver, partition 55, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 Executor: INFO: Running task 55.0 in stage 2.0 (TID 343) 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 35.0 in stage 2.0 (TID 323) in 4947 ms on 163.152.180.157 (executor driver) (16/144) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 158: Executor task launch worker for task 54.0 in stage 2.0 (TID 342) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 158: Executor task launch worker for task 54.0 in stage 2.0 (TID 342) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 53.0 in stage 2.0 (TID 341) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 158: Executor task launch worker for task 54.0 in stage 2.0 (TID 342) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 141: Executor task launch worker for task 53.0 in stage 2.0 (TID 341) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 141: Executor task launch worker for task 53.0 in stage 2.0 (TID 341) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=33, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 114: Executor task launch worker for task 33.0 in stage 2.0 (TID 321) 2023-02-10 11:11:52 Executor: INFO: Finished task 33.0 in stage 2.0 (TID 321). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 56.0 in stage 2.0 (TID 344) (163.152.180.157, executor driver, partition 56, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 33.0 in stage 2.0 (TID 321) in 4957 ms on 163.152.180.157 (executor driver) (17/144) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=19, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 145: Executor task launch worker for task 19.0 in stage 2.0 (TID 307) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 55.0 in stage 2.0 (TID 343) 2023-02-10 11:11:52 Executor: INFO: Finished task 19.0 in stage 2.0 (TID 307). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 57.0 in stage 2.0 (TID 345) (163.152.180.157, executor driver, partition 57, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 Executor: INFO: Running task 57.0 in stage 2.0 (TID 345) 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 19.0 in stage 2.0 (TID 307) in 4965 ms on 163.152.180.157 (executor driver) (18/144) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 131: Executor task launch worker for task 55.0 in stage 2.0 (TID 343) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 131: Executor task launch worker for task 55.0 in stage 2.0 (TID 343) 2023-02-10 11:11:52 Executor: INFO: Running task 56.0 in stage 2.0 (TID 344) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=20, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 151: Executor task launch worker for task 20.0 in stage 2.0 (TID 308) 2023-02-10 11:11:52 Executor: INFO: Finished task 20.0 in stage 2.0 (TID 308). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 58.0 in stage 2.0 (TID 346) (163.152.180.157, executor driver, partition 58, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 20.0 in stage 2.0 (TID 308) in 4973 ms on 163.152.180.157 (executor driver) (19/144) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=11, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 143: Executor task launch worker for task 11.0 in stage 2.0 (TID 299) 2023-02-10 11:11:52 Executor: INFO: Finished task 11.0 in stage 2.0 (TID 299). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 59.0 in stage 2.0 (TID 347) (163.152.180.157, executor driver, partition 59, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 Executor: INFO: Running task 59.0 in stage 2.0 (TID 347) 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 11.0 in stage 2.0 (TID 299) in 4977 ms on 163.152.180.157 (executor driver) (20/144) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 57.0 in stage 2.0 (TID 345) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 153: Executor task launch worker for task 57.0 in stage 2.0 (TID 345) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 153: Executor task launch worker for task 57.0 in stage 2.0 (TID 345) 2023-02-10 11:11:52 Executor: INFO: Running task 58.0 in stage 2.0 (TID 346) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=36, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 125: Executor task launch worker for task 36.0 in stage 2.0 (TID 324) 2023-02-10 11:11:52 Executor: INFO: Finished task 36.0 in stage 2.0 (TID 324). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 60.0 in stage 2.0 (TID 348) (163.152.180.157, executor driver, partition 60, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 36.0 in stage 2.0 (TID 324) in 4988 ms on 163.152.180.157 (executor driver) (21/144) 2023-02-10 11:11:52 Executor: INFO: Running task 60.0 in stage 2.0 (TID 348) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=18, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 120: Executor task launch worker for task 18.0 in stage 2.0 (TID 306) 2023-02-10 11:11:52 Executor: INFO: Finished task 18.0 in stage 2.0 (TID 306). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 61.0 in stage 2.0 (TID 349) (163.152.180.157, executor driver, partition 61, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 Executor: INFO: Running task 61.0 in stage 2.0 (TID 349) 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 18.0 in stage 2.0 (TID 306) in 4996 ms on 163.152.180.157 (executor driver) (22/144) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 56.0 in stage 2.0 (TID 344) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 114: Executor task launch worker for task 56.0 in stage 2.0 (TID 344) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 58.0 in stage 2.0 (TID 346) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 151: Executor task launch worker for task 58.0 in stage 2.0 (TID 346) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 125: Executor task launch worker for task 60.0 in stage 2.0 (TID 348) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 59.0 in stage 2.0 (TID 347) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 125: Executor task launch worker for task 60.0 in stage 2.0 (TID 348) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 145: Executor task launch worker for task 59.0 in stage 2.0 (TID 347) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 151: Executor task launch worker for task 58.0 in stage 2.0 (TID 346) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 125: Executor task launch worker for task 60.0 in stage 2.0 (TID 348) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 145: Executor task launch worker for task 59.0 in stage 2.0 (TID 347) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 61.0 in stage 2.0 (TID 349) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 120: Executor task launch worker for task 61.0 in stage 2.0 (TID 349) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 120: Executor task launch worker for task 61.0 in stage 2.0 (TID 349) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 114: Executor task launch worker for task 56.0 in stage 2.0 (TID 344) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=2, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 126: Executor task launch worker for task 2.0 in stage 2.0 (TID 290) 2023-02-10 11:11:52 Executor: INFO: Finished task 2.0 in stage 2.0 (TID 290). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 62.0 in stage 2.0 (TID 350) (163.152.180.157, executor driver, partition 62, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 2.0 in stage 2.0 (TID 290) in 5025 ms on 163.152.180.157 (executor driver) (23/144) 2023-02-10 11:11:52 Executor: INFO: Running task 62.0 in stage 2.0 (TID 350) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=4, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 128: Executor task launch worker for task 4.0 in stage 2.0 (TID 292) 2023-02-10 11:11:52 Executor: INFO: Finished task 4.0 in stage 2.0 (TID 292). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 63.0 in stage 2.0 (TID 351) (163.152.180.157, executor driver, partition 63, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 Executor: INFO: Running task 63.0 in stage 2.0 (TID 351) 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 4.0 in stage 2.0 (TID 292) in 5041 ms on 163.152.180.157 (executor driver) (24/144) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=21, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 137: Executor task launch worker for task 21.0 in stage 2.0 (TID 309) 2023-02-10 11:11:52 Executor: INFO: Finished task 21.0 in stage 2.0 (TID 309). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 64.0 in stage 2.0 (TID 352) (163.152.180.157, executor driver, partition 64, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 21.0 in stage 2.0 (TID 309) in 5042 ms on 163.152.180.157 (executor driver) (25/144) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 62.0 in stage 2.0 (TID 350) 2023-02-10 11:11:52 Executor: INFO: Running task 64.0 in stage 2.0 (TID 352) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 143: Executor task launch worker for task 62.0 in stage 2.0 (TID 350) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 143: Executor task launch worker for task 62.0 in stage 2.0 (TID 350) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=15, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 118: Executor task launch worker for task 15.0 in stage 2.0 (TID 303) 2023-02-10 11:11:52 Executor: INFO: Finished task 15.0 in stage 2.0 (TID 303). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 65.0 in stage 2.0 (TID 353) (163.152.180.157, executor driver, partition 65, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 15.0 in stage 2.0 (TID 303) in 5055 ms on 163.152.180.157 (executor driver) (26/144) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 63.0 in stage 2.0 (TID 351) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 64.0 in stage 2.0 (TID 352) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 126: Executor task launch worker for task 63.0 in stage 2.0 (TID 351) 2023-02-10 11:11:52 Executor: INFO: Running task 65.0 in stage 2.0 (TID 353) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=17, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 159: Executor task launch worker for task 17.0 in stage 2.0 (TID 305) 2023-02-10 11:11:52 Executor: INFO: Finished task 17.0 in stage 2.0 (TID 305). 839 bytes result sent to driver 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 126: Executor task launch worker for task 63.0 in stage 2.0 (TID 351) 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 66.0 in stage 2.0 (TID 354) (163.152.180.157, executor driver, partition 66, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 17.0 in stage 2.0 (TID 305) in 5062 ms on 163.152.180.157 (executor driver) (27/144) 2023-02-10 11:11:52 Executor: INFO: Running task 66.0 in stage 2.0 (TID 354) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 128: Executor task launch worker for task 64.0 in stage 2.0 (TID 352) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 128: Executor task launch worker for task 64.0 in stage 2.0 (TID 352) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=30, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 116: Executor task launch worker for task 30.0 in stage 2.0 (TID 318) 2023-02-10 11:11:52 Executor: INFO: Finished task 30.0 in stage 2.0 (TID 318). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 67.0 in stage 2.0 (TID 355) (163.152.180.157, executor driver, partition 67, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 30.0 in stage 2.0 (TID 318) in 5071 ms on 163.152.180.157 (executor driver) (28/144) 2023-02-10 11:11:52 Executor: INFO: Running task 67.0 in stage 2.0 (TID 355) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=1, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 152: Executor task launch worker for task 1.0 in stage 2.0 (TID 289) 2023-02-10 11:11:52 Executor: INFO: Finished task 1.0 in stage 2.0 (TID 289). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 68.0 in stage 2.0 (TID 356) (163.152.180.157, executor driver, partition 68, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 1.0 in stage 2.0 (TID 289) in 5076 ms on 163.152.180.157 (executor driver) (29/144) 2023-02-10 11:11:52 Executor: INFO: Running task 68.0 in stage 2.0 (TID 356) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 66.0 in stage 2.0 (TID 354) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 137: Executor task launch worker for task 66.0 in stage 2.0 (TID 354) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 137: Executor task launch worker for task 66.0 in stage 2.0 (TID 354) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=38, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 147: Executor task launch worker for task 38.0 in stage 2.0 (TID 326) 2023-02-10 11:11:52 Executor: INFO: Finished task 38.0 in stage 2.0 (TID 326). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 69.0 in stage 2.0 (TID 357) (163.152.180.157, executor driver, partition 69, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 68.0 in stage 2.0 (TID 356) 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 38.0 in stage 2.0 (TID 326) in 5086 ms on 163.152.180.157 (executor driver) (30/144) 2023-02-10 11:11:52 Executor: INFO: Running task 69.0 in stage 2.0 (TID 357) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 67.0 in stage 2.0 (TID 355) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 159: Executor task launch worker for task 67.0 in stage 2.0 (TID 355) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 159: Executor task launch worker for task 67.0 in stage 2.0 (TID 355) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 152: Executor task launch worker for task 68.0 in stage 2.0 (TID 356) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 152: Executor task launch worker for task 68.0 in stage 2.0 (TID 356) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 65.0 in stage 2.0 (TID 353) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 118: Executor task launch worker for task 65.0 in stage 2.0 (TID 353) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 69.0 in stage 2.0 (TID 357) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 116: Executor task launch worker for task 69.0 in stage 2.0 (TID 357) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=6, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 117: Executor task launch worker for task 6.0 in stage 2.0 (TID 294) 2023-02-10 11:11:52 Executor: INFO: Finished task 6.0 in stage 2.0 (TID 294). 839 bytes result sent to driver 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 118: Executor task launch worker for task 65.0 in stage 2.0 (TID 353) 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 70.0 in stage 2.0 (TID 358) (163.152.180.157, executor driver, partition 70, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 6.0 in stage 2.0 (TID 294) in 5108 ms on 163.152.180.157 (executor driver) (31/144) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 116: Executor task launch worker for task 69.0 in stage 2.0 (TID 357) 2023-02-10 11:11:52 Executor: INFO: Running task 70.0 in stage 2.0 (TID 358) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 70.0 in stage 2.0 (TID 358) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 117: Executor task launch worker for task 70.0 in stage 2.0 (TID 358) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 117: Executor task launch worker for task 70.0 in stage 2.0 (TID 358) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=25, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 138: Executor task launch worker for task 25.0 in stage 2.0 (TID 313) 2023-02-10 11:11:52 Executor: INFO: Finished task 25.0 in stage 2.0 (TID 313). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 71.0 in stage 2.0 (TID 359) (163.152.180.157, executor driver, partition 71, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 25.0 in stage 2.0 (TID 313) in 5139 ms on 163.152.180.157 (executor driver) (32/144) 2023-02-10 11:11:52 Executor: INFO: Running task 71.0 in stage 2.0 (TID 359) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=0, attempt=0, peakBytes=983040, peakBytesReadable=960.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 960.0K allocated (960.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 144: Executor task launch worker for task 0.0 in stage 2.0 (TID 288) 2023-02-10 11:11:52 Executor: INFO: Finished task 0.0 in stage 2.0 (TID 288). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 72.0 in stage 2.0 (TID 360) (163.152.180.157, executor driver, partition 72, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 Executor: INFO: Running task 72.0 in stage 2.0 (TID 360) 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 0.0 in stage 2.0 (TID 288) in 5160 ms on 163.152.180.157 (executor driver) (33/144) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=13, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 133: Executor task launch worker for task 13.0 in stage 2.0 (TID 301) 2023-02-10 11:11:52 Executor: INFO: Finished task 13.0 in stage 2.0 (TID 301). 839 bytes result sent to driver 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=31, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 139: Executor task launch worker for task 31.0 in stage 2.0 (TID 319) 2023-02-10 11:11:52 Executor: INFO: Finished task 31.0 in stage 2.0 (TID 319). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 73.0 in stage 2.0 (TID 361) (163.152.180.157, executor driver, partition 73, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 71.0 in stage 2.0 (TID 359) 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 13.0 in stage 2.0 (TID 301) in 5161 ms on 163.152.180.157 (executor driver) (34/144) 2023-02-10 11:11:52 Executor: INFO: Running task 73.0 in stage 2.0 (TID 361) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 147: Executor task launch worker for task 71.0 in stage 2.0 (TID 359) 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 74.0 in stage 2.0 (TID 362) (163.152.180.157, executor driver, partition 74, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 31.0 in stage 2.0 (TID 319) in 5161 ms on 163.152.180.157 (executor driver) (35/144) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 147: Executor task launch worker for task 71.0 in stage 2.0 (TID 359) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=39, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 150: Executor task launch worker for task 39.0 in stage 2.0 (TID 327) 2023-02-10 11:11:52 Executor: INFO: Finished task 39.0 in stage 2.0 (TID 327). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 75.0 in stage 2.0 (TID 363) (163.152.180.157, executor driver, partition 75, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 Executor: INFO: Running task 75.0 in stage 2.0 (TID 363) 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 39.0 in stage 2.0 (TID 327) in 5166 ms on 163.152.180.157 (executor driver) (36/144) 2023-02-10 11:11:52 Executor: INFO: Running task 74.0 in stage 2.0 (TID 362) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 72.0 in stage 2.0 (TID 360) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 144: Executor task launch worker for task 72.0 in stage 2.0 (TID 360) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 138: Executor task launch worker for task 73.0 in stage 2.0 (TID 361) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 144: Executor task launch worker for task 72.0 in stage 2.0 (TID 360) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 74.0 in stage 2.0 (TID 362) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 139: Executor task launch worker for task 74.0 in stage 2.0 (TID 362) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 139: Executor task launch worker for task 74.0 in stage 2.0 (TID 362) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 138: Executor task launch worker for task 73.0 in stage 2.0 (TID 361) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 138: Executor task launch worker for task 73.0 in stage 2.0 (TID 361) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=32, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 149: Executor task launch worker for task 32.0 in stage 2.0 (TID 320) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 75.0 in stage 2.0 (TID 363) 2023-02-10 11:11:52 Executor: INFO: Finished task 32.0 in stage 2.0 (TID 320). 839 bytes result sent to driver 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 133: Executor task launch worker for task 75.0 in stage 2.0 (TID 363) 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 76.0 in stage 2.0 (TID 364) (163.152.180.157, executor driver, partition 76, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 32.0 in stage 2.0 (TID 320) in 5191 ms on 163.152.180.157 (executor driver) (37/144) 2023-02-10 11:11:52 Executor: INFO: Running task 76.0 in stage 2.0 (TID 364) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 149: Executor task launch worker for task 76.0 in stage 2.0 (TID 364) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 149: Executor task launch worker for task 76.0 in stage 2.0 (TID 364) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 133: Executor task launch worker for task 75.0 in stage 2.0 (TID 363) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 149: Executor task launch worker for task 76.0 in stage 2.0 (TID 364) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=34, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 140: Executor task launch worker for task 34.0 in stage 2.0 (TID 322) 2023-02-10 11:11:52 Executor: INFO: Finished task 34.0 in stage 2.0 (TID 322). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 77.0 in stage 2.0 (TID 365) (163.152.180.157, executor driver, partition 77, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 34.0 in stage 2.0 (TID 322) in 5220 ms on 163.152.180.157 (executor driver) (38/144) 2023-02-10 11:11:52 Executor: INFO: Running task 77.0 in stage 2.0 (TID 365) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 77.0 in stage 2.0 (TID 365) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 140: Executor task launch worker for task 77.0 in stage 2.0 (TID 365) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 140: Executor task launch worker for task 77.0 in stage 2.0 (TID 365) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=12, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 146: Executor task launch worker for task 12.0 in stage 2.0 (TID 300) 2023-02-10 11:11:52 Executor: INFO: Finished task 12.0 in stage 2.0 (TID 300). 839 bytes result sent to driver 2023-02-10 11:11:52 TaskSetManager: INFO: Starting task 78.0 in stage 2.0 (TID 366) (163.152.180.157, executor driver, partition 78, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:52 TaskSetManager: INFO: Finished task 12.0 in stage 2.0 (TID 300) in 5261 ms on 163.152.180.157 (executor driver) (39/144) 2023-02-10 11:11:52 Executor: INFO: Running task 78.0 in stage 2.0 (TID 366) 2023-02-10 11:11:52 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 78.0 in stage 2.0 (TID 366) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 146: Executor task launch worker for task 78.0 in stage 2.0 (TID 366) 2023-02-10 11:11:52 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 146: Executor task launch worker for task 78.0 in stage 2.0 (TID 366) 2023-02-10 11:11:52 root: INFO: TaskReport: stage=2, partition=5, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:52 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 130: Executor task launch worker for task 5.0 in stage 2.0 (TID 293) 2023-02-10 11:11:52 Executor: INFO: Finished task 5.0 in stage 2.0 (TID 293). 839 bytes result sent to driver 2023-02-10 11:11:53 TaskSetManager: INFO: Starting task 79.0 in stage 2.0 (TID 367) (163.152.180.157, executor driver, partition 79, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:53 TaskSetManager: INFO: Finished task 5.0 in stage 2.0 (TID 293) in 5409 ms on 163.152.180.157 (executor driver) (40/144) 2023-02-10 11:11:53 Executor: INFO: Running task 79.0 in stage 2.0 (TID 367) 2023-02-10 11:11:53 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 79.0 in stage 2.0 (TID 367) 2023-02-10 11:11:53 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 150: Executor task launch worker for task 79.0 in stage 2.0 (TID 367) 2023-02-10 11:11:53 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 150: Executor task launch worker for task 79.0 in stage 2.0 (TID 367) 2023-02-10 11:11:55 root: INFO: TaskReport: stage=2, partition=41, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:55 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 123: Executor task launch worker for task 41.0 in stage 2.0 (TID 329) 2023-02-10 11:11:55 Executor: INFO: Finished task 41.0 in stage 2.0 (TID 329). 839 bytes result sent to driver 2023-02-10 11:11:55 TaskSetManager: INFO: Starting task 80.0 in stage 2.0 (TID 368) (163.152.180.157, executor driver, partition 80, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:55 TaskSetManager: INFO: Finished task 41.0 in stage 2.0 (TID 329) in 3326 ms on 163.152.180.157 (executor driver) (41/144) 2023-02-10 11:11:55 Executor: INFO: Running task 80.0 in stage 2.0 (TID 368) 2023-02-10 11:11:55 root: INFO: RegionPool: initialized for thread 123: Executor task launch worker for task 80.0 in stage 2.0 (TID 368) 2023-02-10 11:11:55 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 123: Executor task launch worker for task 80.0 in stage 2.0 (TID 368) 2023-02-10 11:11:55 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 123: Executor task launch worker for task 80.0 in stage 2.0 (TID 368) 2023-02-10 11:11:55 root: INFO: TaskReport: stage=2, partition=47, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:55 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 148: Executor task launch worker for task 47.0 in stage 2.0 (TID 335) 2023-02-10 11:11:55 Executor: INFO: Finished task 47.0 in stage 2.0 (TID 335). 839 bytes result sent to driver 2023-02-10 11:11:55 TaskSetManager: INFO: Starting task 81.0 in stage 2.0 (TID 369) (163.152.180.157, executor driver, partition 81, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:55 TaskSetManager: INFO: Finished task 47.0 in stage 2.0 (TID 335) in 3369 ms on 163.152.180.157 (executor driver) (42/144) 2023-02-10 11:11:55 Executor: INFO: Running task 81.0 in stage 2.0 (TID 369) 2023-02-10 11:11:55 root: INFO: TaskReport: stage=2, partition=44, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:55 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 115: Executor task launch worker for task 44.0 in stage 2.0 (TID 332) 2023-02-10 11:11:55 Executor: INFO: Finished task 44.0 in stage 2.0 (TID 332). 839 bytes result sent to driver 2023-02-10 11:11:55 root: INFO: TaskReport: stage=2, partition=50, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:55 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 134: Executor task launch worker for task 50.0 in stage 2.0 (TID 338) 2023-02-10 11:11:55 TaskSetManager: INFO: Starting task 82.0 in stage 2.0 (TID 370) (163.152.180.157, executor driver, partition 82, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:55 Executor: INFO: Finished task 50.0 in stage 2.0 (TID 338). 839 bytes result sent to driver 2023-02-10 11:11:55 TaskSetManager: INFO: Starting task 83.0 in stage 2.0 (TID 371) (163.152.180.157, executor driver, partition 83, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:55 Executor: INFO: Running task 83.0 in stage 2.0 (TID 371) 2023-02-10 11:11:55 TaskSetManager: INFO: Finished task 44.0 in stage 2.0 (TID 332) in 3415 ms on 163.152.180.157 (executor driver) (43/144) 2023-02-10 11:11:55 TaskSetManager: INFO: Finished task 50.0 in stage 2.0 (TID 338) in 3336 ms on 163.152.180.157 (executor driver) (44/144) 2023-02-10 11:11:55 Executor: INFO: Running task 82.0 in stage 2.0 (TID 370) 2023-02-10 11:11:55 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 81.0 in stage 2.0 (TID 369) 2023-02-10 11:11:55 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 130: Executor task launch worker for task 81.0 in stage 2.0 (TID 369) 2023-02-10 11:11:55 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 130: Executor task launch worker for task 81.0 in stage 2.0 (TID 369) 2023-02-10 11:11:55 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 83.0 in stage 2.0 (TID 371) 2023-02-10 11:11:55 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 134: Executor task launch worker for task 83.0 in stage 2.0 (TID 371) 2023-02-10 11:11:55 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 82.0 in stage 2.0 (TID 370) 2023-02-10 11:11:55 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 115: Executor task launch worker for task 82.0 in stage 2.0 (TID 370) 2023-02-10 11:11:55 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 134: Executor task launch worker for task 83.0 in stage 2.0 (TID 371) 2023-02-10 11:11:55 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 115: Executor task launch worker for task 82.0 in stage 2.0 (TID 370) 2023-02-10 11:11:55 root: INFO: TaskReport: stage=2, partition=57, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:55 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 153: Executor task launch worker for task 57.0 in stage 2.0 (TID 345) 2023-02-10 11:11:55 Executor: INFO: Finished task 57.0 in stage 2.0 (TID 345). 839 bytes result sent to driver 2023-02-10 11:11:55 TaskSetManager: INFO: Starting task 84.0 in stage 2.0 (TID 372) (163.152.180.157, executor driver, partition 84, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:55 TaskSetManager: INFO: Finished task 57.0 in stage 2.0 (TID 345) in 3384 ms on 163.152.180.157 (executor driver) (45/144) 2023-02-10 11:11:55 Executor: INFO: Running task 84.0 in stage 2.0 (TID 372) 2023-02-10 11:11:55 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 84.0 in stage 2.0 (TID 372) 2023-02-10 11:11:55 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 153: Executor task launch worker for task 84.0 in stage 2.0 (TID 372) 2023-02-10 11:11:55 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 153: Executor task launch worker for task 84.0 in stage 2.0 (TID 372) 2023-02-10 11:11:55 root: INFO: TaskReport: stage=2, partition=40, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:55 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 122: Executor task launch worker for task 40.0 in stage 2.0 (TID 328) 2023-02-10 11:11:55 Executor: INFO: Finished task 40.0 in stage 2.0 (TID 328). 839 bytes result sent to driver 2023-02-10 11:11:55 TaskSetManager: INFO: Starting task 85.0 in stage 2.0 (TID 373) (163.152.180.157, executor driver, partition 85, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:55 TaskSetManager: INFO: Finished task 40.0 in stage 2.0 (TID 328) in 3833 ms on 163.152.180.157 (executor driver) (46/144) 2023-02-10 11:11:55 Executor: INFO: Running task 85.0 in stage 2.0 (TID 373) 2023-02-10 11:11:55 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 85.0 in stage 2.0 (TID 373) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 122: Executor task launch worker for task 85.0 in stage 2.0 (TID 373) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 122: Executor task launch worker for task 85.0 in stage 2.0 (TID 373) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=48, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 132: Executor task launch worker for task 48.0 in stage 2.0 (TID 336) 2023-02-10 11:11:56 Executor: INFO: Finished task 48.0 in stage 2.0 (TID 336). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 86.0 in stage 2.0 (TID 374) (163.152.180.157, executor driver, partition 86, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 48.0 in stage 2.0 (TID 336) in 3627 ms on 163.152.180.157 (executor driver) (47/144) 2023-02-10 11:11:56 Executor: INFO: Running task 86.0 in stage 2.0 (TID 374) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=43, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 142: Executor task launch worker for task 43.0 in stage 2.0 (TID 331) 2023-02-10 11:11:56 Executor: INFO: Finished task 43.0 in stage 2.0 (TID 331). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 87.0 in stage 2.0 (TID 375) (163.152.180.157, executor driver, partition 87, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Running task 87.0 in stage 2.0 (TID 375) 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 43.0 in stage 2.0 (TID 331) in 3721 ms on 163.152.180.157 (executor driver) (48/144) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 86.0 in stage 2.0 (TID 374) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 87.0 in stage 2.0 (TID 375) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 142: Executor task launch worker for task 87.0 in stage 2.0 (TID 375) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 148: Executor task launch worker for task 86.0 in stage 2.0 (TID 374) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=46, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 136: Executor task launch worker for task 46.0 in stage 2.0 (TID 334) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 142: Executor task launch worker for task 87.0 in stage 2.0 (TID 375) 2023-02-10 11:11:56 Executor: INFO: Finished task 46.0 in stage 2.0 (TID 334). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 88.0 in stage 2.0 (TID 376) (163.152.180.157, executor driver, partition 88, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 46.0 in stage 2.0 (TID 334) in 3677 ms on 163.152.180.157 (executor driver) (49/144) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 148: Executor task launch worker for task 86.0 in stage 2.0 (TID 374) 2023-02-10 11:11:56 Executor: INFO: Running task 88.0 in stage 2.0 (TID 376) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=76, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 149: Executor task launch worker for task 76.0 in stage 2.0 (TID 364) 2023-02-10 11:11:56 Executor: INFO: Finished task 76.0 in stage 2.0 (TID 364). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 89.0 in stage 2.0 (TID 377) (163.152.180.157, executor driver, partition 89, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 76.0 in stage 2.0 (TID 364) in 3350 ms on 163.152.180.157 (executor driver) (50/144) 2023-02-10 11:11:56 Executor: INFO: Running task 89.0 in stage 2.0 (TID 377) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=58, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 151: Executor task launch worker for task 58.0 in stage 2.0 (TID 346) 2023-02-10 11:11:56 Executor: INFO: Finished task 58.0 in stage 2.0 (TID 346). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 90.0 in stage 2.0 (TID 378) (163.152.180.157, executor driver, partition 90, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 58.0 in stage 2.0 (TID 346) in 3572 ms on 163.152.180.157 (executor driver) (51/144) 2023-02-10 11:11:56 Executor: INFO: Running task 90.0 in stage 2.0 (TID 378) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 88.0 in stage 2.0 (TID 376) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 136: Executor task launch worker for task 88.0 in stage 2.0 (TID 376) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 136: Executor task launch worker for task 88.0 in stage 2.0 (TID 376) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=67, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 159: Executor task launch worker for task 67.0 in stage 2.0 (TID 355) 2023-02-10 11:11:56 Executor: INFO: Finished task 67.0 in stage 2.0 (TID 355). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 91.0 in stage 2.0 (TID 379) (163.152.180.157, executor driver, partition 91, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 67.0 in stage 2.0 (TID 355) in 3484 ms on 163.152.180.157 (executor driver) (52/144) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 89.0 in stage 2.0 (TID 377) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 132: Executor task launch worker for task 89.0 in stage 2.0 (TID 377) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 149: Executor task launch worker for task 90.0 in stage 2.0 (TID 378) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 132: Executor task launch worker for task 89.0 in stage 2.0 (TID 377) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 149: Executor task launch worker for task 90.0 in stage 2.0 (TID 378) 2023-02-10 11:11:56 Executor: INFO: Running task 91.0 in stage 2.0 (TID 379) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 149: Executor task launch worker for task 90.0 in stage 2.0 (TID 378) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 91.0 in stage 2.0 (TID 379) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 159: Executor task launch worker for task 91.0 in stage 2.0 (TID 379) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 159: Executor task launch worker for task 91.0 in stage 2.0 (TID 379) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=49, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 127: Executor task launch worker for task 49.0 in stage 2.0 (TID 337) 2023-02-10 11:11:56 Executor: INFO: Finished task 49.0 in stage 2.0 (TID 337). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 92.0 in stage 2.0 (TID 380) (163.152.180.157, executor driver, partition 92, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 49.0 in stage 2.0 (TID 337) in 3755 ms on 163.152.180.157 (executor driver) (53/144) 2023-02-10 11:11:56 Executor: INFO: Running task 92.0 in stage 2.0 (TID 380) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=45, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 124: Executor task launch worker for task 45.0 in stage 2.0 (TID 333) 2023-02-10 11:11:56 Executor: INFO: Finished task 45.0 in stage 2.0 (TID 333). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 93.0 in stage 2.0 (TID 381) (163.152.180.157, executor driver, partition 93, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Running task 93.0 in stage 2.0 (TID 381) 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 45.0 in stage 2.0 (TID 333) in 3818 ms on 163.152.180.157 (executor driver) (54/144) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 92.0 in stage 2.0 (TID 380) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 127: Executor task launch worker for task 92.0 in stage 2.0 (TID 380) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 127: Executor task launch worker for task 92.0 in stage 2.0 (TID 380) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 93.0 in stage 2.0 (TID 381) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=78, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 146: Executor task launch worker for task 78.0 in stage 2.0 (TID 366) 2023-02-10 11:11:56 Executor: INFO: Finished task 78.0 in stage 2.0 (TID 366). 839 bytes result sent to driver 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=53, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 141: Executor task launch worker for task 53.0 in stage 2.0 (TID 341) 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 94.0 in stage 2.0 (TID 382) (163.152.180.157, executor driver, partition 94, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Finished task 53.0 in stage 2.0 (TID 341). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 78.0 in stage 2.0 (TID 366) in 3404 ms on 163.152.180.157 (executor driver) (55/144) 2023-02-10 11:11:56 Executor: INFO: Running task 94.0 in stage 2.0 (TID 382) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 124: Executor task launch worker for task 93.0 in stage 2.0 (TID 381) 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 95.0 in stage 2.0 (TID 383) (163.152.180.157, executor driver, partition 95, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 53.0 in stage 2.0 (TID 341) in 3733 ms on 163.152.180.157 (executor driver) (56/144) 2023-02-10 11:11:56 Executor: INFO: Running task 95.0 in stage 2.0 (TID 383) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=55, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 131: Executor task launch worker for task 55.0 in stage 2.0 (TID 343) 2023-02-10 11:11:56 Executor: INFO: Finished task 55.0 in stage 2.0 (TID 343). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 96.0 in stage 2.0 (TID 384) (163.152.180.157, executor driver, partition 96, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Running task 96.0 in stage 2.0 (TID 384) 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 55.0 in stage 2.0 (TID 343) in 3719 ms on 163.152.180.157 (executor driver) (57/144) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 124: Executor task launch worker for task 93.0 in stage 2.0 (TID 381) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=61, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 120: Executor task launch worker for task 61.0 in stage 2.0 (TID 349) 2023-02-10 11:11:56 Executor: INFO: Finished task 61.0 in stage 2.0 (TID 349). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 97.0 in stage 2.0 (TID 385) (163.152.180.157, executor driver, partition 97, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Running task 97.0 in stage 2.0 (TID 385) 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 61.0 in stage 2.0 (TID 349) in 3681 ms on 163.152.180.157 (executor driver) (58/144) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=71, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 147: Executor task launch worker for task 71.0 in stage 2.0 (TID 359) 2023-02-10 11:11:56 Executor: INFO: Finished task 71.0 in stage 2.0 (TID 359). 839 bytes result sent to driver 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 95.0 in stage 2.0 (TID 383) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 141: Executor task launch worker for task 95.0 in stage 2.0 (TID 383) 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 98.0 in stage 2.0 (TID 386) (163.152.180.157, executor driver, partition 98, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 71.0 in stage 2.0 (TID 359) in 3543 ms on 163.152.180.157 (executor driver) (59/144) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 94.0 in stage 2.0 (TID 382) 2023-02-10 11:11:56 Executor: INFO: Running task 98.0 in stage 2.0 (TID 386) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 141: Executor task launch worker for task 95.0 in stage 2.0 (TID 383) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 151: Executor task launch worker for task 94.0 in stage 2.0 (TID 382) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 151: Executor task launch worker for task 94.0 in stage 2.0 (TID 382) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 97.0 in stage 2.0 (TID 385) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 120: Executor task launch worker for task 97.0 in stage 2.0 (TID 385) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 98.0 in stage 2.0 (TID 386) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 147: Executor task launch worker for task 98.0 in stage 2.0 (TID 386) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 120: Executor task launch worker for task 97.0 in stage 2.0 (TID 385) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 147: Executor task launch worker for task 98.0 in stage 2.0 (TID 386) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=42, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 129: Executor task launch worker for task 42.0 in stage 2.0 (TID 330) 2023-02-10 11:11:56 Executor: INFO: Finished task 42.0 in stage 2.0 (TID 330). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 99.0 in stage 2.0 (TID 387) (163.152.180.157, executor driver, partition 99, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 42.0 in stage 2.0 (TID 330) in 3940 ms on 163.152.180.157 (executor driver) (60/144) 2023-02-10 11:11:56 Executor: INFO: Running task 99.0 in stage 2.0 (TID 387) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 96.0 in stage 2.0 (TID 384) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 131: Executor task launch worker for task 96.0 in stage 2.0 (TID 384) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 99.0 in stage 2.0 (TID 387) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 146: Executor task launch worker for task 99.0 in stage 2.0 (TID 387) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 131: Executor task launch worker for task 96.0 in stage 2.0 (TID 384) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=64, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 128: Executor task launch worker for task 64.0 in stage 2.0 (TID 352) 2023-02-10 11:11:56 Executor: INFO: Finished task 64.0 in stage 2.0 (TID 352). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 100.0 in stage 2.0 (TID 388) (163.152.180.157, executor driver, partition 100, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 64.0 in stage 2.0 (TID 352) in 3686 ms on 163.152.180.157 (executor driver) (61/144) 2023-02-10 11:11:56 Executor: INFO: Running task 100.0 in stage 2.0 (TID 388) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=65, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 118: Executor task launch worker for task 65.0 in stage 2.0 (TID 353) 2023-02-10 11:11:56 Executor: INFO: Finished task 65.0 in stage 2.0 (TID 353). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 101.0 in stage 2.0 (TID 389) (163.152.180.157, executor driver, partition 101, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 65.0 in stage 2.0 (TID 353) in 3677 ms on 163.152.180.157 (executor driver) (62/144) 2023-02-10 11:11:56 Executor: INFO: Running task 101.0 in stage 2.0 (TID 389) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 146: Executor task launch worker for task 99.0 in stage 2.0 (TID 387) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 129: Executor task launch worker for task 100.0 in stage 2.0 (TID 388) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=52, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 119: Executor task launch worker for task 52.0 in stage 2.0 (TID 340) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 101.0 in stage 2.0 (TID 389) 2023-02-10 11:11:56 Executor: INFO: Finished task 52.0 in stage 2.0 (TID 340). 839 bytes result sent to driver 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 128: Executor task launch worker for task 101.0 in stage 2.0 (TID 389) 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 102.0 in stage 2.0 (TID 390) (163.152.180.157, executor driver, partition 102, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Running task 102.0 in stage 2.0 (TID 390) 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 52.0 in stage 2.0 (TID 340) in 3822 ms on 163.152.180.157 (executor driver) (63/144) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 129: Executor task launch worker for task 100.0 in stage 2.0 (TID 388) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 128: Executor task launch worker for task 101.0 in stage 2.0 (TID 389) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 129: Executor task launch worker for task 100.0 in stage 2.0 (TID 388) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=54, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 158: Executor task launch worker for task 54.0 in stage 2.0 (TID 342) 2023-02-10 11:11:56 Executor: INFO: Finished task 54.0 in stage 2.0 (TID 342). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 103.0 in stage 2.0 (TID 391) (163.152.180.157, executor driver, partition 103, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Running task 103.0 in stage 2.0 (TID 391) 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 54.0 in stage 2.0 (TID 342) in 3818 ms on 163.152.180.157 (executor driver) (64/144) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=63, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 126: Executor task launch worker for task 63.0 in stage 2.0 (TID 351) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 102.0 in stage 2.0 (TID 390) 2023-02-10 11:11:56 Executor: INFO: Finished task 63.0 in stage 2.0 (TID 351). 839 bytes result sent to driver 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 118: Executor task launch worker for task 102.0 in stage 2.0 (TID 390) 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 104.0 in stage 2.0 (TID 392) (163.152.180.157, executor driver, partition 104, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 63.0 in stage 2.0 (TID 351) in 3726 ms on 163.152.180.157 (executor driver) (65/144) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 118: Executor task launch worker for task 102.0 in stage 2.0 (TID 390) 2023-02-10 11:11:56 Executor: INFO: Running task 104.0 in stage 2.0 (TID 392) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 103.0 in stage 2.0 (TID 391) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 119: Executor task launch worker for task 103.0 in stage 2.0 (TID 391) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=59, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 145: Executor task launch worker for task 59.0 in stage 2.0 (TID 347) 2023-02-10 11:11:56 Executor: INFO: Finished task 59.0 in stage 2.0 (TID 347). 839 bytes result sent to driver 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 119: Executor task launch worker for task 103.0 in stage 2.0 (TID 391) 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 105.0 in stage 2.0 (TID 393) (163.152.180.157, executor driver, partition 105, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Running task 105.0 in stage 2.0 (TID 393) 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 59.0 in stage 2.0 (TID 347) in 3811 ms on 163.152.180.157 (executor driver) (66/144) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=69, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 116: Executor task launch worker for task 69.0 in stage 2.0 (TID 357) 2023-02-10 11:11:56 Executor: INFO: Finished task 69.0 in stage 2.0 (TID 357). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 106.0 in stage 2.0 (TID 394) (163.152.180.157, executor driver, partition 106, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 69.0 in stage 2.0 (TID 357) in 3708 ms on 163.152.180.157 (executor driver) (67/144) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 104.0 in stage 2.0 (TID 392) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 126: Executor task launch worker for task 104.0 in stage 2.0 (TID 392) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 126: Executor task launch worker for task 104.0 in stage 2.0 (TID 392) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 158: Executor task launch worker for task 105.0 in stage 2.0 (TID 393) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 158: Executor task launch worker for task 105.0 in stage 2.0 (TID 393) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=62, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 143: Executor task launch worker for task 62.0 in stage 2.0 (TID 350) 2023-02-10 11:11:56 Executor: INFO: Finished task 62.0 in stage 2.0 (TID 350). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 107.0 in stage 2.0 (TID 395) (163.152.180.157, executor driver, partition 107, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 62.0 in stage 2.0 (TID 350) in 3783 ms on 163.152.180.157 (executor driver) (68/144) 2023-02-10 11:11:56 Executor: INFO: Running task 107.0 in stage 2.0 (TID 395) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 158: Executor task launch worker for task 105.0 in stage 2.0 (TID 393) 2023-02-10 11:11:56 Executor: INFO: Running task 106.0 in stage 2.0 (TID 394) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=60, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 125: Executor task launch worker for task 60.0 in stage 2.0 (TID 348) 2023-02-10 11:11:56 Executor: INFO: Finished task 60.0 in stage 2.0 (TID 348). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 108.0 in stage 2.0 (TID 396) (163.152.180.157, executor driver, partition 108, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Running task 108.0 in stage 2.0 (TID 396) 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 60.0 in stage 2.0 (TID 348) in 3825 ms on 163.152.180.157 (executor driver) (69/144) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=66, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 137: Executor task launch worker for task 66.0 in stage 2.0 (TID 354) 2023-02-10 11:11:56 Executor: INFO: Finished task 66.0 in stage 2.0 (TID 354). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 109.0 in stage 2.0 (TID 397) (163.152.180.157, executor driver, partition 109, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Running task 109.0 in stage 2.0 (TID 397) 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 66.0 in stage 2.0 (TID 354) in 3756 ms on 163.152.180.157 (executor driver) (70/144) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 107.0 in stage 2.0 (TID 395) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 145: Executor task launch worker for task 107.0 in stage 2.0 (TID 395) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 145: Executor task launch worker for task 107.0 in stage 2.0 (TID 395) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 106.0 in stage 2.0 (TID 394) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 116: Executor task launch worker for task 106.0 in stage 2.0 (TID 394) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 116: Executor task launch worker for task 106.0 in stage 2.0 (TID 394) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 108.0 in stage 2.0 (TID 396) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 143: Executor task launch worker for task 108.0 in stage 2.0 (TID 396) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 125: Executor task launch worker for task 109.0 in stage 2.0 (TID 397) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 143: Executor task launch worker for task 108.0 in stage 2.0 (TID 396) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 125: Executor task launch worker for task 109.0 in stage 2.0 (TID 397) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 125: Executor task launch worker for task 109.0 in stage 2.0 (TID 397) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=79, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 150: Executor task launch worker for task 79.0 in stage 2.0 (TID 367) 2023-02-10 11:11:56 Executor: INFO: Finished task 79.0 in stage 2.0 (TID 367). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 110.0 in stage 2.0 (TID 398) (163.152.180.157, executor driver, partition 110, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Running task 110.0 in stage 2.0 (TID 398) 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 79.0 in stage 2.0 (TID 367) in 3453 ms on 163.152.180.157 (executor driver) (71/144) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 110.0 in stage 2.0 (TID 398) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 137: Executor task launch worker for task 110.0 in stage 2.0 (TID 398) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 137: Executor task launch worker for task 110.0 in stage 2.0 (TID 398) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=73, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 138: Executor task launch worker for task 73.0 in stage 2.0 (TID 361) 2023-02-10 11:11:56 Executor: INFO: Finished task 73.0 in stage 2.0 (TID 361). 839 bytes result sent to driver 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=68, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 152: Executor task launch worker for task 68.0 in stage 2.0 (TID 356) 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 111.0 in stage 2.0 (TID 399) (163.152.180.157, executor driver, partition 111, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 73.0 in stage 2.0 (TID 361) in 3765 ms on 163.152.180.157 (executor driver) (72/144) 2023-02-10 11:11:56 Executor: INFO: Running task 111.0 in stage 2.0 (TID 399) 2023-02-10 11:11:56 Executor: INFO: Finished task 68.0 in stage 2.0 (TID 356). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 112.0 in stage 2.0 (TID 400) (163.152.180.157, executor driver, partition 112, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 68.0 in stage 2.0 (TID 356) in 3853 ms on 163.152.180.157 (executor driver) (73/144) 2023-02-10 11:11:56 Executor: INFO: Running task 112.0 in stage 2.0 (TID 400) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 111.0 in stage 2.0 (TID 399) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 150: Executor task launch worker for task 111.0 in stage 2.0 (TID 399) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 150: Executor task launch worker for task 111.0 in stage 2.0 (TID 399) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=77, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 140: Executor task launch worker for task 77.0 in stage 2.0 (TID 365) 2023-02-10 11:11:56 Executor: INFO: Finished task 77.0 in stage 2.0 (TID 365). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 113.0 in stage 2.0 (TID 401) (163.152.180.157, executor driver, partition 113, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 77.0 in stage 2.0 (TID 365) in 3750 ms on 163.152.180.157 (executor driver) (74/144) 2023-02-10 11:11:56 Executor: INFO: Running task 113.0 in stage 2.0 (TID 401) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=74, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 139: Executor task launch worker for task 74.0 in stage 2.0 (TID 362) 2023-02-10 11:11:56 Executor: INFO: Finished task 74.0 in stage 2.0 (TID 362). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 114.0 in stage 2.0 (TID 402) (163.152.180.157, executor driver, partition 114, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 74.0 in stage 2.0 (TID 362) in 3810 ms on 163.152.180.157 (executor driver) (75/144) 2023-02-10 11:11:56 Executor: INFO: Running task 114.0 in stage 2.0 (TID 402) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 138: Executor task launch worker for task 112.0 in stage 2.0 (TID 400) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 138: Executor task launch worker for task 112.0 in stage 2.0 (TID 400) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 138: Executor task launch worker for task 112.0 in stage 2.0 (TID 400) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 113.0 in stage 2.0 (TID 401) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 152: Executor task launch worker for task 113.0 in stage 2.0 (TID 401) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 114.0 in stage 2.0 (TID 402) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 139: Executor task launch worker for task 114.0 in stage 2.0 (TID 402) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 152: Executor task launch worker for task 113.0 in stage 2.0 (TID 401) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 139: Executor task launch worker for task 114.0 in stage 2.0 (TID 402) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=72, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 144: Executor task launch worker for task 72.0 in stage 2.0 (TID 360) 2023-02-10 11:11:56 Executor: INFO: Finished task 72.0 in stage 2.0 (TID 360). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 115.0 in stage 2.0 (TID 403) (163.152.180.157, executor driver, partition 115, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 72.0 in stage 2.0 (TID 360) in 3856 ms on 163.152.180.157 (executor driver) (76/144) 2023-02-10 11:11:56 Executor: INFO: Running task 115.0 in stage 2.0 (TID 403) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=75, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 133: Executor task launch worker for task 75.0 in stage 2.0 (TID 363) 2023-02-10 11:11:56 Executor: INFO: Finished task 75.0 in stage 2.0 (TID 363). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 116.0 in stage 2.0 (TID 404) (163.152.180.157, executor driver, partition 116, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Running task 116.0 in stage 2.0 (TID 404) 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 75.0 in stage 2.0 (TID 363) in 3867 ms on 163.152.180.157 (executor driver) (77/144) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 116.0 in stage 2.0 (TID 404) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 140: Executor task launch worker for task 116.0 in stage 2.0 (TID 404) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 140: Executor task launch worker for task 116.0 in stage 2.0 (TID 404) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 115.0 in stage 2.0 (TID 403) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 144: Executor task launch worker for task 115.0 in stage 2.0 (TID 403) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 144: Executor task launch worker for task 115.0 in stage 2.0 (TID 403) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=56, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 114: Executor task launch worker for task 56.0 in stage 2.0 (TID 344) 2023-02-10 11:11:56 Executor: INFO: Finished task 56.0 in stage 2.0 (TID 344). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 117.0 in stage 2.0 (TID 405) (163.152.180.157, executor driver, partition 117, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 56.0 in stage 2.0 (TID 344) in 4158 ms on 163.152.180.157 (executor driver) (78/144) 2023-02-10 11:11:56 Executor: INFO: Running task 117.0 in stage 2.0 (TID 405) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 117.0 in stage 2.0 (TID 405) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 133: Executor task launch worker for task 117.0 in stage 2.0 (TID 405) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 133: Executor task launch worker for task 117.0 in stage 2.0 (TID 405) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=70, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 117: Executor task launch worker for task 70.0 in stage 2.0 (TID 358) 2023-02-10 11:11:56 Executor: INFO: Finished task 70.0 in stage 2.0 (TID 358). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 118.0 in stage 2.0 (TID 406) (163.152.180.157, executor driver, partition 118, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 Executor: INFO: Running task 118.0 in stage 2.0 (TID 406) 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 70.0 in stage 2.0 (TID 358) in 4178 ms on 163.152.180.157 (executor driver) (79/144) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 118.0 in stage 2.0 (TID 406) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 117: Executor task launch worker for task 118.0 in stage 2.0 (TID 406) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 117: Executor task launch worker for task 118.0 in stage 2.0 (TID 406) 2023-02-10 11:11:56 root: INFO: TaskReport: stage=2, partition=51, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:56 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 121: Executor task launch worker for task 51.0 in stage 2.0 (TID 339) 2023-02-10 11:11:56 Executor: INFO: Finished task 51.0 in stage 2.0 (TID 339). 839 bytes result sent to driver 2023-02-10 11:11:56 TaskSetManager: INFO: Starting task 119.0 in stage 2.0 (TID 407) (163.152.180.157, executor driver, partition 119, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:56 TaskSetManager: INFO: Finished task 51.0 in stage 2.0 (TID 339) in 4421 ms on 163.152.180.157 (executor driver) (80/144) 2023-02-10 11:11:56 Executor: INFO: Running task 119.0 in stage 2.0 (TID 407) 2023-02-10 11:11:56 root: INFO: RegionPool: initialized for thread 121: Executor task launch worker for task 119.0 in stage 2.0 (TID 407) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 121: Executor task launch worker for task 119.0 in stage 2.0 (TID 407) 2023-02-10 11:11:56 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 121: Executor task launch worker for task 119.0 in stage 2.0 (TID 407) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=80, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 123: Executor task launch worker for task 80.0 in stage 2.0 (TID 368) 2023-02-10 11:11:59 Executor: INFO: Finished task 80.0 in stage 2.0 (TID 368). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 120.0 in stage 2.0 (TID 408) (163.152.180.157, executor driver, partition 120, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 Executor: INFO: Running task 120.0 in stage 2.0 (TID 408) 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 80.0 in stage 2.0 (TID 368) in 3613 ms on 163.152.180.157 (executor driver) (81/144) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 123: Executor task launch worker for task 120.0 in stage 2.0 (TID 408) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 123: Executor task launch worker for task 120.0 in stage 2.0 (TID 408) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 123: Executor task launch worker for task 120.0 in stage 2.0 (TID 408) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=82, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 115: Executor task launch worker for task 82.0 in stage 2.0 (TID 370) 2023-02-10 11:11:59 Executor: INFO: Finished task 82.0 in stage 2.0 (TID 370). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 121.0 in stage 2.0 (TID 409) (163.152.180.157, executor driver, partition 121, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 Executor: INFO: Running task 121.0 in stage 2.0 (TID 409) 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 82.0 in stage 2.0 (TID 370) in 3421 ms on 163.152.180.157 (executor driver) (82/144) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 121.0 in stage 2.0 (TID 409) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 115: Executor task launch worker for task 121.0 in stage 2.0 (TID 409) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 115: Executor task launch worker for task 121.0 in stage 2.0 (TID 409) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=81, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 130: Executor task launch worker for task 81.0 in stage 2.0 (TID 369) 2023-02-10 11:11:59 Executor: INFO: Finished task 81.0 in stage 2.0 (TID 369). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 122.0 in stage 2.0 (TID 410) (163.152.180.157, executor driver, partition 122, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 81.0 in stage 2.0 (TID 369) in 3594 ms on 163.152.180.157 (executor driver) (83/144) 2023-02-10 11:11:59 Executor: INFO: Running task 122.0 in stage 2.0 (TID 410) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 122.0 in stage 2.0 (TID 410) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 130: Executor task launch worker for task 122.0 in stage 2.0 (TID 410) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 130: Executor task launch worker for task 122.0 in stage 2.0 (TID 410) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=83, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 134: Executor task launch worker for task 83.0 in stage 2.0 (TID 371) 2023-02-10 11:11:59 Executor: INFO: Finished task 83.0 in stage 2.0 (TID 371). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 123.0 in stage 2.0 (TID 411) (163.152.180.157, executor driver, partition 123, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 83.0 in stage 2.0 (TID 371) in 3736 ms on 163.152.180.157 (executor driver) (84/144) 2023-02-10 11:11:59 Executor: INFO: Running task 123.0 in stage 2.0 (TID 411) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=84, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 153: Executor task launch worker for task 84.0 in stage 2.0 (TID 372) 2023-02-10 11:11:59 Executor: INFO: Finished task 84.0 in stage 2.0 (TID 372). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 124.0 in stage 2.0 (TID 412) (163.152.180.157, executor driver, partition 124, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 Executor: INFO: Running task 124.0 in stage 2.0 (TID 412) 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 84.0 in stage 2.0 (TID 372) in 3623 ms on 163.152.180.157 (executor driver) (85/144) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 123.0 in stage 2.0 (TID 411) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 134: Executor task launch worker for task 123.0 in stage 2.0 (TID 411) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 134: Executor task launch worker for task 123.0 in stage 2.0 (TID 411) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 124.0 in stage 2.0 (TID 412) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 114: Executor task launch worker for task 124.0 in stage 2.0 (TID 412) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 114: Executor task launch worker for task 124.0 in stage 2.0 (TID 412) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=91, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 159: Executor task launch worker for task 91.0 in stage 2.0 (TID 379) 2023-02-10 11:11:59 Executor: INFO: Finished task 91.0 in stage 2.0 (TID 379). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 125.0 in stage 2.0 (TID 413) (163.152.180.157, executor driver, partition 125, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 91.0 in stage 2.0 (TID 379) in 3455 ms on 163.152.180.157 (executor driver) (86/144) 2023-02-10 11:11:59 Executor: INFO: Running task 125.0 in stage 2.0 (TID 413) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 125.0 in stage 2.0 (TID 413) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 153: Executor task launch worker for task 125.0 in stage 2.0 (TID 413) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=87, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 142: Executor task launch worker for task 87.0 in stage 2.0 (TID 375) 2023-02-10 11:11:59 Executor: INFO: Finished task 87.0 in stage 2.0 (TID 375). 839 bytes result sent to driver 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 153: Executor task launch worker for task 125.0 in stage 2.0 (TID 413) 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 126.0 in stage 2.0 (TID 414) (163.152.180.157, executor driver, partition 126, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 Executor: INFO: Running task 126.0 in stage 2.0 (TID 414) 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 87.0 in stage 2.0 (TID 375) in 3529 ms on 163.152.180.157 (executor driver) (87/144) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 126.0 in stage 2.0 (TID 414) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 159: Executor task launch worker for task 126.0 in stage 2.0 (TID 414) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 159: Executor task launch worker for task 126.0 in stage 2.0 (TID 414) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=98, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 147: Executor task launch worker for task 98.0 in stage 2.0 (TID 386) 2023-02-10 11:11:59 Executor: INFO: Finished task 98.0 in stage 2.0 (TID 386). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 127.0 in stage 2.0 (TID 415) (163.152.180.157, executor driver, partition 127, PROCESS_LOCAL, 4368 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 98.0 in stage 2.0 (TID 386) in 3413 ms on 163.152.180.157 (executor driver) (88/144) 2023-02-10 11:11:59 Executor: INFO: Running task 127.0 in stage 2.0 (TID 415) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 127.0 in stage 2.0 (TID 415) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 147: Executor task launch worker for task 127.0 in stage 2.0 (TID 415) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 147: Executor task launch worker for task 127.0 in stage 2.0 (TID 415) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=88, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 136: Executor task launch worker for task 88.0 in stage 2.0 (TID 376) 2023-02-10 11:11:59 Executor: INFO: Finished task 88.0 in stage 2.0 (TID 376). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 128.0 in stage 2.0 (TID 416) (163.152.180.157, executor driver, partition 128, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 88.0 in stage 2.0 (TID 376) in 3598 ms on 163.152.180.157 (executor driver) (89/144) 2023-02-10 11:11:59 Executor: INFO: Running task 128.0 in stage 2.0 (TID 416) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=95, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 141: Executor task launch worker for task 95.0 in stage 2.0 (TID 383) 2023-02-10 11:11:59 Executor: INFO: Finished task 95.0 in stage 2.0 (TID 383). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 129.0 in stage 2.0 (TID 417) (163.152.180.157, executor driver, partition 129, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 Executor: INFO: Running task 129.0 in stage 2.0 (TID 417) 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 95.0 in stage 2.0 (TID 383) in 3454 ms on 163.152.180.157 (executor driver) (90/144) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=85, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 122: Executor task launch worker for task 85.0 in stage 2.0 (TID 373) 2023-02-10 11:11:59 Executor: INFO: Finished task 85.0 in stage 2.0 (TID 373). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 130.0 in stage 2.0 (TID 418) (163.152.180.157, executor driver, partition 130, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 Executor: INFO: Running task 130.0 in stage 2.0 (TID 418) 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 85.0 in stage 2.0 (TID 373) in 3740 ms on 163.152.180.157 (executor driver) (91/144) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 128.0 in stage 2.0 (TID 416) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 142: Executor task launch worker for task 128.0 in stage 2.0 (TID 416) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 142: Executor task launch worker for task 128.0 in stage 2.0 (TID 416) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 129.0 in stage 2.0 (TID 417) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 136: Executor task launch worker for task 129.0 in stage 2.0 (TID 417) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 130.0 in stage 2.0 (TID 418) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 141: Executor task launch worker for task 130.0 in stage 2.0 (TID 418) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 136: Executor task launch worker for task 129.0 in stage 2.0 (TID 417) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 141: Executor task launch worker for task 130.0 in stage 2.0 (TID 418) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=94, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 151: Executor task launch worker for task 94.0 in stage 2.0 (TID 382) 2023-02-10 11:11:59 Executor: INFO: Finished task 94.0 in stage 2.0 (TID 382). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 131.0 in stage 2.0 (TID 419) (163.152.180.157, executor driver, partition 131, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 Executor: INFO: Running task 131.0 in stage 2.0 (TID 419) 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 94.0 in stage 2.0 (TID 382) in 3487 ms on 163.152.180.157 (executor driver) (92/144) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 131.0 in stage 2.0 (TID 419) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 122: Executor task launch worker for task 131.0 in stage 2.0 (TID 419) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 122: Executor task launch worker for task 131.0 in stage 2.0 (TID 419) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=99, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 146: Executor task launch worker for task 99.0 in stage 2.0 (TID 387) 2023-02-10 11:11:59 Executor: INFO: Finished task 99.0 in stage 2.0 (TID 387). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 132.0 in stage 2.0 (TID 420) (163.152.180.157, executor driver, partition 132, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 99.0 in stage 2.0 (TID 387) in 3502 ms on 163.152.180.157 (executor driver) (93/144) 2023-02-10 11:11:59 Executor: INFO: Running task 132.0 in stage 2.0 (TID 420) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=92, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 127: Executor task launch worker for task 92.0 in stage 2.0 (TID 380) 2023-02-10 11:11:59 Executor: INFO: Finished task 92.0 in stage 2.0 (TID 380). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 133.0 in stage 2.0 (TID 421) (163.152.180.157, executor driver, partition 133, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 92.0 in stage 2.0 (TID 380) in 3595 ms on 163.152.180.157 (executor driver) (94/144) 2023-02-10 11:11:59 Executor: INFO: Running task 133.0 in stage 2.0 (TID 421) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=104, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 126: Executor task launch worker for task 104.0 in stage 2.0 (TID 392) 2023-02-10 11:11:59 Executor: INFO: Finished task 104.0 in stage 2.0 (TID 392). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 134.0 in stage 2.0 (TID 422) (163.152.180.157, executor driver, partition 134, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 104.0 in stage 2.0 (TID 392) in 3472 ms on 163.152.180.157 (executor driver) (95/144) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 132.0 in stage 2.0 (TID 420) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 146: Executor task launch worker for task 132.0 in stage 2.0 (TID 420) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 146: Executor task launch worker for task 132.0 in stage 2.0 (TID 420) 2023-02-10 11:11:59 Executor: INFO: Running task 134.0 in stage 2.0 (TID 422) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 133.0 in stage 2.0 (TID 421) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 127: Executor task launch worker for task 133.0 in stage 2.0 (TID 421) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 127: Executor task launch worker for task 133.0 in stage 2.0 (TID 421) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=105, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 158: Executor task launch worker for task 105.0 in stage 2.0 (TID 393) 2023-02-10 11:11:59 Executor: INFO: Finished task 105.0 in stage 2.0 (TID 393). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 135.0 in stage 2.0 (TID 423) (163.152.180.157, executor driver, partition 135, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 Executor: INFO: Running task 135.0 in stage 2.0 (TID 423) 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 105.0 in stage 2.0 (TID 393) in 3510 ms on 163.152.180.157 (executor driver) (96/144) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=107, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 145: Executor task launch worker for task 107.0 in stage 2.0 (TID 395) 2023-02-10 11:11:59 Executor: INFO: Finished task 107.0 in stage 2.0 (TID 395). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 136.0 in stage 2.0 (TID 424) (163.152.180.157, executor driver, partition 136, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 Executor: INFO: Running task 136.0 in stage 2.0 (TID 424) 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 107.0 in stage 2.0 (TID 395) in 3506 ms on 163.152.180.157 (executor driver) (97/144) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=96, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 131: Executor task launch worker for task 96.0 in stage 2.0 (TID 384) 2023-02-10 11:11:59 Executor: INFO: Finished task 96.0 in stage 2.0 (TID 384). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 137.0 in stage 2.0 (TID 425) (163.152.180.157, executor driver, partition 137, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 96.0 in stage 2.0 (TID 384) in 3651 ms on 163.152.180.157 (executor driver) (98/144) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 134.0 in stage 2.0 (TID 422) 2023-02-10 11:11:59 Executor: INFO: Running task 137.0 in stage 2.0 (TID 425) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=93, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 124: Executor task launch worker for task 93.0 in stage 2.0 (TID 381) 2023-02-10 11:11:59 Executor: INFO: Finished task 93.0 in stage 2.0 (TID 381). 839 bytes result sent to driver 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 126: Executor task launch worker for task 134.0 in stage 2.0 (TID 422) 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 138.0 in stage 2.0 (TID 426) (163.152.180.157, executor driver, partition 138, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 93.0 in stage 2.0 (TID 381) in 3681 ms on 163.152.180.157 (executor driver) (99/144) 2023-02-10 11:11:59 Executor: INFO: Running task 138.0 in stage 2.0 (TID 426) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 126: Executor task launch worker for task 134.0 in stage 2.0 (TID 422) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=110, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 137: Executor task launch worker for task 110.0 in stage 2.0 (TID 398) 2023-02-10 11:11:59 Executor: INFO: Finished task 110.0 in stage 2.0 (TID 398). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 139.0 in stage 2.0 (TID 427) (163.152.180.157, executor driver, partition 139, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 Executor: INFO: Running task 139.0 in stage 2.0 (TID 427) 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 110.0 in stage 2.0 (TID 398) in 3468 ms on 163.152.180.157 (executor driver) (100/144) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 135.0 in stage 2.0 (TID 423) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 151: Executor task launch worker for task 135.0 in stage 2.0 (TID 423) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 137.0 in stage 2.0 (TID 425) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 151: Executor task launch worker for task 135.0 in stage 2.0 (TID 423) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 131: Executor task launch worker for task 137.0 in stage 2.0 (TID 425) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=101, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 128: Executor task launch worker for task 101.0 in stage 2.0 (TID 389) 2023-02-10 11:11:59 Executor: INFO: Finished task 101.0 in stage 2.0 (TID 389). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 140.0 in stage 2.0 (TID 428) (163.152.180.157, executor driver, partition 140, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 101.0 in stage 2.0 (TID 389) in 3613 ms on 163.152.180.157 (executor driver) (101/144) 2023-02-10 11:11:59 Executor: INFO: Running task 140.0 in stage 2.0 (TID 428) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 139.0 in stage 2.0 (TID 427) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 145: Executor task launch worker for task 139.0 in stage 2.0 (TID 427) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 131: Executor task launch worker for task 137.0 in stage 2.0 (TID 425) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 145: Executor task launch worker for task 139.0 in stage 2.0 (TID 427) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 138.0 in stage 2.0 (TID 426) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 124: Executor task launch worker for task 138.0 in stage 2.0 (TID 426) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 124: Executor task launch worker for task 138.0 in stage 2.0 (TID 426) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 140.0 in stage 2.0 (TID 428) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 137: Executor task launch worker for task 140.0 in stage 2.0 (TID 428) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 158: Executor task launch worker for task 136.0 in stage 2.0 (TID 424) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 137: Executor task launch worker for task 140.0 in stage 2.0 (TID 428) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 158: Executor task launch worker for task 136.0 in stage 2.0 (TID 424) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 158: Executor task launch worker for task 136.0 in stage 2.0 (TID 424) 2023-02-10 11:11:59 root: INFO: TaskReport: stage=2, partition=108, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:11:59 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 143: Executor task launch worker for task 108.0 in stage 2.0 (TID 396) 2023-02-10 11:11:59 Executor: INFO: Finished task 108.0 in stage 2.0 (TID 396). 839 bytes result sent to driver 2023-02-10 11:11:59 TaskSetManager: INFO: Starting task 141.0 in stage 2.0 (TID 429) (163.152.180.157, executor driver, partition 141, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:11:59 Executor: INFO: Running task 141.0 in stage 2.0 (TID 429) 2023-02-10 11:11:59 TaskSetManager: INFO: Finished task 108.0 in stage 2.0 (TID 396) in 3567 ms on 163.152.180.157 (executor driver) (102/144) 2023-02-10 11:11:59 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 141.0 in stage 2.0 (TID 429) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 128: Executor task launch worker for task 141.0 in stage 2.0 (TID 429) 2023-02-10 11:11:59 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 128: Executor task launch worker for task 141.0 in stage 2.0 (TID 429) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=106, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 116: Executor task launch worker for task 106.0 in stage 2.0 (TID 394) 2023-02-10 11:12:00 Executor: INFO: Finished task 106.0 in stage 2.0 (TID 394). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Starting task 142.0 in stage 2.0 (TID 430) (163.152.180.157, executor driver, partition 142, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 106.0 in stage 2.0 (TID 394) in 3676 ms on 163.152.180.157 (executor driver) (103/144) 2023-02-10 11:12:00 Executor: INFO: Running task 142.0 in stage 2.0 (TID 430) 2023-02-10 11:12:00 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 142.0 in stage 2.0 (TID 430) 2023-02-10 11:12:00 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 116: Executor task launch worker for task 142.0 in stage 2.0 (TID 430) 2023-02-10 11:12:00 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 116: Executor task launch worker for task 142.0 in stage 2.0 (TID 430) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=100, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 129: Executor task launch worker for task 100.0 in stage 2.0 (TID 388) 2023-02-10 11:12:00 Executor: INFO: Finished task 100.0 in stage 2.0 (TID 388). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Starting task 143.0 in stage 2.0 (TID 431) (163.152.180.157, executor driver, partition 143, PROCESS_LOCAL, 4369 bytes) taskResourceAssignments Map() 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 100.0 in stage 2.0 (TID 388) in 3796 ms on 163.152.180.157 (executor driver) (104/144) 2023-02-10 11:12:00 Executor: INFO: Running task 143.0 in stage 2.0 (TID 431) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=112, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 138: Executor task launch worker for task 112.0 in stage 2.0 (TID 400) 2023-02-10 11:12:00 Executor: INFO: Finished task 112.0 in stage 2.0 (TID 400). 839 bytes result sent to driver 2023-02-10 11:12:00 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 143.0 in stage 2.0 (TID 431) 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 112.0 in stage 2.0 (TID 400) in 3623 ms on 163.152.180.157 (executor driver) (105/144) 2023-02-10 11:12:00 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 3, 0 current java objects, thread 143: Executor task launch worker for task 143.0 in stage 2.0 (TID 431) 2023-02-10 11:12:00 root: INFO: RegionPool: REPORT_THRESHOLD: 512.0K allocated (448.0K blocks / 64.0K chunks), regions.size = 7, 0 current java objects, thread 143: Executor task launch worker for task 143.0 in stage 2.0 (TID 431) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=86, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 148: Executor task launch worker for task 86.0 in stage 2.0 (TID 374) 2023-02-10 11:12:00 Executor: INFO: Finished task 86.0 in stage 2.0 (TID 374). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 86.0 in stage 2.0 (TID 374) in 4099 ms on 163.152.180.157 (executor driver) (106/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=102, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 118: Executor task launch worker for task 102.0 in stage 2.0 (TID 390) 2023-02-10 11:12:00 Executor: INFO: Finished task 102.0 in stage 2.0 (TID 390). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 102.0 in stage 2.0 (TID 390) in 3863 ms on 163.152.180.157 (executor driver) (107/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=90, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 149: Executor task launch worker for task 90.0 in stage 2.0 (TID 378) 2023-02-10 11:12:00 Executor: INFO: Finished task 90.0 in stage 2.0 (TID 378). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 90.0 in stage 2.0 (TID 378) in 4084 ms on 163.152.180.157 (executor driver) (108/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=97, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 120: Executor task launch worker for task 97.0 in stage 2.0 (TID 385) 2023-02-10 11:12:00 Executor: INFO: Finished task 97.0 in stage 2.0 (TID 385). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 97.0 in stage 2.0 (TID 385) in 3957 ms on 163.152.180.157 (executor driver) (109/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=116, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 140: Executor task launch worker for task 116.0 in stage 2.0 (TID 404) 2023-02-10 11:12:00 Executor: INFO: Finished task 116.0 in stage 2.0 (TID 404). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 116.0 in stage 2.0 (TID 404) in 3666 ms on 163.152.180.157 (executor driver) (110/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=113, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 152: Executor task launch worker for task 113.0 in stage 2.0 (TID 401) 2023-02-10 11:12:00 Executor: INFO: Finished task 113.0 in stage 2.0 (TID 401). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 113.0 in stage 2.0 (TID 401) in 3736 ms on 163.152.180.157 (executor driver) (111/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=103, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 119: Executor task launch worker for task 103.0 in stage 2.0 (TID 391) 2023-02-10 11:12:00 Executor: INFO: Finished task 103.0 in stage 2.0 (TID 391). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 103.0 in stage 2.0 (TID 391) in 3955 ms on 163.152.180.157 (executor driver) (112/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=89, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 132: Executor task launch worker for task 89.0 in stage 2.0 (TID 377) 2023-02-10 11:12:00 Executor: INFO: Finished task 89.0 in stage 2.0 (TID 377). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 89.0 in stage 2.0 (TID 377) in 4174 ms on 163.152.180.157 (executor driver) (113/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=111, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 150: Executor task launch worker for task 111.0 in stage 2.0 (TID 399) 2023-02-10 11:12:00 Executor: INFO: Finished task 111.0 in stage 2.0 (TID 399). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 111.0 in stage 2.0 (TID 399) in 3809 ms on 163.152.180.157 (executor driver) (114/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=109, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 125: Executor task launch worker for task 109.0 in stage 2.0 (TID 397) 2023-02-10 11:12:00 Executor: INFO: Finished task 109.0 in stage 2.0 (TID 397). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 109.0 in stage 2.0 (TID 397) in 3941 ms on 163.152.180.157 (executor driver) (115/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=115, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 144: Executor task launch worker for task 115.0 in stage 2.0 (TID 403) 2023-02-10 11:12:00 Executor: INFO: Finished task 115.0 in stage 2.0 (TID 403). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 115.0 in stage 2.0 (TID 403) in 3854 ms on 163.152.180.157 (executor driver) (116/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=114, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 139: Executor task launch worker for task 114.0 in stage 2.0 (TID 402) 2023-02-10 11:12:00 Executor: INFO: Finished task 114.0 in stage 2.0 (TID 402). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 114.0 in stage 2.0 (TID 402) in 3950 ms on 163.152.180.157 (executor driver) (117/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=118, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 117: Executor task launch worker for task 118.0 in stage 2.0 (TID 406) 2023-02-10 11:12:00 Executor: INFO: Finished task 118.0 in stage 2.0 (TID 406). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 118.0 in stage 2.0 (TID 406) in 3705 ms on 163.152.180.157 (executor driver) (118/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=119, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 121: Executor task launch worker for task 119.0 in stage 2.0 (TID 407) 2023-02-10 11:12:00 Executor: INFO: Finished task 119.0 in stage 2.0 (TID 407). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 119.0 in stage 2.0 (TID 407) in 3772 ms on 163.152.180.157 (executor driver) (119/144) 2023-02-10 11:12:00 root: INFO: TaskReport: stage=2, partition=117, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:00 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 133: Executor task launch worker for task 117.0 in stage 2.0 (TID 405) 2023-02-10 11:12:00 Executor: INFO: Finished task 117.0 in stage 2.0 (TID 405). 839 bytes result sent to driver 2023-02-10 11:12:00 TaskSetManager: INFO: Finished task 117.0 in stage 2.0 (TID 405) in 3981 ms on 163.152.180.157 (executor driver) (120/144) 2023-02-10 11:12:01 root: INFO: TaskReport: stage=2, partition=120, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:01 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 123: Executor task launch worker for task 120.0 in stage 2.0 (TID 408) 2023-02-10 11:12:01 Executor: INFO: Finished task 120.0 in stage 2.0 (TID 408). 839 bytes result sent to driver 2023-02-10 11:12:01 TaskSetManager: INFO: Finished task 120.0 in stage 2.0 (TID 408) in 2610 ms on 163.152.180.157 (executor driver) (121/144) 2023-02-10 11:12:01 root: INFO: TaskReport: stage=2, partition=122, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:01 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 130: Executor task launch worker for task 122.0 in stage 2.0 (TID 410) 2023-02-10 11:12:01 Executor: INFO: Finished task 122.0 in stage 2.0 (TID 410). 839 bytes result sent to driver 2023-02-10 11:12:01 TaskSetManager: INFO: Finished task 122.0 in stage 2.0 (TID 410) in 2532 ms on 163.152.180.157 (executor driver) (122/144) 2023-02-10 11:12:02 root: INFO: TaskReport: stage=2, partition=129, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:02 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 136: Executor task launch worker for task 129.0 in stage 2.0 (TID 417) 2023-02-10 11:12:02 Executor: INFO: Finished task 129.0 in stage 2.0 (TID 417). 839 bytes result sent to driver 2023-02-10 11:12:02 TaskSetManager: INFO: Finished task 129.0 in stage 2.0 (TID 417) in 2369 ms on 163.152.180.157 (executor driver) (123/144) 2023-02-10 11:12:02 root: INFO: TaskReport: stage=2, partition=131, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:02 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 122: Executor task launch worker for task 131.0 in stage 2.0 (TID 419) 2023-02-10 11:12:02 Executor: INFO: Finished task 131.0 in stage 2.0 (TID 419). 839 bytes result sent to driver 2023-02-10 11:12:02 TaskSetManager: INFO: Finished task 131.0 in stage 2.0 (TID 419) in 2494 ms on 163.152.180.157 (executor driver) (124/144) 2023-02-10 11:12:02 root: INFO: TaskReport: stage=2, partition=134, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:02 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 126: Executor task launch worker for task 134.0 in stage 2.0 (TID 422) 2023-02-10 11:12:02 Executor: INFO: Finished task 134.0 in stage 2.0 (TID 422). 839 bytes result sent to driver 2023-02-10 11:12:02 TaskSetManager: INFO: Finished task 134.0 in stage 2.0 (TID 422) in 2427 ms on 163.152.180.157 (executor driver) (125/144) 2023-02-10 11:12:02 root: INFO: TaskReport: stage=2, partition=133, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:02 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 127: Executor task launch worker for task 133.0 in stage 2.0 (TID 421) 2023-02-10 11:12:02 Executor: INFO: Finished task 133.0 in stage 2.0 (TID 421). 839 bytes result sent to driver 2023-02-10 11:12:02 TaskSetManager: INFO: Finished task 133.0 in stage 2.0 (TID 421) in 2453 ms on 163.152.180.157 (executor driver) (126/144) 2023-02-10 11:12:02 root: INFO: TaskReport: stage=2, partition=126, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:02 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 159: Executor task launch worker for task 126.0 in stage 2.0 (TID 414) 2023-02-10 11:12:02 Executor: INFO: Finished task 126.0 in stage 2.0 (TID 414). 839 bytes result sent to driver 2023-02-10 11:12:02 TaskSetManager: INFO: Finished task 126.0 in stage 2.0 (TID 414) in 2693 ms on 163.152.180.157 (executor driver) (127/144) 2023-02-10 11:12:02 root: INFO: TaskReport: stage=2, partition=143, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:02 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 143: Executor task launch worker for task 143.0 in stage 2.0 (TID 431) 2023-02-10 11:12:02 Executor: INFO: Finished task 143.0 in stage 2.0 (TID 431). 839 bytes result sent to driver 2023-02-10 11:12:02 TaskSetManager: INFO: Finished task 143.0 in stage 2.0 (TID 431) in 2338 ms on 163.152.180.157 (executor driver) (128/144) 2023-02-10 11:12:02 root: INFO: TaskReport: stage=2, partition=137, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:02 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 131: Executor task launch worker for task 137.0 in stage 2.0 (TID 425) 2023-02-10 11:12:02 Executor: INFO: Finished task 137.0 in stage 2.0 (TID 425). 839 bytes result sent to driver 2023-02-10 11:12:02 TaskSetManager: INFO: Finished task 137.0 in stage 2.0 (TID 425) in 2597 ms on 163.152.180.157 (executor driver) (129/144) 2023-02-10 11:12:02 root: INFO: TaskReport: stage=2, partition=130, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:02 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 141: Executor task launch worker for task 130.0 in stage 2.0 (TID 418) 2023-02-10 11:12:02 Executor: INFO: Finished task 130.0 in stage 2.0 (TID 418). 839 bytes result sent to driver 2023-02-10 11:12:02 TaskSetManager: INFO: Finished task 130.0 in stage 2.0 (TID 418) in 2890 ms on 163.152.180.157 (executor driver) (130/144) 2023-02-10 11:12:02 root: INFO: TaskReport: stage=2, partition=138, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:02 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 124: Executor task launch worker for task 138.0 in stage 2.0 (TID 426) 2023-02-10 11:12:02 Executor: INFO: Finished task 138.0 in stage 2.0 (TID 426). 839 bytes result sent to driver 2023-02-10 11:12:02 TaskSetManager: INFO: Finished task 138.0 in stage 2.0 (TID 426) in 2719 ms on 163.152.180.157 (executor driver) (131/144) 2023-02-10 11:12:02 root: INFO: TaskReport: stage=2, partition=139, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:02 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 145: Executor task launch worker for task 139.0 in stage 2.0 (TID 427) 2023-02-10 11:12:02 Executor: INFO: Finished task 139.0 in stage 2.0 (TID 427). 839 bytes result sent to driver 2023-02-10 11:12:02 TaskSetManager: INFO: Finished task 139.0 in stage 2.0 (TID 427) in 2714 ms on 163.152.180.157 (executor driver) (132/144) 2023-02-10 11:12:02 root: INFO: TaskReport: stage=2, partition=140, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:02 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 137: Executor task launch worker for task 140.0 in stage 2.0 (TID 428) 2023-02-10 11:12:02 Executor: INFO: Finished task 140.0 in stage 2.0 (TID 428). 839 bytes result sent to driver 2023-02-10 11:12:02 TaskSetManager: INFO: Finished task 140.0 in stage 2.0 (TID 428) in 2996 ms on 163.152.180.157 (executor driver) (133/144) 2023-02-10 11:12:03 root: INFO: TaskReport: stage=2, partition=142, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:03 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 116: Executor task launch worker for task 142.0 in stage 2.0 (TID 430) 2023-02-10 11:12:03 Executor: INFO: Finished task 142.0 in stage 2.0 (TID 430). 839 bytes result sent to driver 2023-02-10 11:12:03 TaskSetManager: INFO: Finished task 142.0 in stage 2.0 (TID 430) in 2976 ms on 163.152.180.157 (executor driver) (134/144) 2023-02-10 11:12:03 root: INFO: TaskReport: stage=2, partition=121, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:03 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 115: Executor task launch worker for task 121.0 in stage 2.0 (TID 409) 2023-02-10 11:12:03 Executor: INFO: Finished task 121.0 in stage 2.0 (TID 409). 839 bytes result sent to driver 2023-02-10 11:12:03 TaskSetManager: INFO: Finished task 121.0 in stage 2.0 (TID 409) in 4088 ms on 163.152.180.157 (executor driver) (135/144) 2023-02-10 11:12:03 root: INFO: TaskReport: stage=2, partition=132, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:03 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 146: Executor task launch worker for task 132.0 in stage 2.0 (TID 420) 2023-02-10 11:12:03 Executor: INFO: Finished task 132.0 in stage 2.0 (TID 420). 839 bytes result sent to driver 2023-02-10 11:12:03 TaskSetManager: INFO: Finished task 132.0 in stage 2.0 (TID 420) in 3650 ms on 163.152.180.157 (executor driver) (136/144) 2023-02-10 11:12:03 root: INFO: TaskReport: stage=2, partition=123, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:03 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 134: Executor task launch worker for task 123.0 in stage 2.0 (TID 411) 2023-02-10 11:12:03 Executor: INFO: Finished task 123.0 in stage 2.0 (TID 411). 839 bytes result sent to driver 2023-02-10 11:12:03 TaskSetManager: INFO: Finished task 123.0 in stage 2.0 (TID 411) in 3980 ms on 163.152.180.157 (executor driver) (137/144) 2023-02-10 11:12:03 root: INFO: TaskReport: stage=2, partition=127, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:03 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 147: Executor task launch worker for task 127.0 in stage 2.0 (TID 415) 2023-02-10 11:12:03 Executor: INFO: Finished task 127.0 in stage 2.0 (TID 415). 839 bytes result sent to driver 2023-02-10 11:12:03 TaskSetManager: INFO: Finished task 127.0 in stage 2.0 (TID 415) in 3978 ms on 163.152.180.157 (executor driver) (138/144) 2023-02-10 11:12:03 root: INFO: TaskReport: stage=2, partition=141, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:03 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 128: Executor task launch worker for task 141.0 in stage 2.0 (TID 429) 2023-02-10 11:12:03 Executor: INFO: Finished task 141.0 in stage 2.0 (TID 429). 839 bytes result sent to driver 2023-02-10 11:12:03 TaskSetManager: INFO: Finished task 141.0 in stage 2.0 (TID 429) in 3785 ms on 163.152.180.157 (executor driver) (139/144) 2023-02-10 11:12:03 root: INFO: TaskReport: stage=2, partition=124, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:03 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 114: Executor task launch worker for task 124.0 in stage 2.0 (TID 412) 2023-02-10 11:12:03 Executor: INFO: Finished task 124.0 in stage 2.0 (TID 412). 839 bytes result sent to driver 2023-02-10 11:12:03 TaskSetManager: INFO: Finished task 124.0 in stage 2.0 (TID 412) in 4214 ms on 163.152.180.157 (executor driver) (140/144) 2023-02-10 11:12:03 root: INFO: TaskReport: stage=2, partition=128, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:03 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 142: Executor task launch worker for task 128.0 in stage 2.0 (TID 416) 2023-02-10 11:12:03 Executor: INFO: Finished task 128.0 in stage 2.0 (TID 416). 839 bytes result sent to driver 2023-02-10 11:12:03 TaskSetManager: INFO: Finished task 128.0 in stage 2.0 (TID 416) in 4151 ms on 163.152.180.157 (executor driver) (141/144) 2023-02-10 11:12:03 root: INFO: TaskReport: stage=2, partition=135, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:03 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 151: Executor task launch worker for task 135.0 in stage 2.0 (TID 423) 2023-02-10 11:12:03 Executor: INFO: Finished task 135.0 in stage 2.0 (TID 423). 839 bytes result sent to driver 2023-02-10 11:12:03 TaskSetManager: INFO: Finished task 135.0 in stage 2.0 (TID 423) in 4020 ms on 163.152.180.157 (executor driver) (142/144) 2023-02-10 11:12:03 root: INFO: TaskReport: stage=2, partition=136, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:03 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 158: Executor task launch worker for task 136.0 in stage 2.0 (TID 424) 2023-02-10 11:12:03 Executor: INFO: Finished task 136.0 in stage 2.0 (TID 424). 839 bytes result sent to driver 2023-02-10 11:12:03 TaskSetManager: INFO: Finished task 136.0 in stage 2.0 (TID 424) in 4003 ms on 163.152.180.157 (executor driver) (143/144) 2023-02-10 11:12:03 root: INFO: TaskReport: stage=2, partition=125, attempt=0, peakBytes=524288, peakBytesReadable=512.00 KiB, chunks requested=0, cache hits=0 2023-02-10 11:12:03 root: INFO: RegionPool: FREE: 512.0K allocated (512.0K blocks / 0 chunks), regions.size = 8, 0 current java objects, thread 153: Executor task launch worker for task 125.0 in stage 2.0 (TID 413) 2023-02-10 11:12:03 Executor: INFO: Finished task 125.0 in stage 2.0 (TID 413). 839 bytes result sent to driver 2023-02-10 11:12:03 TaskSetManager: INFO: Finished task 125.0 in stage 2.0 (TID 413) in 4323 ms on 163.152.180.157 (executor driver) (144/144) 2023-02-10 11:12:03 TaskSchedulerImpl: INFO: Removed TaskSet 2.0, whose tasks have all completed, from pool 2023-02-10 11:12:03 DAGScheduler: INFO: ResultStage 2 (runJob at ContextRDD.scala:238) finished in 16.355 s 2023-02-10 11:12:03 DAGScheduler: INFO: Job 2 is finished. Cancelling potential speculative or zombie tasks for this job 2023-02-10 11:12:03 TaskSchedulerImpl: INFO: Killing all running tasks in stage 2: Stage finished 2023-02-10 11:12:03 DAGScheduler: INFO: Job 2 finished: runJob at ContextRDD.scala:238, took 16.362377 s 2023-02-10 11:12:03 root: INFO: encoder cache miss (1 hits, 6 misses, 0.143) 2023-02-10 11:12:03 root: INFO: instruction count: 3: __C1688HailClassLoaderContainer. 2023-02-10 11:12:03 root: INFO: instruction count: 3: __C1688HailClassLoaderContainer. 2023-02-10 11:12:03 root: INFO: instruction count: 3: __C1689FSContainer. 2023-02-10 11:12:03 root: INFO: instruction count: 3: __C1689FSContainer. 2023-02-10 11:12:03 root: INFO: instruction count: 3: __C1690etypeEncode. 2023-02-10 11:12:03 root: INFO: instruction count: 7: __C1690etypeEncode.apply 2023-02-10 11:12:03 root: INFO: instruction count: 25: __C1690etypeEncode.__m1691ENCODE_SBaseStructPointer_TO_r_struct_of_r_array_of_r_struct_of_r_binaryENDEND 2023-02-10 11:12:03 root: INFO: instruction count: 35: __C1690etypeEncode.__m1692ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_binaryEND 2023-02-10 11:12:03 root: INFO: instruction count: 13: __C1690etypeEncode.__m1693ENCODE_SBaseStructPointer_TO_r_struct_of_r_binaryEND 2023-02-10 11:12:03 root: INFO: instruction count: 16: __C1690etypeEncode.__m1694ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:12:04 root: INFO: compiling and evaluating result: TableWrite 2023-02-10 11:12:04 root: INFO: optimize optimize: relationalLowerer, initial IR: before: IR size 414: (Let __iruid_775 (Literal Struct{__cols:Array[Struct{s:String}]} ) (Let __iruid_1177 (EncodedLiteral Struct{__cols:Array[Struct{s:String}]}) (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"maybeRefs\":{\"references\":[{\"name\":\"GRCh38\",\"contigs\":[\"chr1\",\"chr2\",\"chr3\",\"chr4\",\"chr5\",\"chr6\",\"chr7\",\"chr8\",\"chr9\",\"chr10\",\"chr11\",\"chr12\",\"chr13\",\"chr14\",\"chr15\",\"chr16\",\"chr17\",\"chr18\",\"chr19\",\"chr20\",\"chr21\",\"chr22\",\"chrX\",\"chrY\",\"chrM\",\"chr1_KI270706v1_random\",\"chr1_KI270707v1_random\",\"chr1_KI270708v1_random\",\"chr1_KI270709v1_random\",\"chr1_KI270710v1_random\",\"chr1_KI270711v1_random\",\"chr1_KI270712v1_random\",\"chr1_KI270713v1_random\",\"chr1_KI270714v1_random\",\"chr2_KI270715v1_random\",\"chr2_KI270716v1_random\",\"chr3_GL000221v1_random\",\"chr4_GL000008v2_random\",\"chr5_GL000208v1_random\",\"chr9_KI270717v1_random\",\"chr9_KI270718v1_random\",\"chr9_KI270719v1_random\",\"chr9_KI270720v1_random\",\"chr11_KI270721v1_random\",\"chr14_GL000009v2_random\",\"chr14_GL000225v1_random\",\"chr14_KI270722v1_r..." (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"overwrite\":false}" (Let __iruid_1197 (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows/parts/\"}" (ToStream False (GetField __cols (Ref __iruid_775))) (Str "part-0")) (Let __iruid_1198 (CollectDistributedArray __iruid_1193 __iruid_1195 (StreamZip -1 AssertSameLength (__iruid_1191 __iruid_1192) (StreamZip -1 AssumeSameLength (__iruid_1187 __iruid_1188) (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Let __iruid_1179 (ToArray (StreamRange -1 False (I32 0) (I32 0) (I32 1))) (StreamMap __iruid_1180 (ToStream False (Literal Array[Struct{partitionBound:Interval[Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32]],parentPartitions:Array[Int32]}] )) (MakeStruct (partitionBound (GetField partitionBound (Ref __iruid_1180))) (oldContexts (ToArray (StreamMap __iruid_1181 (ToStream False (GetField parentPartitions (Ref __iruid_1180))) (ArrayRef -1 (Ref __iruid_1179) (Ref __iruid_1181)))))))) (MakeTuple (0 1) (Ref __iruid_1187) (Ref __iruid_1188))) (ToStream False (Literal Array[String] )) (MakeStruct (oldCtx (Ref __iruid_1191)) (writeCtx (Ref __iruid_1192)))) (MakeStruct (__iruid_775 (Ref __iruid_775)) (__iruid_1177 (Ref __iruid_1177))) (Let __iruid_1177 (GetField __iruid_1177 (Ref __iruid_1195)) (Let __iruid_775 (GetField __iruid_775 (Ref __iruid_1195)) (WritePartition "{\"spec1\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix1\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows/parts/\",\"spec2\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix2\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows/parts/\",\"keyFieldNames\":[\"locus\",\"alleles\"],\"index\":{\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/index/\":\"+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}\"}}" (Let __iruid_1194 (GetField oldCtx (Ref __iruid_1193)) (Let __iruid_1189 (Ref __iruid_1194) (Let global (Ref __iruid_775) (StreamMap __iruid_1190 (StreamMultiMerge (locus alleles) (Let __iruid_776 (GetTupleElement 0 (Ref __iruid_1189)) (Let global (Ref __iruid_775) (StreamMap __iruid_784 (StreamFlatMap __iruid_781 (Let global (Ref __iruid_775) (StreamMap __iruid_780 (StreamFlatMap __iruid_777 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_776))) (ToStream False (ArraySort __iruid_778 __iruid_779 (Ref __iruid_777) (ApplyComparisonOp LT (Ref __iruid_778) (Ref __iruid_779))))) (Let row (Ref __iruid_780) (InsertFields (Let __iruid_509 (GetField alleles (Ref row)) (Let __iruid_510 (GetField locus (Ref row)) (InsertFields (SelectFields (locus alleles rsid qual filters info) (Ref row)) None (__uid_3 (ArraySort __iruid_511 __iruid_512 (StreamFlatMap __iruid_513 (StreamFilter __iruid_514 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_509)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_509) (Ref __iruid_514)) (Str "*"))) (ToStream False (Let __iruid_515 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_510) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_509) (I32 0)) (ApplyIR 7 indexArray () String (Ref __iruid_509) (Ref __iruid_513)))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_515)) (Ref __iruid_510)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_515))) (locus (GetField locus (Ref __iruid_515))) (a_index (Ref __iruid_513)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref row))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_511)) (False) (If (IsNA (Ref __iruid_512)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_511) (Ref __iruid_512)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row))))))) (Let __iruid_782 (GetField __uid_3 (Ref __iruid_781)) (StreamMap __iruid_783 (ToStream False (Ref __iruid_782)) (InsertFields (Ref __iruid_781) None (__uid_3 (Ref __iruid_783)))))) (Let row (Ref __iruid_784) (InsertFields (Let __iruid_517 (GetField __uid_3 (Ref row)) (InsertFields (SelectFields (locus alleles rsid qual filters info) (Ref row)) None (locus (GetField locus (Ref __iruid_517))) (alleles (GetField alleles (Ref __iruid_517))) (a_index (GetField a_index (Ref __iruid_517))) (was_split (GetField was_split (Ref __iruid_517))) (old_alleles (GetField alleles (Ref row))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row)))))))) (Let __iruid_1183 (GetTupleElement 1 (Ref __iruid_1189)) (Let __iruid_1184 (GetField partitionBound (Ref __iruid_1183)) (StreamTakeWhile __iruid_1186 (StreamDropWhile __iruid_1185 (StreamFlatMap __iruid_1182 (ToStream True (GetField oldContexts (Ref __iruid_1183))) (Let __iruid_1178 (Ref __iruid_1182) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean,old_alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "\"\"" (Ref __iruid_1178)))) (Apply -1 pointLessThanPartitionIntervalLeftEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1185)) (ApplySpecial -1 start () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1184)) (Apply -1 includesStart () Boolean (Ref __iruid_1184)))) (Apply -1 pointLessThanPartitionIntervalRightEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1186)) (ApplySpecial -1 end () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1184)) (Apply -1 includesEnd () Boolean (Ref __iruid_1184))))))) (Let row (Ref __iruid_1190) (MakeStruct (locus (GetField locus (Ref row))) (alleles (GetField alleles (Ref row))) (rsid (GetField rsid (Ref row))) (qual (GetField qual (Ref row))) (filters (GetField filters (Ref row))) (info (GetField info (Ref row))) (a_index (GetField a_index (Ref row))) (was_split (GetField was_split (Ref row))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_527 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row))) (Let __iruid_528 (If (IsNA (GetField PL (Ref __iruid_527))) (NA Array[Int32]) (ToArray (StreamMap __iruid_529 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_534 __iruid_535) __iruid_530 (StreamFilter __iruid_531 (StreamMap __iruid_532 (StreamFilter __iruid_533 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref row)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_533)) (GetField a_index (Ref row)))) (Ref __iruid_529))) (ApplyIR 25 indexArray () Int32 (GetField PL (Ref __iruid_527)) (Ref __iruid_532))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_531)))) (NA Int32) (True) (If (Ref __iruid_535) (Ref __iruid_530) (If (ApplyComparisonOp LT (Ref __iruid_534) (Ref __iruid_530)) (Ref __iruid_534) (Ref __iruid_530))) (False) (Ref __iruid_534))))) (InsertFields (Ref __iruid_527) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_527)) (GetField a_index (Ref row)))) (DP (GetField DP (Ref __iruid_527))) (AD (If (IsNA (GetField AD (Ref __iruid_527))) (NA Array[Int32]) (Let __iruid_536 (GetField AD (Ref __iruid_527)) (Let __iruid_537 (GetField a_index (Ref row)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_538 __iruid_539 (StreamFilter __iruid_540 (ToStream False (Ref __iruid_536)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_540)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_538) (Ref __iruid_539))) (ApplyIR 17 indexArray () Int32 (Ref __iruid_536) (Ref __iruid_537))) (ApplyIR 18 indexArray () Int32 (Ref __iruid_536) (Ref __iruid_537))))))) (PL (Ref __iruid_528)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_528)) (GetField GQ (Ref __iruid_527))))))))))))))) (Apply -1 concat () String (GetField writeCtx (Ref __iruid_1193)) (UUID4 __iruid_1196)))))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals/parts/\"}" (MakeStream Stream[Struct{}] False (MakeStruct)) (Str "part-0"))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows/parts/\"}" (MakeStream Stream[Struct{}] False (SelectFields () (Ref __iruid_775))) (Str "part-0"))))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"typ\":{\"rowType\":\"Struct{}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"globals\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (MakeStruct (partitionCounts (I64 1)) (distinctlyKeyed (True)) (firstKey (MakeStruct)) (lastKey (MakeStruct))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (Ref __iruid_1197)))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"typ\":{\"rowType\":\"Struct{s:String}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1197)))) (Let __iruid_1200 (ToArray (StreamMap __iruid_1199 (ToStream False (Ref __iruid_1198)) (GetField filePath (Ref __iruid_1199)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\"..." (Ref __iruid_1200)) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\"..." (Ref __iruid_1200)))) (Let __iruid_1202 (ToArray (StreamMap __iruid_1201 (ToStream False (Ref __iruid_1198)) (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1201)))) (Begin (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"key\":[\"locus\",\"alleles\"],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (Ref __iruid_1202)) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"typ\":{\"rowType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (ToArray (StreamMap __iruid_1203 (ToStream False (Ref __iruid_1202)) (InsertFields (SelectFields (partitionCounts distinctlyKeyed) (Ref __iruid_1203)) None (firstKey (MakeStruct)) (lastKey (MakeStruct)))))) (WriteMetadata "{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"typ\":{\"globalType\":\"Struct{}\",\"colKey\":[\"s\"],\"colType\":\"Struct{s:String}\",\"rowKey\":[\"locus\",\"alleles\"],\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"entryType\":\"Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}\"},\"rowRelPath\":\"rows/rows\",\"globalRelPath\":\"globals/rows\",\"colRelPath\":\"cols/rows\",\"entryRelPath\":\"entries/rows\",\"refRelPath\":\"references\",\"log\":true}" (MakeStruct (cols (GetField partitionCounts (Ref __iruid_1197))) (rows (ToArray (StreamMap __iruid_1204 (ToStream False (Ref __iruid_1202)) (GetField partitionCounts (Ref __iruid_1204))))))))))))))))))) 2023-02-10 11:12:04 root: INFO: Prune: MakeStruct: eliminating field '__iruid_1177' 2023-02-10 11:12:04 root: INFO: Prune: MakeStruct: eliminating field '__iruid_775' 2023-02-10 11:12:04 root: INFO: optimize optimize: relationalLowerer, initial IR: after: IR size 365: (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"maybeRefs\":{\"references\":[{\"name\":\"GRCh38\",\"contigs\":[\"chr1\",\"chr2\",\"chr3\",\"chr4\",\"chr5\",\"chr6\",\"chr7\",\"chr8\",\"chr9\",\"chr10\",\"chr11\",\"chr12\",\"chr13\",\"chr14\",\"chr15\",\"chr16\",\"chr17\",\"chr18\",\"chr19\",\"chr20\",\"chr21\",\"chr22\",\"chrX\",\"chrY\",\"chrM\",\"chr1_KI270706v1_random\",\"chr1_KI270707v1_random\",\"chr1_KI270708v1_random\",\"chr1_KI270709v1_random\",\"chr1_KI270710v1_random\",\"chr1_KI270711v1_random\",\"chr1_KI270712v1_random\",\"chr1_KI270713v1_random\",\"chr1_KI270714v1_random\",\"chr2_KI270715v1_random\",\"chr2_KI270716v1_random\",\"chr3_GL000221v1_random\",\"chr4_GL000008v2_random\",\"chr5_GL000208v1_random\",\"chr9_KI270717v1_random\",\"chr9_KI270718v1_random\",\"chr9_KI270719v1_random\",\"chr9_KI270720v1_random\",\"chr11_KI270721v1_random\",\"chr14_GL000009v2_random\",\"chr14_GL000225v1_random\",\"chr14_KI270722v1_r..." (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"overwrite\":false}" (Let __iruid_1398 (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows/parts/\"}" (ToStream False (Literal Array[Struct{s:String}] )) (Str "part-0")) (Let __iruid_1399 (CollectDistributedArray __iruid_1400 __iruid_1401 (StreamZip -1 AssertSameLength (__iruid_1402 __iruid_1403) (StreamZip -1 AssumeSameLength (__iruid_1404 __iruid_1405) (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Let __iruid_1406 (ToArray (StreamRange -1 False (I32 0) (I32 0) (I32 1))) (StreamMap __iruid_1407 (ToStream False (Literal Array[Struct{partitionBound:Interval[Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32]],parentPartitions:Array[Int32]}] )) (MakeStruct (partitionBound (GetField partitionBound (Ref __iruid_1407))) (oldContexts (ToArray (StreamMap __iruid_1408 (ToStream False (GetField parentPartitions (Ref __iruid_1407))) (ArrayRef -1 (Ref __iruid_1406) (Ref __iruid_1408)))))))) (MakeTuple (0 1) (Ref __iruid_1404) (Ref __iruid_1405))) (ToStream False (Literal Array[String] )) (MakeStruct (oldCtx (Ref __iruid_1402)) (writeCtx (Ref __iruid_1403)))) (Literal Struct{} ) (WritePartition "{\"spec1\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix1\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows/parts/\",\"spec2\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix2\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows/parts/\",\"keyFieldNames\":[\"locus\",\"alleles\"],\"index\":{\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/index/\":\"+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}\"}}" (Let __iruid_1409 (GetField oldCtx (Ref __iruid_1400)) (StreamMap __iruid_1410 (StreamMultiMerge (locus alleles) (StreamFlatMap __iruid_1411 (StreamFlatMap __iruid_1412 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetTupleElement 0 (Ref __iruid_1409)))) (StreamMap __iruid_1413 (ToStream False (ArraySort __iruid_1414 __iruid_1415 (Ref __iruid_1412) (ApplyComparisonOp LT (Ref __iruid_1414) (Ref __iruid_1415)))) (InsertFields (Let __iruid_1416 (GetField alleles (Ref __iruid_1413)) (Let __iruid_1417 (GetField locus (Ref __iruid_1413)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_1413)) None (__uid_3 (ArraySort __iruid_1418 __iruid_1419 (StreamFlatMap __iruid_1420 (StreamFilter __iruid_1421 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_1416)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_1416) (Ref __iruid_1421)) (Str "*"))) (ToStream False (Let __iruid_1422 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_1417) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_1416) (I32 0)) (ApplyIR 7 indexArray () String (Ref __iruid_1416) (Ref __iruid_1420)))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_1422)) (Ref __iruid_1417)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_1422))) (locus (GetField locus (Ref __iruid_1422))) (a_index (Ref __iruid_1420)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_1413))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_1418)) (False) (If (IsNA (Ref __iruid_1419)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_1418) (Ref __iruid_1419)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1413)))))) (StreamMap __iruid_1423 (ToStream False (GetField __uid_3 (Ref __iruid_1411))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_1411)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_1423))) (alleles (GetField alleles (Ref __iruid_1423))) (a_index (GetField a_index (Ref __iruid_1423))) (was_split (GetField was_split (Ref __iruid_1423))) (old_alleles (GetField alleles (Ref __iruid_1411)))))) (Let __iruid_1424 (GetTupleElement 1 (Ref __iruid_1409)) (Let __iruid_1425 (GetField partitionBound (Ref __iruid_1424)) (StreamTakeWhile __iruid_1426 (StreamDropWhile __iruid_1427 (StreamFlatMap __iruid_1428 (ToStream True (GetField oldContexts (Ref __iruid_1424))) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean,old_alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "\"\"" (Ref __iruid_1428))) (Apply -1 pointLessThanPartitionIntervalLeftEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1427)) (ApplySpecial -1 start () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1425)) (Apply -1 includesStart () Boolean (Ref __iruid_1425)))) (Apply -1 pointLessThanPartitionIntervalRightEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1426)) (ApplySpecial -1 end () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1425)) (Apply -1 includesEnd () Boolean (Ref __iruid_1425))))))) (MakeStruct (locus (GetField locus (Ref __iruid_1410))) (alleles (GetField alleles (Ref __iruid_1410))) (rsid (GetField rsid (Ref __iruid_1410))) (qual (GetField qual (Ref __iruid_1410))) (filters (GetField filters (Ref __iruid_1410))) (info (GetField info (Ref __iruid_1410))) (a_index (GetField a_index (Ref __iruid_1410))) (was_split (GetField was_split (Ref __iruid_1410))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_1429 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1410))) (Let __iruid_1430 (If (IsNA (GetField PL (Ref __iruid_1429))) (NA Array[Int32]) (ToArray (StreamMap __iruid_1431 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_1436 __iruid_1437) __iruid_1432 (StreamFilter __iruid_1433 (StreamMap __iruid_1434 (StreamFilter __iruid_1435 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref __iruid_1410)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_1435)) (GetField a_index (Ref __iruid_1410)))) (Ref __iruid_1431))) (ApplyIR 25 indexArray () Int32 (GetField PL (Ref __iruid_1429)) (Ref __iruid_1434))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_1433)))) (NA Int32) (True) (If (Ref __iruid_1437) (Ref __iruid_1432) (If (ApplyComparisonOp LT (Ref __iruid_1436) (Ref __iruid_1432)) (Ref __iruid_1436) (Ref __iruid_1432))) (False) (Ref __iruid_1436))))) (InsertFields (Ref __iruid_1429) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_1429)) (GetField a_index (Ref __iruid_1410)))) (DP (GetField DP (Ref __iruid_1429))) (AD (If (IsNA (GetField AD (Ref __iruid_1429))) (NA Array[Int32]) (Let __iruid_1438 (GetField AD (Ref __iruid_1429)) (Let __iruid_1439 (GetField a_index (Ref __iruid_1410)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_1440 __iruid_1441 (StreamFilter __iruid_1442 (ToStream False (Ref __iruid_1438)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_1442)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_1440) (Ref __iruid_1441))) (ApplyIR 17 indexArray () Int32 (Ref __iruid_1438) (Ref __iruid_1439))) (ApplyIR 18 indexArray () Int32 (Ref __iruid_1438) (Ref __iruid_1439))))))) (PL (Ref __iruid_1430)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_1430)) (GetField GQ (Ref __iruid_1429)))))))))))) (Apply -1 concat () String (GetField writeCtx (Ref __iruid_1400)) (UUID4 __iruid_1196)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"typ\":{\"rowType\":\"Struct{}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"globals\",\"refRelPath\":\"../references\",\"log\":false}" (Literal Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] )) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (Ref __iruid_1398)))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"typ\":{\"rowType\":\"Struct{s:String}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1398)))) (Let __iruid_1443 (ToArray (StreamMap __iruid_1444 (ToStream False (Ref __iruid_1399)) (GetField filePath (Ref __iruid_1444)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\"..." (Ref __iruid_1443)) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\"..." (Ref __iruid_1443)))) (Let __iruid_1445 (ToArray (StreamMap __iruid_1446 (ToStream False (Ref __iruid_1399)) (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1446)))) (Begin (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"key\":[\"locus\",\"alleles\"],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (Ref __iruid_1445)) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"typ\":{\"rowType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (ToArray (StreamMap __iruid_1447 (ToStream False (Ref __iruid_1445)) (InsertFields (SelectFields (partitionCounts distinctlyKeyed) (Ref __iruid_1447)) None (firstKey (Literal Struct{} )) (lastKey (Literal Struct{} )))))) (WriteMetadata "{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"typ\":{\"globalType\":\"Struct{}\",\"colKey\":[\"s\"],\"colType\":\"Struct{s:String}\",\"rowKey\":[\"locus\",\"alleles\"],\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"entryType\":\"Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}\"},\"rowRelPath\":\"rows/rows\",\"globalRelPath\":\"globals/rows\",\"colRelPath\":\"cols/rows\",\"entryRelPath\":\"entries/rows\",\"refRelPath\":\"references\",\"log\":true}" (MakeStruct (cols (GetField partitionCounts (Ref __iruid_1398))) (rows (ToArray (StreamMap __iruid_1448 (ToStream False (Ref __iruid_1445)) (GetField partitionCounts (Ref __iruid_1448))))))))))))))))) 2023-02-10 11:12:04 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: before: IR size 365: (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"maybeRefs\":{\"references\":[{\"name\":\"GRCh38\",\"contigs\":[\"chr1\",\"chr2\",\"chr3\",\"chr4\",\"chr5\",\"chr6\",\"chr7\",\"chr8\",\"chr9\",\"chr10\",\"chr11\",\"chr12\",\"chr13\",\"chr14\",\"chr15\",\"chr16\",\"chr17\",\"chr18\",\"chr19\",\"chr20\",\"chr21\",\"chr22\",\"chrX\",\"chrY\",\"chrM\",\"chr1_KI270706v1_random\",\"chr1_KI270707v1_random\",\"chr1_KI270708v1_random\",\"chr1_KI270709v1_random\",\"chr1_KI270710v1_random\",\"chr1_KI270711v1_random\",\"chr1_KI270712v1_random\",\"chr1_KI270713v1_random\",\"chr1_KI270714v1_random\",\"chr2_KI270715v1_random\",\"chr2_KI270716v1_random\",\"chr3_GL000221v1_random\",\"chr4_GL000008v2_random\",\"chr5_GL000208v1_random\",\"chr9_KI270717v1_random\",\"chr9_KI270718v1_random\",\"chr9_KI270719v1_random\",\"chr9_KI270720v1_random\",\"chr11_KI270721v1_random\",\"chr14_GL000009v2_random\",\"chr14_GL000225v1_random\",\"chr14_KI270722v1_r..." (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"overwrite\":false}" (Let __iruid_1398 (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows/parts/\"}" (ToStream False (Literal Array[Struct{s:String}] )) (Str "part-0")) (Let __iruid_1399 (CollectDistributedArray __iruid_1400 __iruid_1401 (StreamZip -1 AssertSameLength (__iruid_1402 __iruid_1403) (StreamZip -1 AssumeSameLength (__iruid_1404 __iruid_1405) (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Let __iruid_1406 (ToArray (StreamRange -1 False (I32 0) (I32 0) (I32 1))) (StreamMap __iruid_1407 (ToStream False (Literal Array[Struct{partitionBound:Interval[Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32]],parentPartitions:Array[Int32]}] )) (MakeStruct (partitionBound (GetField partitionBound (Ref __iruid_1407))) (oldContexts (ToArray (StreamMap __iruid_1408 (ToStream False (GetField parentPartitions (Ref __iruid_1407))) (ArrayRef -1 (Ref __iruid_1406) (Ref __iruid_1408)))))))) (MakeTuple (0 1) (Ref __iruid_1404) (Ref __iruid_1405))) (ToStream False (Literal Array[String] )) (MakeStruct (oldCtx (Ref __iruid_1402)) (writeCtx (Ref __iruid_1403)))) (Literal Struct{} ) (WritePartition "{\"spec1\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix1\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows/parts/\",\"spec2\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix2\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows/parts/\",\"keyFieldNames\":[\"locus\",\"alleles\"],\"index\":{\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/index/\":\"+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}\"}}" (Let __iruid_1409 (GetField oldCtx (Ref __iruid_1400)) (StreamMap __iruid_1410 (StreamMultiMerge (locus alleles) (StreamFlatMap __iruid_1411 (StreamFlatMap __iruid_1412 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetTupleElement 0 (Ref __iruid_1409)))) (StreamMap __iruid_1413 (ToStream False (ArraySort __iruid_1414 __iruid_1415 (Ref __iruid_1412) (ApplyComparisonOp LT (Ref __iruid_1414) (Ref __iruid_1415)))) (InsertFields (Let __iruid_1416 (GetField alleles (Ref __iruid_1413)) (Let __iruid_1417 (GetField locus (Ref __iruid_1413)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_1413)) None (__uid_3 (ArraySort __iruid_1418 __iruid_1419 (StreamFlatMap __iruid_1420 (StreamFilter __iruid_1421 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_1416)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_1416) (Ref __iruid_1421)) (Str "*"))) (ToStream False (Let __iruid_1422 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_1417) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_1416) (I32 0)) (ApplyIR 7 indexArray () String (Ref __iruid_1416) (Ref __iruid_1420)))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_1422)) (Ref __iruid_1417)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_1422))) (locus (GetField locus (Ref __iruid_1422))) (a_index (Ref __iruid_1420)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_1413))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_1418)) (False) (If (IsNA (Ref __iruid_1419)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_1418) (Ref __iruid_1419)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1413)))))) (StreamMap __iruid_1423 (ToStream False (GetField __uid_3 (Ref __iruid_1411))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_1411)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_1423))) (alleles (GetField alleles (Ref __iruid_1423))) (a_index (GetField a_index (Ref __iruid_1423))) (was_split (GetField was_split (Ref __iruid_1423))) (old_alleles (GetField alleles (Ref __iruid_1411)))))) (Let __iruid_1424 (GetTupleElement 1 (Ref __iruid_1409)) (Let __iruid_1425 (GetField partitionBound (Ref __iruid_1424)) (StreamTakeWhile __iruid_1426 (StreamDropWhile __iruid_1427 (StreamFlatMap __iruid_1428 (ToStream True (GetField oldContexts (Ref __iruid_1424))) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean,old_alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "\"\"" (Ref __iruid_1428))) (Apply -1 pointLessThanPartitionIntervalLeftEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1427)) (ApplySpecial -1 start () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1425)) (Apply -1 includesStart () Boolean (Ref __iruid_1425)))) (Apply -1 pointLessThanPartitionIntervalRightEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1426)) (ApplySpecial -1 end () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1425)) (Apply -1 includesEnd () Boolean (Ref __iruid_1425))))))) (MakeStruct (locus (GetField locus (Ref __iruid_1410))) (alleles (GetField alleles (Ref __iruid_1410))) (rsid (GetField rsid (Ref __iruid_1410))) (qual (GetField qual (Ref __iruid_1410))) (filters (GetField filters (Ref __iruid_1410))) (info (GetField info (Ref __iruid_1410))) (a_index (GetField a_index (Ref __iruid_1410))) (was_split (GetField was_split (Ref __iruid_1410))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_1429 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1410))) (Let __iruid_1430 (If (IsNA (GetField PL (Ref __iruid_1429))) (NA Array[Int32]) (ToArray (StreamMap __iruid_1431 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_1436 __iruid_1437) __iruid_1432 (StreamFilter __iruid_1433 (StreamMap __iruid_1434 (StreamFilter __iruid_1435 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref __iruid_1410)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_1435)) (GetField a_index (Ref __iruid_1410)))) (Ref __iruid_1431))) (ApplyIR 25 indexArray () Int32 (GetField PL (Ref __iruid_1429)) (Ref __iruid_1434))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_1433)))) (NA Int32) (True) (If (Ref __iruid_1437) (Ref __iruid_1432) (If (ApplyComparisonOp LT (Ref __iruid_1436) (Ref __iruid_1432)) (Ref __iruid_1436) (Ref __iruid_1432))) (False) (Ref __iruid_1436))))) (InsertFields (Ref __iruid_1429) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_1429)) (GetField a_index (Ref __iruid_1410)))) (DP (GetField DP (Ref __iruid_1429))) (AD (If (IsNA (GetField AD (Ref __iruid_1429))) (NA Array[Int32]) (Let __iruid_1438 (GetField AD (Ref __iruid_1429)) (Let __iruid_1439 (GetField a_index (Ref __iruid_1410)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_1440 __iruid_1441 (StreamFilter __iruid_1442 (ToStream False (Ref __iruid_1438)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_1442)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_1440) (Ref __iruid_1441))) (ApplyIR 17 indexArray () Int32 (Ref __iruid_1438) (Ref __iruid_1439))) (ApplyIR 18 indexArray () Int32 (Ref __iruid_1438) (Ref __iruid_1439))))))) (PL (Ref __iruid_1430)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_1430)) (GetField GQ (Ref __iruid_1429)))))))))))) (Apply -1 concat () String (GetField writeCtx (Ref __iruid_1400)) (UUID4 __iruid_1196)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"typ\":{\"rowType\":\"Struct{}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"globals\",\"refRelPath\":\"../references\",\"log\":false}" (Literal Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] )) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (Ref __iruid_1398)))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"typ\":{\"rowType\":\"Struct{s:String}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1398)))) (Let __iruid_1443 (ToArray (StreamMap __iruid_1444 (ToStream False (Ref __iruid_1399)) (GetField filePath (Ref __iruid_1444)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\"..." (Ref __iruid_1443)) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\"..." (Ref __iruid_1443)))) (Let __iruid_1445 (ToArray (StreamMap __iruid_1446 (ToStream False (Ref __iruid_1399)) (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1446)))) (Begin (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"key\":[\"locus\",\"alleles\"],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (Ref __iruid_1445)) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"typ\":{\"rowType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (ToArray (StreamMap __iruid_1447 (ToStream False (Ref __iruid_1445)) (InsertFields (SelectFields (partitionCounts distinctlyKeyed) (Ref __iruid_1447)) None (firstKey (Literal Struct{} )) (lastKey (Literal Struct{} )))))) (WriteMetadata "{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"typ\":{\"globalType\":\"Struct{}\",\"colKey\":[\"s\"],\"colType\":\"Struct{s:String}\",\"rowKey\":[\"locus\",\"alleles\"],\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"entryType\":\"Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}\"},\"rowRelPath\":\"rows/rows\",\"globalRelPath\":\"globals/rows\",\"colRelPath\":\"cols/rows\",\"entryRelPath\":\"entries/rows\",\"refRelPath\":\"references\",\"log\":true}" (MakeStruct (cols (GetField partitionCounts (Ref __iruid_1398))) (rows (ToArray (StreamMap __iruid_1448 (ToStream False (Ref __iruid_1445)) (GetField partitionCounts (Ref __iruid_1448))))))))))))))))) 2023-02-10 11:12:04 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: after: IR size 365: (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"maybeRefs\":{\"references\":[{\"name\":\"GRCh38\",\"contigs\":[\"chr1\",\"chr2\",\"chr3\",\"chr4\",\"chr5\",\"chr6\",\"chr7\",\"chr8\",\"chr9\",\"chr10\",\"chr11\",\"chr12\",\"chr13\",\"chr14\",\"chr15\",\"chr16\",\"chr17\",\"chr18\",\"chr19\",\"chr20\",\"chr21\",\"chr22\",\"chrX\",\"chrY\",\"chrM\",\"chr1_KI270706v1_random\",\"chr1_KI270707v1_random\",\"chr1_KI270708v1_random\",\"chr1_KI270709v1_random\",\"chr1_KI270710v1_random\",\"chr1_KI270711v1_random\",\"chr1_KI270712v1_random\",\"chr1_KI270713v1_random\",\"chr1_KI270714v1_random\",\"chr2_KI270715v1_random\",\"chr2_KI270716v1_random\",\"chr3_GL000221v1_random\",\"chr4_GL000008v2_random\",\"chr5_GL000208v1_random\",\"chr9_KI270717v1_random\",\"chr9_KI270718v1_random\",\"chr9_KI270719v1_random\",\"chr9_KI270720v1_random\",\"chr11_KI270721v1_random\",\"chr14_GL000009v2_random\",\"chr14_GL000225v1_random\",\"chr14_KI270722v1_r..." (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"overwrite\":false}" (Let __iruid_1635 (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows/parts/\"}" (ToStream False (Literal Array[Struct{s:String}] )) (Str "part-0")) (Let __iruid_1636 (CollectDistributedArray __iruid_1637 __iruid_1638 (StreamZip -1 AssertSameLength (__iruid_1639 __iruid_1640) (StreamZip -1 AssumeSameLength (__iruid_1641 __iruid_1642) (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Let __iruid_1643 (ToArray (StreamRange -1 False (I32 0) (I32 0) (I32 1))) (StreamMap __iruid_1644 (ToStream False (Literal Array[Struct{partitionBound:Interval[Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32]],parentPartitions:Array[Int32]}] )) (MakeStruct (partitionBound (GetField partitionBound (Ref __iruid_1644))) (oldContexts (ToArray (StreamMap __iruid_1645 (ToStream False (GetField parentPartitions (Ref __iruid_1644))) (ArrayRef -1 (Ref __iruid_1643) (Ref __iruid_1645)))))))) (MakeTuple (0 1) (Ref __iruid_1641) (Ref __iruid_1642))) (ToStream False (Literal Array[String] )) (MakeStruct (oldCtx (Ref __iruid_1639)) (writeCtx (Ref __iruid_1640)))) (Literal Struct{} ) (WritePartition "{\"spec1\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix1\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows/parts/\",\"spec2\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix2\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows/parts/\",\"keyFieldNames\":[\"locus\",\"alleles\"],\"index\":{\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/index/\":\"+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}\"}}" (Let __iruid_1646 (GetField oldCtx (Ref __iruid_1637)) (StreamMap __iruid_1647 (StreamMultiMerge (locus alleles) (StreamFlatMap __iruid_1648 (StreamFlatMap __iruid_1649 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetTupleElement 0 (Ref __iruid_1646)))) (StreamMap __iruid_1650 (ToStream False (ArraySort __iruid_1651 __iruid_1652 (Ref __iruid_1649) (ApplyComparisonOp LT (Ref __iruid_1651) (Ref __iruid_1652)))) (InsertFields (Let __iruid_1653 (GetField alleles (Ref __iruid_1650)) (Let __iruid_1654 (GetField locus (Ref __iruid_1650)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_1650)) None (__uid_3 (ArraySort __iruid_1655 __iruid_1656 (StreamFlatMap __iruid_1657 (StreamFilter __iruid_1658 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_1653)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_1653) (Ref __iruid_1658)) (Str "*"))) (ToStream False (Let __iruid_1659 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_1654) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_1653) (I32 0)) (ApplyIR 7 indexArray () String (Ref __iruid_1653) (Ref __iruid_1657)))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_1659)) (Ref __iruid_1654)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_1659))) (locus (GetField locus (Ref __iruid_1659))) (a_index (Ref __iruid_1657)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_1650))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_1655)) (False) (If (IsNA (Ref __iruid_1656)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_1655) (Ref __iruid_1656)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1650)))))) (StreamMap __iruid_1660 (ToStream False (GetField __uid_3 (Ref __iruid_1648))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_1648)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_1660))) (alleles (GetField alleles (Ref __iruid_1660))) (a_index (GetField a_index (Ref __iruid_1660))) (was_split (GetField was_split (Ref __iruid_1660))) (old_alleles (GetField alleles (Ref __iruid_1648)))))) (Let __iruid_1661 (GetTupleElement 1 (Ref __iruid_1646)) (Let __iruid_1662 (GetField partitionBound (Ref __iruid_1661)) (StreamTakeWhile __iruid_1663 (StreamDropWhile __iruid_1664 (StreamFlatMap __iruid_1665 (ToStream True (GetField oldContexts (Ref __iruid_1661))) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean,old_alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "\"\"" (Ref __iruid_1665))) (Apply -1 pointLessThanPartitionIntervalLeftEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1664)) (ApplySpecial -1 start () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1662)) (Apply -1 includesStart () Boolean (Ref __iruid_1662)))) (Apply -1 pointLessThanPartitionIntervalRightEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1663)) (ApplySpecial -1 end () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1662)) (Apply -1 includesEnd () Boolean (Ref __iruid_1662))))))) (MakeStruct (locus (GetField locus (Ref __iruid_1647))) (alleles (GetField alleles (Ref __iruid_1647))) (rsid (GetField rsid (Ref __iruid_1647))) (qual (GetField qual (Ref __iruid_1647))) (filters (GetField filters (Ref __iruid_1647))) (info (GetField info (Ref __iruid_1647))) (a_index (GetField a_index (Ref __iruid_1647))) (was_split (GetField was_split (Ref __iruid_1647))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_1666 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1647))) (Let __iruid_1667 (If (IsNA (GetField PL (Ref __iruid_1666))) (NA Array[Int32]) (ToArray (StreamMap __iruid_1668 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_1673 __iruid_1674) __iruid_1669 (StreamFilter __iruid_1670 (StreamMap __iruid_1671 (StreamFilter __iruid_1672 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref __iruid_1647)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_1672)) (GetField a_index (Ref __iruid_1647)))) (Ref __iruid_1668))) (ApplyIR 25 indexArray () Int32 (GetField PL (Ref __iruid_1666)) (Ref __iruid_1671))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_1670)))) (NA Int32) (True) (If (Ref __iruid_1674) (Ref __iruid_1669) (If (ApplyComparisonOp LT (Ref __iruid_1673) (Ref __iruid_1669)) (Ref __iruid_1673) (Ref __iruid_1669))) (False) (Ref __iruid_1673))))) (InsertFields (Ref __iruid_1666) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_1666)) (GetField a_index (Ref __iruid_1647)))) (DP (GetField DP (Ref __iruid_1666))) (AD (If (IsNA (GetField AD (Ref __iruid_1666))) (NA Array[Int32]) (Let __iruid_1675 (GetField AD (Ref __iruid_1666)) (Let __iruid_1676 (GetField a_index (Ref __iruid_1647)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_1677 __iruid_1678 (StreamFilter __iruid_1679 (ToStream False (Ref __iruid_1675)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_1679)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_1677) (Ref __iruid_1678))) (ApplyIR 17 indexArray () Int32 (Ref __iruid_1675) (Ref __iruid_1676))) (ApplyIR 18 indexArray () Int32 (Ref __iruid_1675) (Ref __iruid_1676))))))) (PL (Ref __iruid_1667)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_1667)) (GetField GQ (Ref __iruid_1666)))))))))))) (Apply -1 concat () String (GetField writeCtx (Ref __iruid_1637)) (UUID4 __iruid_1196)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"typ\":{\"rowType\":\"Struct{}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"globals\",\"refRelPath\":\"../references\",\"log\":false}" (Literal Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] )) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (Ref __iruid_1635)))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"typ\":{\"rowType\":\"Struct{s:String}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1635)))) (Let __iruid_1680 (ToArray (StreamMap __iruid_1681 (ToStream False (Ref __iruid_1636)) (GetField filePath (Ref __iruid_1681)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\"..." (Ref __iruid_1680)) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\"..." (Ref __iruid_1680)))) (Let __iruid_1682 (ToArray (StreamMap __iruid_1683 (ToStream False (Ref __iruid_1636)) (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1683)))) (Begin (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"key\":[\"locus\",\"alleles\"],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (Ref __iruid_1682)) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"typ\":{\"rowType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (ToArray (StreamMap __iruid_1684 (ToStream False (Ref __iruid_1682)) (InsertFields (SelectFields (partitionCounts distinctlyKeyed) (Ref __iruid_1684)) None (firstKey (Literal Struct{} )) (lastKey (Literal Struct{} )))))) (WriteMetadata "{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"typ\":{\"globalType\":\"Struct{}\",\"colKey\":[\"s\"],\"colType\":\"Struct{s:String}\",\"rowKey\":[\"locus\",\"alleles\"],\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"entryType\":\"Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}\"},\"rowRelPath\":\"rows/rows\",\"globalRelPath\":\"globals/rows\",\"colRelPath\":\"cols/rows\",\"entryRelPath\":\"entries/rows\",\"refRelPath\":\"references\",\"log\":true}" (MakeStruct (cols (GetField partitionCounts (Ref __iruid_1635))) (rows (ToArray (StreamMap __iruid_1685 (ToStream False (Ref __iruid_1682)) (GetField partitionCounts (Ref __iruid_1685))))))))))))))))) 2023-02-10 11:12:04 root: INFO: optimize optimize: relationalLowerer, after InterpretNonCompilable: before: IR size 365: (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"maybeRefs\":{\"references\":[{\"name\":\"GRCh38\",\"contigs\":[\"chr1\",\"chr2\",\"chr3\",\"chr4\",\"chr5\",\"chr6\",\"chr7\",\"chr8\",\"chr9\",\"chr10\",\"chr11\",\"chr12\",\"chr13\",\"chr14\",\"chr15\",\"chr16\",\"chr17\",\"chr18\",\"chr19\",\"chr20\",\"chr21\",\"chr22\",\"chrX\",\"chrY\",\"chrM\",\"chr1_KI270706v1_random\",\"chr1_KI270707v1_random\",\"chr1_KI270708v1_random\",\"chr1_KI270709v1_random\",\"chr1_KI270710v1_random\",\"chr1_KI270711v1_random\",\"chr1_KI270712v1_random\",\"chr1_KI270713v1_random\",\"chr1_KI270714v1_random\",\"chr2_KI270715v1_random\",\"chr2_KI270716v1_random\",\"chr3_GL000221v1_random\",\"chr4_GL000008v2_random\",\"chr5_GL000208v1_random\",\"chr9_KI270717v1_random\",\"chr9_KI270718v1_random\",\"chr9_KI270719v1_random\",\"chr9_KI270720v1_random\",\"chr11_KI270721v1_random\",\"chr14_GL000009v2_random\",\"chr14_GL000225v1_random\",\"chr14_KI270722v1_r..." (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"overwrite\":false}" (Let __iruid_1635 (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows/parts/\"}" (ToStream False (Literal Array[Struct{s:String}] )) (Str "part-0")) (Let __iruid_1636 (CollectDistributedArray __iruid_1637 __iruid_1638 (StreamZip -1 AssertSameLength (__iruid_1639 __iruid_1640) (StreamZip -1 AssumeSameLength (__iruid_1641 __iruid_1642) (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Let __iruid_1643 (ToArray (StreamRange -1 False (I32 0) (I32 0) (I32 1))) (StreamMap __iruid_1644 (ToStream False (Literal Array[Struct{partitionBound:Interval[Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32]],parentPartitions:Array[Int32]}] )) (MakeStruct (partitionBound (GetField partitionBound (Ref __iruid_1644))) (oldContexts (ToArray (StreamMap __iruid_1645 (ToStream False (GetField parentPartitions (Ref __iruid_1644))) (ArrayRef -1 (Ref __iruid_1643) (Ref __iruid_1645)))))))) (MakeTuple (0 1) (Ref __iruid_1641) (Ref __iruid_1642))) (ToStream False (Literal Array[String] )) (MakeStruct (oldCtx (Ref __iruid_1639)) (writeCtx (Ref __iruid_1640)))) (Literal Struct{} ) (WritePartition "{\"spec1\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix1\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows/parts/\",\"spec2\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix2\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows/parts/\",\"keyFieldNames\":[\"locus\",\"alleles\"],\"index\":{\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/index/\":\"+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}\"}}" (Let __iruid_1646 (GetField oldCtx (Ref __iruid_1637)) (StreamMap __iruid_1647 (StreamMultiMerge (locus alleles) (StreamFlatMap __iruid_1648 (StreamFlatMap __iruid_1649 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetTupleElement 0 (Ref __iruid_1646)))) (StreamMap __iruid_1650 (ToStream False (ArraySort __iruid_1651 __iruid_1652 (Ref __iruid_1649) (ApplyComparisonOp LT (Ref __iruid_1651) (Ref __iruid_1652)))) (InsertFields (Let __iruid_1653 (GetField alleles (Ref __iruid_1650)) (Let __iruid_1654 (GetField locus (Ref __iruid_1650)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_1650)) None (__uid_3 (ArraySort __iruid_1655 __iruid_1656 (StreamFlatMap __iruid_1657 (StreamFilter __iruid_1658 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_1653)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_1653) (Ref __iruid_1658)) (Str "*"))) (ToStream False (Let __iruid_1659 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_1654) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_1653) (I32 0)) (ApplyIR 7 indexArray () String (Ref __iruid_1653) (Ref __iruid_1657)))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_1659)) (Ref __iruid_1654)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_1659))) (locus (GetField locus (Ref __iruid_1659))) (a_index (Ref __iruid_1657)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_1650))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_1655)) (False) (If (IsNA (Ref __iruid_1656)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_1655) (Ref __iruid_1656)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1650)))))) (StreamMap __iruid_1660 (ToStream False (GetField __uid_3 (Ref __iruid_1648))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_1648)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_1660))) (alleles (GetField alleles (Ref __iruid_1660))) (a_index (GetField a_index (Ref __iruid_1660))) (was_split (GetField was_split (Ref __iruid_1660))) (old_alleles (GetField alleles (Ref __iruid_1648)))))) (Let __iruid_1661 (GetTupleElement 1 (Ref __iruid_1646)) (Let __iruid_1662 (GetField partitionBound (Ref __iruid_1661)) (StreamTakeWhile __iruid_1663 (StreamDropWhile __iruid_1664 (StreamFlatMap __iruid_1665 (ToStream True (GetField oldContexts (Ref __iruid_1661))) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean,old_alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "\"\"" (Ref __iruid_1665))) (Apply -1 pointLessThanPartitionIntervalLeftEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1664)) (ApplySpecial -1 start () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1662)) (Apply -1 includesStart () Boolean (Ref __iruid_1662)))) (Apply -1 pointLessThanPartitionIntervalRightEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1663)) (ApplySpecial -1 end () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1662)) (Apply -1 includesEnd () Boolean (Ref __iruid_1662))))))) (MakeStruct (locus (GetField locus (Ref __iruid_1647))) (alleles (GetField alleles (Ref __iruid_1647))) (rsid (GetField rsid (Ref __iruid_1647))) (qual (GetField qual (Ref __iruid_1647))) (filters (GetField filters (Ref __iruid_1647))) (info (GetField info (Ref __iruid_1647))) (a_index (GetField a_index (Ref __iruid_1647))) (was_split (GetField was_split (Ref __iruid_1647))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_1666 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1647))) (Let __iruid_1667 (If (IsNA (GetField PL (Ref __iruid_1666))) (NA Array[Int32]) (ToArray (StreamMap __iruid_1668 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_1673 __iruid_1674) __iruid_1669 (StreamFilter __iruid_1670 (StreamMap __iruid_1671 (StreamFilter __iruid_1672 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref __iruid_1647)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_1672)) (GetField a_index (Ref __iruid_1647)))) (Ref __iruid_1668))) (ApplyIR 25 indexArray () Int32 (GetField PL (Ref __iruid_1666)) (Ref __iruid_1671))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_1670)))) (NA Int32) (True) (If (Ref __iruid_1674) (Ref __iruid_1669) (If (ApplyComparisonOp LT (Ref __iruid_1673) (Ref __iruid_1669)) (Ref __iruid_1673) (Ref __iruid_1669))) (False) (Ref __iruid_1673))))) (InsertFields (Ref __iruid_1666) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_1666)) (GetField a_index (Ref __iruid_1647)))) (DP (GetField DP (Ref __iruid_1666))) (AD (If (IsNA (GetField AD (Ref __iruid_1666))) (NA Array[Int32]) (Let __iruid_1675 (GetField AD (Ref __iruid_1666)) (Let __iruid_1676 (GetField a_index (Ref __iruid_1647)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_1677 __iruid_1678 (StreamFilter __iruid_1679 (ToStream False (Ref __iruid_1675)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_1679)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_1677) (Ref __iruid_1678))) (ApplyIR 17 indexArray () Int32 (Ref __iruid_1675) (Ref __iruid_1676))) (ApplyIR 18 indexArray () Int32 (Ref __iruid_1675) (Ref __iruid_1676))))))) (PL (Ref __iruid_1667)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_1667)) (GetField GQ (Ref __iruid_1666)))))))))))) (Apply -1 concat () String (GetField writeCtx (Ref __iruid_1637)) (UUID4 __iruid_1196)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"typ\":{\"rowType\":\"Struct{}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"globals\",\"refRelPath\":\"../references\",\"log\":false}" (Literal Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] )) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (Ref __iruid_1635)))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"typ\":{\"rowType\":\"Struct{s:String}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1635)))) (Let __iruid_1680 (ToArray (StreamMap __iruid_1681 (ToStream False (Ref __iruid_1636)) (GetField filePath (Ref __iruid_1681)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\"..." (Ref __iruid_1680)) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\"..." (Ref __iruid_1680)))) (Let __iruid_1682 (ToArray (StreamMap __iruid_1683 (ToStream False (Ref __iruid_1636)) (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1683)))) (Begin (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"key\":[\"locus\",\"alleles\"],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (Ref __iruid_1682)) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"typ\":{\"rowType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (ToArray (StreamMap __iruid_1684 (ToStream False (Ref __iruid_1682)) (InsertFields (SelectFields (partitionCounts distinctlyKeyed) (Ref __iruid_1684)) None (firstKey (Literal Struct{} )) (lastKey (Literal Struct{} )))))) (WriteMetadata "{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"typ\":{\"globalType\":\"Struct{}\",\"colKey\":[\"s\"],\"colType\":\"Struct{s:String}\",\"rowKey\":[\"locus\",\"alleles\"],\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"entryType\":\"Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}\"},\"rowRelPath\":\"rows/rows\",\"globalRelPath\":\"globals/rows\",\"colRelPath\":\"cols/rows\",\"entryRelPath\":\"entries/rows\",\"refRelPath\":\"references\",\"log\":true}" (MakeStruct (cols (GetField partitionCounts (Ref __iruid_1635))) (rows (ToArray (StreamMap __iruid_1685 (ToStream False (Ref __iruid_1682)) (GetField partitionCounts (Ref __iruid_1685))))))))))))))))) 2023-02-10 11:12:04 root: INFO: optimize optimize: relationalLowerer, after InterpretNonCompilable: after: IR size 365: (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"maybeRefs\":{\"references\":[{\"name\":\"GRCh38\",\"contigs\":[\"chr1\",\"chr2\",\"chr3\",\"chr4\",\"chr5\",\"chr6\",\"chr7\",\"chr8\",\"chr9\",\"chr10\",\"chr11\",\"chr12\",\"chr13\",\"chr14\",\"chr15\",\"chr16\",\"chr17\",\"chr18\",\"chr19\",\"chr20\",\"chr21\",\"chr22\",\"chrX\",\"chrY\",\"chrM\",\"chr1_KI270706v1_random\",\"chr1_KI270707v1_random\",\"chr1_KI270708v1_random\",\"chr1_KI270709v1_random\",\"chr1_KI270710v1_random\",\"chr1_KI270711v1_random\",\"chr1_KI270712v1_random\",\"chr1_KI270713v1_random\",\"chr1_KI270714v1_random\",\"chr2_KI270715v1_random\",\"chr2_KI270716v1_random\",\"chr3_GL000221v1_random\",\"chr4_GL000008v2_random\",\"chr5_GL000208v1_random\",\"chr9_KI270717v1_random\",\"chr9_KI270718v1_random\",\"chr9_KI270719v1_random\",\"chr9_KI270720v1_random\",\"chr11_KI270721v1_random\",\"chr14_GL000009v2_random\",\"chr14_GL000225v1_random\",\"chr14_KI270722v1_r..." (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"overwrite\":false}" (Let __iruid_1872 (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows/parts/\"}" (ToStream False (Literal Array[Struct{s:String}] )) (Str "part-0")) (Let __iruid_1873 (CollectDistributedArray __iruid_1874 __iruid_1875 (StreamZip -1 AssertSameLength (__iruid_1876 __iruid_1877) (StreamZip -1 AssumeSameLength (__iruid_1878 __iruid_1879) (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Let __iruid_1880 (ToArray (StreamRange -1 False (I32 0) (I32 0) (I32 1))) (StreamMap __iruid_1881 (ToStream False (Literal Array[Struct{partitionBound:Interval[Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32]],parentPartitions:Array[Int32]}] )) (MakeStruct (partitionBound (GetField partitionBound (Ref __iruid_1881))) (oldContexts (ToArray (StreamMap __iruid_1882 (ToStream False (GetField parentPartitions (Ref __iruid_1881))) (ArrayRef -1 (Ref __iruid_1880) (Ref __iruid_1882)))))))) (MakeTuple (0 1) (Ref __iruid_1878) (Ref __iruid_1879))) (ToStream False (Literal Array[String] )) (MakeStruct (oldCtx (Ref __iruid_1876)) (writeCtx (Ref __iruid_1877)))) (Literal Struct{} ) (WritePartition "{\"spec1\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix1\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows/parts/\",\"spec2\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix2\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows/parts/\",\"keyFieldNames\":[\"locus\",\"alleles\"],\"index\":{\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/index/\":\"+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}\"}}" (Let __iruid_1883 (GetField oldCtx (Ref __iruid_1874)) (StreamMap __iruid_1884 (StreamMultiMerge (locus alleles) (StreamFlatMap __iruid_1885 (StreamFlatMap __iruid_1886 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetTupleElement 0 (Ref __iruid_1883)))) (StreamMap __iruid_1887 (ToStream False (ArraySort __iruid_1888 __iruid_1889 (Ref __iruid_1886) (ApplyComparisonOp LT (Ref __iruid_1888) (Ref __iruid_1889)))) (InsertFields (Let __iruid_1890 (GetField alleles (Ref __iruid_1887)) (Let __iruid_1891 (GetField locus (Ref __iruid_1887)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_1887)) None (__uid_3 (ArraySort __iruid_1892 __iruid_1893 (StreamFlatMap __iruid_1894 (StreamFilter __iruid_1895 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_1890)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_1890) (Ref __iruid_1895)) (Str "*"))) (ToStream False (Let __iruid_1896 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_1891) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_1890) (I32 0)) (ApplyIR 7 indexArray () String (Ref __iruid_1890) (Ref __iruid_1894)))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_1896)) (Ref __iruid_1891)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_1896))) (locus (GetField locus (Ref __iruid_1896))) (a_index (Ref __iruid_1894)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_1887))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_1892)) (False) (If (IsNA (Ref __iruid_1893)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_1892) (Ref __iruid_1893)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1887)))))) (StreamMap __iruid_1897 (ToStream False (GetField __uid_3 (Ref __iruid_1885))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_1885)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_1897))) (alleles (GetField alleles (Ref __iruid_1897))) (a_index (GetField a_index (Ref __iruid_1897))) (was_split (GetField was_split (Ref __iruid_1897))) (old_alleles (GetField alleles (Ref __iruid_1885)))))) (Let __iruid_1898 (GetTupleElement 1 (Ref __iruid_1883)) (Let __iruid_1899 (GetField partitionBound (Ref __iruid_1898)) (StreamTakeWhile __iruid_1900 (StreamDropWhile __iruid_1901 (StreamFlatMap __iruid_1902 (ToStream True (GetField oldContexts (Ref __iruid_1898))) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean,old_alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "\"\"" (Ref __iruid_1902))) (Apply -1 pointLessThanPartitionIntervalLeftEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1901)) (ApplySpecial -1 start () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1899)) (Apply -1 includesStart () Boolean (Ref __iruid_1899)))) (Apply -1 pointLessThanPartitionIntervalRightEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1900)) (ApplySpecial -1 end () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1899)) (Apply -1 includesEnd () Boolean (Ref __iruid_1899))))))) (MakeStruct (locus (GetField locus (Ref __iruid_1884))) (alleles (GetField alleles (Ref __iruid_1884))) (rsid (GetField rsid (Ref __iruid_1884))) (qual (GetField qual (Ref __iruid_1884))) (filters (GetField filters (Ref __iruid_1884))) (info (GetField info (Ref __iruid_1884))) (a_index (GetField a_index (Ref __iruid_1884))) (was_split (GetField was_split (Ref __iruid_1884))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_1903 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1884))) (Let __iruid_1904 (If (IsNA (GetField PL (Ref __iruid_1903))) (NA Array[Int32]) (ToArray (StreamMap __iruid_1905 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_1910 __iruid_1911) __iruid_1906 (StreamFilter __iruid_1907 (StreamMap __iruid_1908 (StreamFilter __iruid_1909 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref __iruid_1884)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_1909)) (GetField a_index (Ref __iruid_1884)))) (Ref __iruid_1905))) (ApplyIR 25 indexArray () Int32 (GetField PL (Ref __iruid_1903)) (Ref __iruid_1908))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_1907)))) (NA Int32) (True) (If (Ref __iruid_1911) (Ref __iruid_1906) (If (ApplyComparisonOp LT (Ref __iruid_1910) (Ref __iruid_1906)) (Ref __iruid_1910) (Ref __iruid_1906))) (False) (Ref __iruid_1910))))) (InsertFields (Ref __iruid_1903) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_1903)) (GetField a_index (Ref __iruid_1884)))) (DP (GetField DP (Ref __iruid_1903))) (AD (If (IsNA (GetField AD (Ref __iruid_1903))) (NA Array[Int32]) (Let __iruid_1912 (GetField AD (Ref __iruid_1903)) (Let __iruid_1913 (GetField a_index (Ref __iruid_1884)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_1914 __iruid_1915 (StreamFilter __iruid_1916 (ToStream False (Ref __iruid_1912)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_1916)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_1914) (Ref __iruid_1915))) (ApplyIR 17 indexArray () Int32 (Ref __iruid_1912) (Ref __iruid_1913))) (ApplyIR 18 indexArray () Int32 (Ref __iruid_1912) (Ref __iruid_1913))))))) (PL (Ref __iruid_1904)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_1904)) (GetField GQ (Ref __iruid_1903)))))))))))) (Apply -1 concat () String (GetField writeCtx (Ref __iruid_1874)) (UUID4 __iruid_1196)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"typ\":{\"rowType\":\"Struct{}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"globals\",\"refRelPath\":\"../references\",\"log\":false}" (Literal Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] )) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (Ref __iruid_1872)))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"typ\":{\"rowType\":\"Struct{s:String}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1872)))) (Let __iruid_1917 (ToArray (StreamMap __iruid_1918 (ToStream False (Ref __iruid_1873)) (GetField filePath (Ref __iruid_1918)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\"..." (Ref __iruid_1917)) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\"..." (Ref __iruid_1917)))) (Let __iruid_1919 (ToArray (StreamMap __iruid_1920 (ToStream False (Ref __iruid_1873)) (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1920)))) (Begin (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"key\":[\"locus\",\"alleles\"],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (Ref __iruid_1919)) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"typ\":{\"rowType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (ToArray (StreamMap __iruid_1921 (ToStream False (Ref __iruid_1919)) (InsertFields (SelectFields (partitionCounts distinctlyKeyed) (Ref __iruid_1921)) None (firstKey (Literal Struct{} )) (lastKey (Literal Struct{} )))))) (WriteMetadata "{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"typ\":{\"globalType\":\"Struct{}\",\"colKey\":[\"s\"],\"colType\":\"Struct{s:String}\",\"rowKey\":[\"locus\",\"alleles\"],\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"entryType\":\"Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}\"},\"rowRelPath\":\"rows/rows\",\"globalRelPath\":\"globals/rows\",\"colRelPath\":\"cols/rows\",\"entryRelPath\":\"entries/rows\",\"refRelPath\":\"references\",\"log\":true}" (MakeStruct (cols (GetField partitionCounts (Ref __iruid_1872))) (rows (ToArray (StreamMap __iruid_1922 (ToStream False (Ref __iruid_1919)) (GetField partitionCounts (Ref __iruid_1922))))))))))))))))) 2023-02-10 11:12:04 root: INFO: optimize optimize: compileLowerer, initial IR: before: IR size 365: (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"maybeRefs\":{\"references\":[{\"name\":\"GRCh38\",\"contigs\":[\"chr1\",\"chr2\",\"chr3\",\"chr4\",\"chr5\",\"chr6\",\"chr7\",\"chr8\",\"chr9\",\"chr10\",\"chr11\",\"chr12\",\"chr13\",\"chr14\",\"chr15\",\"chr16\",\"chr17\",\"chr18\",\"chr19\",\"chr20\",\"chr21\",\"chr22\",\"chrX\",\"chrY\",\"chrM\",\"chr1_KI270706v1_random\",\"chr1_KI270707v1_random\",\"chr1_KI270708v1_random\",\"chr1_KI270709v1_random\",\"chr1_KI270710v1_random\",\"chr1_KI270711v1_random\",\"chr1_KI270712v1_random\",\"chr1_KI270713v1_random\",\"chr1_KI270714v1_random\",\"chr2_KI270715v1_random\",\"chr2_KI270716v1_random\",\"chr3_GL000221v1_random\",\"chr4_GL000008v2_random\",\"chr5_GL000208v1_random\",\"chr9_KI270717v1_random\",\"chr9_KI270718v1_random\",\"chr9_KI270719v1_random\",\"chr9_KI270720v1_random\",\"chr11_KI270721v1_random\",\"chr14_GL000009v2_random\",\"chr14_GL000225v1_random\",\"chr14_KI270722v1_r..." (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"overwrite\":false}" (Let __iruid_1872 (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows/parts/\"}" (ToStream False (Literal Array[Struct{s:String}] )) (Str "part-0")) (Let __iruid_1873 (CollectDistributedArray __iruid_1874 __iruid_1875 (StreamZip -1 AssertSameLength (__iruid_1876 __iruid_1877) (StreamZip -1 AssumeSameLength (__iruid_1878 __iruid_1879) (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Let __iruid_1880 (ToArray (StreamRange -1 False (I32 0) (I32 0) (I32 1))) (StreamMap __iruid_1881 (ToStream False (Literal Array[Struct{partitionBound:Interval[Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32]],parentPartitions:Array[Int32]}] )) (MakeStruct (partitionBound (GetField partitionBound (Ref __iruid_1881))) (oldContexts (ToArray (StreamMap __iruid_1882 (ToStream False (GetField parentPartitions (Ref __iruid_1881))) (ArrayRef -1 (Ref __iruid_1880) (Ref __iruid_1882)))))))) (MakeTuple (0 1) (Ref __iruid_1878) (Ref __iruid_1879))) (ToStream False (Literal Array[String] )) (MakeStruct (oldCtx (Ref __iruid_1876)) (writeCtx (Ref __iruid_1877)))) (Literal Struct{} ) (WritePartition "{\"spec1\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix1\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows/parts/\",\"spec2\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix2\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows/parts/\",\"keyFieldNames\":[\"locus\",\"alleles\"],\"index\":{\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/index/\":\"+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}\"}}" (Let __iruid_1883 (GetField oldCtx (Ref __iruid_1874)) (StreamMap __iruid_1884 (StreamMultiMerge (locus alleles) (StreamFlatMap __iruid_1885 (StreamFlatMap __iruid_1886 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetTupleElement 0 (Ref __iruid_1883)))) (StreamMap __iruid_1887 (ToStream False (ArraySort __iruid_1888 __iruid_1889 (Ref __iruid_1886) (ApplyComparisonOp LT (Ref __iruid_1888) (Ref __iruid_1889)))) (InsertFields (Let __iruid_1890 (GetField alleles (Ref __iruid_1887)) (Let __iruid_1891 (GetField locus (Ref __iruid_1887)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_1887)) None (__uid_3 (ArraySort __iruid_1892 __iruid_1893 (StreamFlatMap __iruid_1894 (StreamFilter __iruid_1895 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_1890)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_1890) (Ref __iruid_1895)) (Str "*"))) (ToStream False (Let __iruid_1896 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_1891) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_1890) (I32 0)) (ApplyIR 7 indexArray () String (Ref __iruid_1890) (Ref __iruid_1894)))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_1896)) (Ref __iruid_1891)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_1896))) (locus (GetField locus (Ref __iruid_1896))) (a_index (Ref __iruid_1894)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_1887))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_1892)) (False) (If (IsNA (Ref __iruid_1893)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_1892) (Ref __iruid_1893)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1887)))))) (StreamMap __iruid_1897 (ToStream False (GetField __uid_3 (Ref __iruid_1885))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_1885)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_1897))) (alleles (GetField alleles (Ref __iruid_1897))) (a_index (GetField a_index (Ref __iruid_1897))) (was_split (GetField was_split (Ref __iruid_1897))) (old_alleles (GetField alleles (Ref __iruid_1885)))))) (Let __iruid_1898 (GetTupleElement 1 (Ref __iruid_1883)) (Let __iruid_1899 (GetField partitionBound (Ref __iruid_1898)) (StreamTakeWhile __iruid_1900 (StreamDropWhile __iruid_1901 (StreamFlatMap __iruid_1902 (ToStream True (GetField oldContexts (Ref __iruid_1898))) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean,old_alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "\"\"" (Ref __iruid_1902))) (Apply -1 pointLessThanPartitionIntervalLeftEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1901)) (ApplySpecial -1 start () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1899)) (Apply -1 includesStart () Boolean (Ref __iruid_1899)))) (Apply -1 pointLessThanPartitionIntervalRightEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_1900)) (ApplySpecial -1 end () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_1899)) (Apply -1 includesEnd () Boolean (Ref __iruid_1899))))))) (MakeStruct (locus (GetField locus (Ref __iruid_1884))) (alleles (GetField alleles (Ref __iruid_1884))) (rsid (GetField rsid (Ref __iruid_1884))) (qual (GetField qual (Ref __iruid_1884))) (filters (GetField filters (Ref __iruid_1884))) (info (GetField info (Ref __iruid_1884))) (a_index (GetField a_index (Ref __iruid_1884))) (was_split (GetField was_split (Ref __iruid_1884))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_1903 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_1884))) (Let __iruid_1904 (If (IsNA (GetField PL (Ref __iruid_1903))) (NA Array[Int32]) (ToArray (StreamMap __iruid_1905 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_1910 __iruid_1911) __iruid_1906 (StreamFilter __iruid_1907 (StreamMap __iruid_1908 (StreamFilter __iruid_1909 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref __iruid_1884)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_1909)) (GetField a_index (Ref __iruid_1884)))) (Ref __iruid_1905))) (ApplyIR 25 indexArray () Int32 (GetField PL (Ref __iruid_1903)) (Ref __iruid_1908))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_1907)))) (NA Int32) (True) (If (Ref __iruid_1911) (Ref __iruid_1906) (If (ApplyComparisonOp LT (Ref __iruid_1910) (Ref __iruid_1906)) (Ref __iruid_1910) (Ref __iruid_1906))) (False) (Ref __iruid_1910))))) (InsertFields (Ref __iruid_1903) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_1903)) (GetField a_index (Ref __iruid_1884)))) (DP (GetField DP (Ref __iruid_1903))) (AD (If (IsNA (GetField AD (Ref __iruid_1903))) (NA Array[Int32]) (Let __iruid_1912 (GetField AD (Ref __iruid_1903)) (Let __iruid_1913 (GetField a_index (Ref __iruid_1884)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_1914 __iruid_1915 (StreamFilter __iruid_1916 (ToStream False (Ref __iruid_1912)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_1916)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_1914) (Ref __iruid_1915))) (ApplyIR 17 indexArray () Int32 (Ref __iruid_1912) (Ref __iruid_1913))) (ApplyIR 18 indexArray () Int32 (Ref __iruid_1912) (Ref __iruid_1913))))))) (PL (Ref __iruid_1904)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_1904)) (GetField GQ (Ref __iruid_1903)))))))))))) (Apply -1 concat () String (GetField writeCtx (Ref __iruid_1874)) (UUID4 __iruid_1196)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"typ\":{\"rowType\":\"Struct{}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"globals\",\"refRelPath\":\"../references\",\"log\":false}" (Literal Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] )) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (Ref __iruid_1872)))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"typ\":{\"rowType\":\"Struct{s:String}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1872)))) (Let __iruid_1917 (ToArray (StreamMap __iruid_1918 (ToStream False (Ref __iruid_1873)) (GetField filePath (Ref __iruid_1918)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\"..." (Ref __iruid_1917)) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\"..." (Ref __iruid_1917)))) (Let __iruid_1919 (ToArray (StreamMap __iruid_1920 (ToStream False (Ref __iruid_1873)) (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_1920)))) (Begin (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"key\":[\"locus\",\"alleles\"],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (Ref __iruid_1919)) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"typ\":{\"rowType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (ToArray (StreamMap __iruid_1921 (ToStream False (Ref __iruid_1919)) (InsertFields (SelectFields (partitionCounts distinctlyKeyed) (Ref __iruid_1921)) None (firstKey (Literal Struct{} )) (lastKey (Literal Struct{} )))))) (WriteMetadata "{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"typ\":{\"globalType\":\"Struct{}\",\"colKey\":[\"s\"],\"colType\":\"Struct{s:String}\",\"rowKey\":[\"locus\",\"alleles\"],\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"entryType\":\"Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}\"},\"rowRelPath\":\"rows/rows\",\"globalRelPath\":\"globals/rows\",\"colRelPath\":\"cols/rows\",\"entryRelPath\":\"entries/rows\",\"refRelPath\":\"references\",\"log\":true}" (MakeStruct (cols (GetField partitionCounts (Ref __iruid_1872))) (rows (ToArray (StreamMap __iruid_1922 (ToStream False (Ref __iruid_1919)) (GetField partitionCounts (Ref __iruid_1922))))))))))))))))) 2023-02-10 11:12:04 root: INFO: optimize optimize: compileLowerer, initial IR: after: IR size 365: (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"maybeRefs\":{\"references\":[{\"name\":\"GRCh38\",\"contigs\":[\"chr1\",\"chr2\",\"chr3\",\"chr4\",\"chr5\",\"chr6\",\"chr7\",\"chr8\",\"chr9\",\"chr10\",\"chr11\",\"chr12\",\"chr13\",\"chr14\",\"chr15\",\"chr16\",\"chr17\",\"chr18\",\"chr19\",\"chr20\",\"chr21\",\"chr22\",\"chrX\",\"chrY\",\"chrM\",\"chr1_KI270706v1_random\",\"chr1_KI270707v1_random\",\"chr1_KI270708v1_random\",\"chr1_KI270709v1_random\",\"chr1_KI270710v1_random\",\"chr1_KI270711v1_random\",\"chr1_KI270712v1_random\",\"chr1_KI270713v1_random\",\"chr1_KI270714v1_random\",\"chr2_KI270715v1_random\",\"chr2_KI270716v1_random\",\"chr3_GL000221v1_random\",\"chr4_GL000008v2_random\",\"chr5_GL000208v1_random\",\"chr9_KI270717v1_random\",\"chr9_KI270718v1_random\",\"chr9_KI270719v1_random\",\"chr9_KI270720v1_random\",\"chr11_KI270721v1_random\",\"chr14_GL000009v2_random\",\"chr14_GL000225v1_random\",\"chr14_KI270722v1_r..." (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"overwrite\":false}" (Let __iruid_2109 (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows/parts/\"}" (ToStream False (Literal Array[Struct{s:String}] )) (Str "part-0")) (Let __iruid_2110 (CollectDistributedArray __iruid_2111 __iruid_2112 (StreamZip -1 AssertSameLength (__iruid_2113 __iruid_2114) (StreamZip -1 AssumeSameLength (__iruid_2115 __iruid_2116) (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Let __iruid_2117 (ToArray (StreamRange -1 False (I32 0) (I32 0) (I32 1))) (StreamMap __iruid_2118 (ToStream False (Literal Array[Struct{partitionBound:Interval[Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32]],parentPartitions:Array[Int32]}] )) (MakeStruct (partitionBound (GetField partitionBound (Ref __iruid_2118))) (oldContexts (ToArray (StreamMap __iruid_2119 (ToStream False (GetField parentPartitions (Ref __iruid_2118))) (ArrayRef -1 (Ref __iruid_2117) (Ref __iruid_2119)))))))) (MakeTuple (0 1) (Ref __iruid_2115) (Ref __iruid_2116))) (ToStream False (Literal Array[String] )) (MakeStruct (oldCtx (Ref __iruid_2113)) (writeCtx (Ref __iruid_2114)))) (Literal Struct{} ) (WritePartition "{\"spec1\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix1\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows/parts/\",\"spec2\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix2\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows/parts/\",\"keyFieldNames\":[\"locus\",\"alleles\"],\"index\":{\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/index/\":\"+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}\"}}" (Let __iruid_2120 (GetField oldCtx (Ref __iruid_2111)) (StreamMap __iruid_2121 (StreamMultiMerge (locus alleles) (StreamFlatMap __iruid_2122 (StreamFlatMap __iruid_2123 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetTupleElement 0 (Ref __iruid_2120)))) (StreamMap __iruid_2124 (ToStream False (ArraySort __iruid_2125 __iruid_2126 (Ref __iruid_2123) (ApplyComparisonOp LT (Ref __iruid_2125) (Ref __iruid_2126)))) (InsertFields (Let __iruid_2127 (GetField alleles (Ref __iruid_2124)) (Let __iruid_2128 (GetField locus (Ref __iruid_2124)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_2124)) None (__uid_3 (ArraySort __iruid_2129 __iruid_2130 (StreamFlatMap __iruid_2131 (StreamFilter __iruid_2132 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_2127)) (I32 1)) (ApplyComparisonOp NEQ (ApplyIR 2 indexArray () String (Ref __iruid_2127) (Ref __iruid_2132)) (Str "*"))) (ToStream False (Let __iruid_2133 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_2128) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_2127) (I32 0)) (ApplyIR 7 indexArray () String (Ref __iruid_2127) (Ref __iruid_2131)))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_2133)) (Ref __iruid_2128)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_2133))) (locus (GetField locus (Ref __iruid_2133))) (a_index (Ref __iruid_2131)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_2124))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_2129)) (False) (If (IsNA (Ref __iruid_2130)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_2129) (Ref __iruid_2130)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_2124)))))) (StreamMap __iruid_2134 (ToStream False (GetField __uid_3 (Ref __iruid_2122))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_2122)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_2134))) (alleles (GetField alleles (Ref __iruid_2134))) (a_index (GetField a_index (Ref __iruid_2134))) (was_split (GetField was_split (Ref __iruid_2134))) (old_alleles (GetField alleles (Ref __iruid_2122)))))) (Let __iruid_2135 (GetTupleElement 1 (Ref __iruid_2120)) (Let __iruid_2136 (GetField partitionBound (Ref __iruid_2135)) (StreamTakeWhile __iruid_2137 (StreamDropWhile __iruid_2138 (StreamFlatMap __iruid_2139 (ToStream True (GetField oldContexts (Ref __iruid_2135))) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean,old_alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "\"\"" (Ref __iruid_2139))) (Apply -1 pointLessThanPartitionIntervalLeftEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_2138)) (ApplySpecial -1 start () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_2136)) (Apply -1 includesStart () Boolean (Ref __iruid_2136)))) (Apply -1 pointLessThanPartitionIntervalRightEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_2137)) (ApplySpecial -1 end () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_2136)) (Apply -1 includesEnd () Boolean (Ref __iruid_2136))))))) (MakeStruct (locus (GetField locus (Ref __iruid_2121))) (alleles (GetField alleles (Ref __iruid_2121))) (rsid (GetField rsid (Ref __iruid_2121))) (qual (GetField qual (Ref __iruid_2121))) (filters (GetField filters (Ref __iruid_2121))) (info (GetField info (Ref __iruid_2121))) (a_index (GetField a_index (Ref __iruid_2121))) (was_split (GetField was_split (Ref __iruid_2121))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_2140 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_2121))) (Let __iruid_2141 (If (IsNA (GetField PL (Ref __iruid_2140))) (NA Array[Int32]) (ToArray (StreamMap __iruid_2142 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_2147 __iruid_2148) __iruid_2143 (StreamFilter __iruid_2144 (StreamMap __iruid_2145 (StreamFilter __iruid_2146 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref __iruid_2121)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_2146)) (GetField a_index (Ref __iruid_2121)))) (Ref __iruid_2142))) (ApplyIR 25 indexArray () Int32 (GetField PL (Ref __iruid_2140)) (Ref __iruid_2145))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_2144)))) (NA Int32) (True) (If (Ref __iruid_2148) (Ref __iruid_2143) (If (ApplyComparisonOp LT (Ref __iruid_2147) (Ref __iruid_2143)) (Ref __iruid_2147) (Ref __iruid_2143))) (False) (Ref __iruid_2147))))) (InsertFields (Ref __iruid_2140) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_2140)) (GetField a_index (Ref __iruid_2121)))) (DP (GetField DP (Ref __iruid_2140))) (AD (If (IsNA (GetField AD (Ref __iruid_2140))) (NA Array[Int32]) (Let __iruid_2149 (GetField AD (Ref __iruid_2140)) (Let __iruid_2150 (GetField a_index (Ref __iruid_2121)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_2151 __iruid_2152 (StreamFilter __iruid_2153 (ToStream False (Ref __iruid_2149)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_2153)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_2151) (Ref __iruid_2152))) (ApplyIR 17 indexArray () Int32 (Ref __iruid_2149) (Ref __iruid_2150))) (ApplyIR 18 indexArray () Int32 (Ref __iruid_2149) (Ref __iruid_2150))))))) (PL (Ref __iruid_2141)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_2141)) (GetField GQ (Ref __iruid_2140)))))))))))) (Apply -1 concat () String (GetField writeCtx (Ref __iruid_2111)) (UUID4 __iruid_1196)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"typ\":{\"rowType\":\"Struct{}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"globals\",\"refRelPath\":\"../references\",\"log\":false}" (Literal Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] )) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (Ref __iruid_2109)))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"typ\":{\"rowType\":\"Struct{s:String}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_2109)))) (Let __iruid_2154 (ToArray (StreamMap __iruid_2155 (ToStream False (Ref __iruid_2110)) (GetField filePath (Ref __iruid_2155)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\"..." (Ref __iruid_2154)) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\"..." (Ref __iruid_2154)))) (Let __iruid_2156 (ToArray (StreamMap __iruid_2157 (ToStream False (Ref __iruid_2110)) (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_2157)))) (Begin (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"key\":[\"locus\",\"alleles\"],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (Ref __iruid_2156)) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"typ\":{\"rowType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (ToArray (StreamMap __iruid_2158 (ToStream False (Ref __iruid_2156)) (InsertFields (SelectFields (partitionCounts distinctlyKeyed) (Ref __iruid_2158)) None (firstKey (Literal Struct{} )) (lastKey (Literal Struct{} )))))) (WriteMetadata "{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"typ\":{\"globalType\":\"Struct{}\",\"colKey\":[\"s\"],\"colType\":\"Struct{s:String}\",\"rowKey\":[\"locus\",\"alleles\"],\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"entryType\":\"Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}\"},\"rowRelPath\":\"rows/rows\",\"globalRelPath\":\"globals/rows\",\"colRelPath\":\"cols/rows\",\"entryRelPath\":\"entries/rows\",\"refRelPath\":\"references\",\"log\":true}" (MakeStruct (cols (GetField partitionCounts (Ref __iruid_2109))) (rows (ToArray (StreamMap __iruid_2159 (ToStream False (Ref __iruid_2156)) (GetField partitionCounts (Ref __iruid_2159))))))))))))))))) 2023-02-10 11:12:04 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: before: IR size 425: (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"maybeRefs\":{\"references\":[{\"name\":\"GRCh38\",\"contigs\":[\"chr1\",\"chr2\",\"chr3\",\"chr4\",\"chr5\",\"chr6\",\"chr7\",\"chr8\",\"chr9\",\"chr10\",\"chr11\",\"chr12\",\"chr13\",\"chr14\",\"chr15\",\"chr16\",\"chr17\",\"chr18\",\"chr19\",\"chr20\",\"chr21\",\"chr22\",\"chrX\",\"chrY\",\"chrM\",\"chr1_KI270706v1_random\",\"chr1_KI270707v1_random\",\"chr1_KI270708v1_random\",\"chr1_KI270709v1_random\",\"chr1_KI270710v1_random\",\"chr1_KI270711v1_random\",\"chr1_KI270712v1_random\",\"chr1_KI270713v1_random\",\"chr1_KI270714v1_random\",\"chr2_KI270715v1_random\",\"chr2_KI270716v1_random\",\"chr3_GL000221v1_random\",\"chr4_GL000008v2_random\",\"chr5_GL000208v1_random\",\"chr9_KI270717v1_random\",\"chr9_KI270718v1_random\",\"chr9_KI270719v1_random\",\"chr9_KI270720v1_random\",\"chr11_KI270721v1_random\",\"chr14_GL000009v2_random\",\"chr14_GL000225v1_random\",\"chr14_KI270722v1_r..." (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"overwrite\":false}" (Let __iruid_2109 (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows/parts/\"}" (ToStream False (Literal Array[Struct{s:String}] )) (Str "part-0")) (Let __iruid_2110 (CollectDistributedArray __iruid_2111 __iruid_2112 (StreamZip -1 AssertSameLength (__iruid_2113 __iruid_2114) (StreamZip -1 AssumeSameLength (__iruid_2115 __iruid_2116) (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Let __iruid_2117 (ToArray (StreamRange -1 False (I32 0) (I32 0) (I32 1))) (StreamMap __iruid_2118 (ToStream False (Literal Array[Struct{partitionBound:Interval[Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32]],parentPartitions:Array[Int32]}] )) (MakeStruct (partitionBound (GetField partitionBound (Ref __iruid_2118))) (oldContexts (ToArray (StreamMap __iruid_2119 (ToStream False (GetField parentPartitions (Ref __iruid_2118))) (ArrayRef -1 (Ref __iruid_2117) (Ref __iruid_2119)))))))) (MakeTuple (0 1) (Ref __iruid_2115) (Ref __iruid_2116))) (ToStream False (Literal Array[String] )) (MakeStruct (oldCtx (Ref __iruid_2113)) (writeCtx (Ref __iruid_2114)))) (Literal Struct{} ) (WritePartition "{\"spec1\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix1\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows/parts/\",\"spec2\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix2\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows/parts/\",\"keyFieldNames\":[\"locus\",\"alleles\"],\"index\":{\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/index/\":\"+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}\"}}" (Let __iruid_2120 (GetField oldCtx (Ref __iruid_2111)) (StreamMap __iruid_2121 (StreamMultiMerge (locus alleles) (StreamFlatMap __iruid_2122 (StreamFlatMap __iruid_2123 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetTupleElement 0 (Ref __iruid_2120)))) (StreamMap __iruid_2124 (ToStream False (ArraySort __iruid_2125 __iruid_2126 (Ref __iruid_2123) (ApplyComparisonOp LT (Ref __iruid_2125) (Ref __iruid_2126)))) (InsertFields (Let __iruid_2127 (GetField alleles (Ref __iruid_2124)) (Let __iruid_2128 (GetField locus (Ref __iruid_2124)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_2124)) None (__uid_3 (ArraySort __iruid_2129 __iruid_2130 (StreamFlatMap __iruid_2131 (StreamFilter __iruid_2132 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_2127)) (I32 1)) (ApplyComparisonOp NEQ (Let __iruid_2176 (Ref __iruid_2127) (Let __iruid_2177 (Ref __iruid_2132) (ArrayRef 2 (Ref __iruid_2176) (If (ApplyComparisonOp LT (Ref __iruid_2177) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2176)) (Ref __iruid_2177)) (Ref __iruid_2177))))) (Str "*"))) (ToStream False (Let __iruid_2133 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_2128) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_2127) (I32 0)) (Let __iruid_2168 (Ref __iruid_2127) (Let __iruid_2169 (Ref __iruid_2131) (ArrayRef 7 (Ref __iruid_2168) (If (ApplyComparisonOp LT (Ref __iruid_2169) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2168)) (Ref __iruid_2169)) (Ref __iruid_2169))))))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_2133)) (Ref __iruid_2128)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_2133))) (locus (GetField locus (Ref __iruid_2133))) (a_index (Ref __iruid_2131)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_2124))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_2129)) (False) (If (IsNA (Ref __iruid_2130)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_2129) (Ref __iruid_2130)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_2124)))))) (StreamMap __iruid_2134 (ToStream False (GetField __uid_3 (Ref __iruid_2122))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_2122)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_2134))) (alleles (GetField alleles (Ref __iruid_2134))) (a_index (GetField a_index (Ref __iruid_2134))) (was_split (GetField was_split (Ref __iruid_2134))) (old_alleles (GetField alleles (Ref __iruid_2122)))))) (Let __iruid_2135 (GetTupleElement 1 (Ref __iruid_2120)) (Let __iruid_2136 (GetField partitionBound (Ref __iruid_2135)) (StreamTakeWhile __iruid_2137 (StreamDropWhile __iruid_2138 (StreamFlatMap __iruid_2139 (ToStream True (GetField oldContexts (Ref __iruid_2135))) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean,old_alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "\"\"" (Ref __iruid_2139))) (Apply -1 pointLessThanPartitionIntervalLeftEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_2138)) (ApplySpecial -1 start () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_2136)) (Apply -1 includesStart () Boolean (Ref __iruid_2136)))) (Apply -1 pointLessThanPartitionIntervalRightEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_2137)) (ApplySpecial -1 end () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_2136)) (Apply -1 includesEnd () Boolean (Ref __iruid_2136))))))) (MakeStruct (locus (GetField locus (Ref __iruid_2121))) (alleles (GetField alleles (Ref __iruid_2121))) (rsid (GetField rsid (Ref __iruid_2121))) (qual (GetField qual (Ref __iruid_2121))) (filters (GetField filters (Ref __iruid_2121))) (info (GetField info (Ref __iruid_2121))) (a_index (GetField a_index (Ref __iruid_2121))) (was_split (GetField was_split (Ref __iruid_2121))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_2140 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_2121))) (Let __iruid_2141 (If (IsNA (GetField PL (Ref __iruid_2140))) (NA Array[Int32]) (ToArray (StreamMap __iruid_2142 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_2147 __iruid_2148) __iruid_2143 (StreamFilter __iruid_2144 (StreamMap __iruid_2145 (StreamFilter __iruid_2146 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref __iruid_2121)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_2146)) (GetField a_index (Ref __iruid_2121)))) (Ref __iruid_2142))) (Let __iruid_2170 (GetField PL (Ref __iruid_2140)) (Let __iruid_2171 (Ref __iruid_2145) (ArrayRef 25 (Ref __iruid_2170) (If (ApplyComparisonOp LT (Ref __iruid_2171) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2170)) (Ref __iruid_2171)) (Ref __iruid_2171)))))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_2144)))) (NA Int32) (True) (If (Ref __iruid_2148) (Ref __iruid_2143) (If (ApplyComparisonOp LT (Ref __iruid_2147) (Ref __iruid_2143)) (Ref __iruid_2147) (Ref __iruid_2143))) (False) (Ref __iruid_2147))))) (InsertFields (Ref __iruid_2140) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_2140)) (GetField a_index (Ref __iruid_2121)))) (DP (GetField DP (Ref __iruid_2140))) (AD (If (IsNA (GetField AD (Ref __iruid_2140))) (NA Array[Int32]) (Let __iruid_2149 (GetField AD (Ref __iruid_2140)) (Let __iruid_2150 (GetField a_index (Ref __iruid_2121)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_2151 __iruid_2152 (StreamFilter __iruid_2153 (ToStream False (Ref __iruid_2149)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_2153)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_2151) (Ref __iruid_2152))) (Let __iruid_2172 (Ref __iruid_2149) (Let __iruid_2173 (Ref __iruid_2150) (ArrayRef 17 (Ref __iruid_2172) (If (ApplyComparisonOp LT (Ref __iruid_2173) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2172)) (Ref __iruid_2173)) (Ref __iruid_2173)))))) (Let __iruid_2174 (Ref __iruid_2149) (Let __iruid_2175 (Ref __iruid_2150) (ArrayRef 18 (Ref __iruid_2174) (If (ApplyComparisonOp LT (Ref __iruid_2175) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2174)) (Ref __iruid_2175)) (Ref __iruid_2175)))))))))) (PL (Ref __iruid_2141)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_2141)) (GetField GQ (Ref __iruid_2140)))))))))))) (Apply -1 concat () String (GetField writeCtx (Ref __iruid_2111)) (UUID4 __iruid_1196)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"typ\":{\"rowType\":\"Struct{}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"globals\",\"refRelPath\":\"../references\",\"log\":false}" (Literal Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] )) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (Ref __iruid_2109)))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"typ\":{\"rowType\":\"Struct{s:String}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_2109)))) (Let __iruid_2154 (ToArray (StreamMap __iruid_2155 (ToStream False (Ref __iruid_2110)) (GetField filePath (Ref __iruid_2155)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\"..." (Ref __iruid_2154)) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\"..." (Ref __iruid_2154)))) (Let __iruid_2156 (ToArray (StreamMap __iruid_2157 (ToStream False (Ref __iruid_2110)) (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_2157)))) (Begin (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"key\":[\"locus\",\"alleles\"],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (Ref __iruid_2156)) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"typ\":{\"rowType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (ToArray (StreamMap __iruid_2158 (ToStream False (Ref __iruid_2156)) (InsertFields (SelectFields (partitionCounts distinctlyKeyed) (Ref __iruid_2158)) None (firstKey (Literal Struct{} )) (lastKey (Literal Struct{} )))))) (WriteMetadata "{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"typ\":{\"globalType\":\"Struct{}\",\"colKey\":[\"s\"],\"colType\":\"Struct{s:String}\",\"rowKey\":[\"locus\",\"alleles\"],\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"entryType\":\"Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}\"},\"rowRelPath\":\"rows/rows\",\"globalRelPath\":\"globals/rows\",\"colRelPath\":\"cols/rows\",\"entryRelPath\":\"entries/rows\",\"refRelPath\":\"references\",\"log\":true}" (MakeStruct (cols (GetField partitionCounts (Ref __iruid_2109))) (rows (ToArray (StreamMap __iruid_2159 (ToStream False (Ref __iruid_2156)) (GetField partitionCounts (Ref __iruid_2159))))))))))))))))) 2023-02-10 11:12:04 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: after: IR size 407: (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"maybeRefs\":{\"references\":[{\"name\":\"GRCh38\",\"contigs\":[\"chr1\",\"chr2\",\"chr3\",\"chr4\",\"chr5\",\"chr6\",\"chr7\",\"chr8\",\"chr9\",\"chr10\",\"chr11\",\"chr12\",\"chr13\",\"chr14\",\"chr15\",\"chr16\",\"chr17\",\"chr18\",\"chr19\",\"chr20\",\"chr21\",\"chr22\",\"chrX\",\"chrY\",\"chrM\",\"chr1_KI270706v1_random\",\"chr1_KI270707v1_random\",\"chr1_KI270708v1_random\",\"chr1_KI270709v1_random\",\"chr1_KI270710v1_random\",\"chr1_KI270711v1_random\",\"chr1_KI270712v1_random\",\"chr1_KI270713v1_random\",\"chr1_KI270714v1_random\",\"chr2_KI270715v1_random\",\"chr2_KI270716v1_random\",\"chr3_GL000221v1_random\",\"chr4_GL000008v2_random\",\"chr5_GL000208v1_random\",\"chr9_KI270717v1_random\",\"chr9_KI270718v1_random\",\"chr9_KI270719v1_random\",\"chr9_KI270720v1_random\",\"chr11_KI270721v1_random\",\"chr14_GL000009v2_random\",\"chr14_GL000225v1_random\",\"chr14_KI270722v1_r..." (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"overwrite\":false}" (Let __iruid_2291 (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows/parts/\"}" (ToStream False (Literal Array[Struct{s:String}] )) (Str "part-0")) (Let __iruid_2292 (CollectDistributedArray __iruid_2293 __iruid_2294 (StreamZip -1 AssertSameLength (__iruid_2295 __iruid_2296) (StreamZip -1 AssumeSameLength (__iruid_2297 __iruid_2298) (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Let __iruid_2299 (ToArray (StreamRange -1 False (I32 0) (I32 0) (I32 1))) (StreamMap __iruid_2300 (ToStream False (Literal Array[Struct{partitionBound:Interval[Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32]],parentPartitions:Array[Int32]}] )) (MakeStruct (partitionBound (GetField partitionBound (Ref __iruid_2300))) (oldContexts (ToArray (StreamMap __iruid_2301 (ToStream False (GetField parentPartitions (Ref __iruid_2300))) (ArrayRef -1 (Ref __iruid_2299) (Ref __iruid_2301)))))))) (MakeTuple (0 1) (Ref __iruid_2297) (Ref __iruid_2298))) (ToStream False (Literal Array[String] )) (MakeStruct (oldCtx (Ref __iruid_2295)) (writeCtx (Ref __iruid_2296)))) (Literal Struct{} ) (WritePartition "{\"spec1\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix1\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows/parts/\",\"spec2\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix2\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows/parts/\",\"keyFieldNames\":[\"locus\",\"alleles\"],\"index\":{\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/index/\":\"+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}\"}}" (Let __iruid_2302 (GetField oldCtx (Ref __iruid_2293)) (StreamMap __iruid_2303 (StreamMultiMerge (locus alleles) (StreamFlatMap __iruid_2304 (StreamFlatMap __iruid_2305 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetTupleElement 0 (Ref __iruid_2302)))) (StreamMap __iruid_2306 (ToStream False (ArraySort __iruid_2307 __iruid_2308 (Ref __iruid_2305) (ApplyComparisonOp LT (Ref __iruid_2307) (Ref __iruid_2308)))) (InsertFields (Let __iruid_2309 (GetField alleles (Ref __iruid_2306)) (Let __iruid_2310 (GetField locus (Ref __iruid_2306)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_2306)) None (__uid_3 (ArraySort __iruid_2311 __iruid_2312 (StreamFlatMap __iruid_2313 (StreamFilter __iruid_2314 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_2309)) (I32 1)) (ApplyComparisonOp NEQ (ArrayRef 2 (Ref __iruid_2309) (If (ApplyComparisonOp LT (Ref __iruid_2314) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2309)) (Ref __iruid_2314)) (Ref __iruid_2314))) (Str "*"))) (ToStream False (Let __iruid_2315 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_2310) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_2309) (I32 0)) (ArrayRef 7 (Ref __iruid_2309) (If (ApplyComparisonOp LT (Ref __iruid_2313) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2309)) (Ref __iruid_2313)) (Ref __iruid_2313))))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_2315)) (Ref __iruid_2310)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_2315))) (locus (GetField locus (Ref __iruid_2315))) (a_index (Ref __iruid_2313)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_2306))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_2311)) (False) (If (IsNA (Ref __iruid_2312)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_2311) (Ref __iruid_2312)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_2306)))))) (StreamMap __iruid_2316 (ToStream False (GetField __uid_3 (Ref __iruid_2304))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_2304)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_2316))) (alleles (GetField alleles (Ref __iruid_2316))) (a_index (GetField a_index (Ref __iruid_2316))) (was_split (GetField was_split (Ref __iruid_2316))) (old_alleles (GetField alleles (Ref __iruid_2304)))))) (Let __iruid_2317 (GetTupleElement 1 (Ref __iruid_2302)) (Let __iruid_2318 (GetField partitionBound (Ref __iruid_2317)) (StreamTakeWhile __iruid_2319 (StreamDropWhile __iruid_2320 (StreamFlatMap __iruid_2321 (ToStream True (GetField oldContexts (Ref __iruid_2317))) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean,old_alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "\"\"" (Ref __iruid_2321))) (Apply -1 pointLessThanPartitionIntervalLeftEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_2320)) (ApplySpecial -1 start () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_2318)) (Apply -1 includesStart () Boolean (Ref __iruid_2318)))) (Apply -1 pointLessThanPartitionIntervalRightEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_2319)) (ApplySpecial -1 end () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_2318)) (Apply -1 includesEnd () Boolean (Ref __iruid_2318))))))) (MakeStruct (locus (GetField locus (Ref __iruid_2303))) (alleles (GetField alleles (Ref __iruid_2303))) (rsid (GetField rsid (Ref __iruid_2303))) (qual (GetField qual (Ref __iruid_2303))) (filters (GetField filters (Ref __iruid_2303))) (info (GetField info (Ref __iruid_2303))) (a_index (GetField a_index (Ref __iruid_2303))) (was_split (GetField was_split (Ref __iruid_2303))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_2322 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_2303))) (Let __iruid_2323 (If (IsNA (GetField PL (Ref __iruid_2322))) (NA Array[Int32]) (ToArray (StreamMap __iruid_2324 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_2330 __iruid_2331) __iruid_2325 (StreamFilter __iruid_2326 (StreamMap __iruid_2327 (StreamFilter __iruid_2328 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref __iruid_2303)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_2328)) (GetField a_index (Ref __iruid_2303)))) (Ref __iruid_2324))) (Let __iruid_2329 (GetField PL (Ref __iruid_2322)) (ArrayRef 25 (Ref __iruid_2329) (If (ApplyComparisonOp LT (Ref __iruid_2327) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2329)) (Ref __iruid_2327)) (Ref __iruid_2327))))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_2326)))) (NA Int32) (True) (If (Ref __iruid_2331) (Ref __iruid_2325) (If (ApplyComparisonOp LT (Ref __iruid_2330) (Ref __iruid_2325)) (Ref __iruid_2330) (Ref __iruid_2325))) (False) (Ref __iruid_2330))))) (InsertFields (Ref __iruid_2322) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_2322)) (GetField a_index (Ref __iruid_2303)))) (DP (GetField DP (Ref __iruid_2322))) (AD (If (IsNA (GetField AD (Ref __iruid_2322))) (NA Array[Int32]) (Let __iruid_2332 (GetField AD (Ref __iruid_2322)) (Let __iruid_2333 (GetField a_index (Ref __iruid_2303)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_2334 __iruid_2335 (StreamFilter __iruid_2336 (ToStream False (Ref __iruid_2332)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_2336)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_2334) (Ref __iruid_2335))) (ArrayRef 17 (Ref __iruid_2332) (If (ApplyComparisonOp LT (Ref __iruid_2333) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2332)) (Ref __iruid_2333)) (Ref __iruid_2333)))) (ArrayRef 18 (Ref __iruid_2332) (If (ApplyComparisonOp LT (Ref __iruid_2333) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2332)) (Ref __iruid_2333)) (Ref __iruid_2333)))))))) (PL (Ref __iruid_2323)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_2323)) (GetField GQ (Ref __iruid_2322)))))))))))) (Apply -1 concat () String (GetField writeCtx (Ref __iruid_2293)) (UUID4 __iruid_1196)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"typ\":{\"rowType\":\"Struct{}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"globals\",\"refRelPath\":\"../references\",\"log\":false}" (Literal Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] )) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (Ref __iruid_2291)))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"typ\":{\"rowType\":\"Struct{s:String}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_2291)))) (Let __iruid_2337 (ToArray (StreamMap __iruid_2338 (ToStream False (Ref __iruid_2292)) (GetField filePath (Ref __iruid_2338)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\"..." (Ref __iruid_2337)) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\"..." (Ref __iruid_2337)))) (Let __iruid_2339 (ToArray (StreamMap __iruid_2340 (ToStream False (Ref __iruid_2292)) (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_2340)))) (Begin (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"key\":[\"locus\",\"alleles\"],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (Ref __iruid_2339)) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"typ\":{\"rowType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (ToArray (StreamMap __iruid_2341 (ToStream False (Ref __iruid_2339)) (InsertFields (SelectFields (partitionCounts distinctlyKeyed) (Ref __iruid_2341)) None (firstKey (Literal Struct{} )) (lastKey (Literal Struct{} )))))) (WriteMetadata "{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"typ\":{\"globalType\":\"Struct{}\",\"colKey\":[\"s\"],\"colType\":\"Struct{s:String}\",\"rowKey\":[\"locus\",\"alleles\"],\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"entryType\":\"Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}\"},\"rowRelPath\":\"rows/rows\",\"globalRelPath\":\"globals/rows\",\"colRelPath\":\"cols/rows\",\"entryRelPath\":\"entries/rows\",\"refRelPath\":\"references\",\"log\":true}" (MakeStruct (cols (GetField partitionCounts (Ref __iruid_2291))) (rows (ToArray (StreamMap __iruid_2342 (ToStream False (Ref __iruid_2339)) (GetField partitionCounts (Ref __iruid_2342))))))))))))))))) 2023-02-10 11:12:04 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: before: IR size 407: (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"maybeRefs\":{\"references\":[{\"name\":\"GRCh38\",\"contigs\":[\"chr1\",\"chr2\",\"chr3\",\"chr4\",\"chr5\",\"chr6\",\"chr7\",\"chr8\",\"chr9\",\"chr10\",\"chr11\",\"chr12\",\"chr13\",\"chr14\",\"chr15\",\"chr16\",\"chr17\",\"chr18\",\"chr19\",\"chr20\",\"chr21\",\"chr22\",\"chrX\",\"chrY\",\"chrM\",\"chr1_KI270706v1_random\",\"chr1_KI270707v1_random\",\"chr1_KI270708v1_random\",\"chr1_KI270709v1_random\",\"chr1_KI270710v1_random\",\"chr1_KI270711v1_random\",\"chr1_KI270712v1_random\",\"chr1_KI270713v1_random\",\"chr1_KI270714v1_random\",\"chr2_KI270715v1_random\",\"chr2_KI270716v1_random\",\"chr3_GL000221v1_random\",\"chr4_GL000008v2_random\",\"chr5_GL000208v1_random\",\"chr9_KI270717v1_random\",\"chr9_KI270718v1_random\",\"chr9_KI270719v1_random\",\"chr9_KI270720v1_random\",\"chr11_KI270721v1_random\",\"chr14_GL000009v2_random\",\"chr14_GL000225v1_random\",\"chr14_KI270722v1_r..." (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"overwrite\":false}" (Let __iruid_2291 (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows/parts/\"}" (ToStream False (Literal Array[Struct{s:String}] )) (Str "part-0")) (Let __iruid_2292 (CollectDistributedArray __iruid_2293 __iruid_2294 (StreamZip -1 AssertSameLength (__iruid_2295 __iruid_2296) (StreamZip -1 AssumeSameLength (__iruid_2297 __iruid_2298) (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Let __iruid_2299 (ToArray (StreamRange -1 False (I32 0) (I32 0) (I32 1))) (StreamMap __iruid_2300 (ToStream False (Literal Array[Struct{partitionBound:Interval[Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32]],parentPartitions:Array[Int32]}] )) (MakeStruct (partitionBound (GetField partitionBound (Ref __iruid_2300))) (oldContexts (ToArray (StreamMap __iruid_2301 (ToStream False (GetField parentPartitions (Ref __iruid_2300))) (ArrayRef -1 (Ref __iruid_2299) (Ref __iruid_2301)))))))) (MakeTuple (0 1) (Ref __iruid_2297) (Ref __iruid_2298))) (ToStream False (Literal Array[String] )) (MakeStruct (oldCtx (Ref __iruid_2295)) (writeCtx (Ref __iruid_2296)))) (Literal Struct{} ) (WritePartition "{\"spec1\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix1\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows/parts/\",\"spec2\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix2\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows/parts/\",\"keyFieldNames\":[\"locus\",\"alleles\"],\"index\":{\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/index/\":\"+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}\"}}" (Let __iruid_2302 (GetField oldCtx (Ref __iruid_2293)) (StreamMap __iruid_2303 (StreamMultiMerge (locus alleles) (StreamFlatMap __iruid_2304 (StreamFlatMap __iruid_2305 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetTupleElement 0 (Ref __iruid_2302)))) (StreamMap __iruid_2306 (ToStream False (ArraySort __iruid_2307 __iruid_2308 (Ref __iruid_2305) (ApplyComparisonOp LT (Ref __iruid_2307) (Ref __iruid_2308)))) (InsertFields (Let __iruid_2309 (GetField alleles (Ref __iruid_2306)) (Let __iruid_2310 (GetField locus (Ref __iruid_2306)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_2306)) None (__uid_3 (ArraySort __iruid_2311 __iruid_2312 (StreamFlatMap __iruid_2313 (StreamFilter __iruid_2314 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_2309)) (I32 1)) (ApplyComparisonOp NEQ (ArrayRef 2 (Ref __iruid_2309) (If (ApplyComparisonOp LT (Ref __iruid_2314) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2309)) (Ref __iruid_2314)) (Ref __iruid_2314))) (Str "*"))) (ToStream False (Let __iruid_2315 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_2310) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_2309) (I32 0)) (ArrayRef 7 (Ref __iruid_2309) (If (ApplyComparisonOp LT (Ref __iruid_2313) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2309)) (Ref __iruid_2313)) (Ref __iruid_2313))))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_2315)) (Ref __iruid_2310)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_2315))) (locus (GetField locus (Ref __iruid_2315))) (a_index (Ref __iruid_2313)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_2306))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_2311)) (False) (If (IsNA (Ref __iruid_2312)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_2311) (Ref __iruid_2312)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_2306)))))) (StreamMap __iruid_2316 (ToStream False (GetField __uid_3 (Ref __iruid_2304))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_2304)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_2316))) (alleles (GetField alleles (Ref __iruid_2316))) (a_index (GetField a_index (Ref __iruid_2316))) (was_split (GetField was_split (Ref __iruid_2316))) (old_alleles (GetField alleles (Ref __iruid_2304)))))) (Let __iruid_2317 (GetTupleElement 1 (Ref __iruid_2302)) (Let __iruid_2318 (GetField partitionBound (Ref __iruid_2317)) (StreamTakeWhile __iruid_2319 (StreamDropWhile __iruid_2320 (StreamFlatMap __iruid_2321 (ToStream True (GetField oldContexts (Ref __iruid_2317))) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean,old_alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "\"\"" (Ref __iruid_2321))) (Apply -1 pointLessThanPartitionIntervalLeftEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_2320)) (ApplySpecial -1 start () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_2318)) (Apply -1 includesStart () Boolean (Ref __iruid_2318)))) (Apply -1 pointLessThanPartitionIntervalRightEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_2319)) (ApplySpecial -1 end () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_2318)) (Apply -1 includesEnd () Boolean (Ref __iruid_2318))))))) (MakeStruct (locus (GetField locus (Ref __iruid_2303))) (alleles (GetField alleles (Ref __iruid_2303))) (rsid (GetField rsid (Ref __iruid_2303))) (qual (GetField qual (Ref __iruid_2303))) (filters (GetField filters (Ref __iruid_2303))) (info (GetField info (Ref __iruid_2303))) (a_index (GetField a_index (Ref __iruid_2303))) (was_split (GetField was_split (Ref __iruid_2303))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_2322 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_2303))) (Let __iruid_2323 (If (IsNA (GetField PL (Ref __iruid_2322))) (NA Array[Int32]) (ToArray (StreamMap __iruid_2324 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_2330 __iruid_2331) __iruid_2325 (StreamFilter __iruid_2326 (StreamMap __iruid_2327 (StreamFilter __iruid_2328 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref __iruid_2303)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_2328)) (GetField a_index (Ref __iruid_2303)))) (Ref __iruid_2324))) (Let __iruid_2329 (GetField PL (Ref __iruid_2322)) (ArrayRef 25 (Ref __iruid_2329) (If (ApplyComparisonOp LT (Ref __iruid_2327) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2329)) (Ref __iruid_2327)) (Ref __iruid_2327))))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_2326)))) (NA Int32) (True) (If (Ref __iruid_2331) (Ref __iruid_2325) (If (ApplyComparisonOp LT (Ref __iruid_2330) (Ref __iruid_2325)) (Ref __iruid_2330) (Ref __iruid_2325))) (False) (Ref __iruid_2330))))) (InsertFields (Ref __iruid_2322) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_2322)) (GetField a_index (Ref __iruid_2303)))) (DP (GetField DP (Ref __iruid_2322))) (AD (If (IsNA (GetField AD (Ref __iruid_2322))) (NA Array[Int32]) (Let __iruid_2332 (GetField AD (Ref __iruid_2322)) (Let __iruid_2333 (GetField a_index (Ref __iruid_2303)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_2334 __iruid_2335 (StreamFilter __iruid_2336 (ToStream False (Ref __iruid_2332)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_2336)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_2334) (Ref __iruid_2335))) (ArrayRef 17 (Ref __iruid_2332) (If (ApplyComparisonOp LT (Ref __iruid_2333) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2332)) (Ref __iruid_2333)) (Ref __iruid_2333)))) (ArrayRef 18 (Ref __iruid_2332) (If (ApplyComparisonOp LT (Ref __iruid_2333) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2332)) (Ref __iruid_2333)) (Ref __iruid_2333)))))))) (PL (Ref __iruid_2323)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_2323)) (GetField GQ (Ref __iruid_2322)))))))))))) (Apply -1 concat () String (GetField writeCtx (Ref __iruid_2293)) (UUID4 __iruid_1196)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"typ\":{\"rowType\":\"Struct{}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"globals\",\"refRelPath\":\"../references\",\"log\":false}" (Literal Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] )) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (Ref __iruid_2291)))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"typ\":{\"rowType\":\"Struct{s:String}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_2291)))) (Let __iruid_2337 (ToArray (StreamMap __iruid_2338 (ToStream False (Ref __iruid_2292)) (GetField filePath (Ref __iruid_2338)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\"..." (Ref __iruid_2337)) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\"..." (Ref __iruid_2337)))) (Let __iruid_2339 (ToArray (StreamMap __iruid_2340 (ToStream False (Ref __iruid_2292)) (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_2340)))) (Begin (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"key\":[\"locus\",\"alleles\"],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (Ref __iruid_2339)) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"typ\":{\"rowType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (ToArray (StreamMap __iruid_2341 (ToStream False (Ref __iruid_2339)) (InsertFields (SelectFields (partitionCounts distinctlyKeyed) (Ref __iruid_2341)) None (firstKey (Literal Struct{} )) (lastKey (Literal Struct{} )))))) (WriteMetadata "{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"typ\":{\"globalType\":\"Struct{}\",\"colKey\":[\"s\"],\"colType\":\"Struct{s:String}\",\"rowKey\":[\"locus\",\"alleles\"],\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"entryType\":\"Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}\"},\"rowRelPath\":\"rows/rows\",\"globalRelPath\":\"globals/rows\",\"colRelPath\":\"cols/rows\",\"entryRelPath\":\"entries/rows\",\"refRelPath\":\"references\",\"log\":true}" (MakeStruct (cols (GetField partitionCounts (Ref __iruid_2291))) (rows (ToArray (StreamMap __iruid_2342 (ToStream False (Ref __iruid_2339)) (GetField partitionCounts (Ref __iruid_2342))))))))))))))))) 2023-02-10 11:12:04 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: after: IR size 407: (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"overwrite\":true,\"maybeRefs\":{\"references\":[{\"name\":\"GRCh38\",\"contigs\":[\"chr1\",\"chr2\",\"chr3\",\"chr4\",\"chr5\",\"chr6\",\"chr7\",\"chr8\",\"chr9\",\"chr10\",\"chr11\",\"chr12\",\"chr13\",\"chr14\",\"chr15\",\"chr16\",\"chr17\",\"chr18\",\"chr19\",\"chr20\",\"chr21\",\"chr22\",\"chrX\",\"chrY\",\"chrM\",\"chr1_KI270706v1_random\",\"chr1_KI270707v1_random\",\"chr1_KI270708v1_random\",\"chr1_KI270709v1_random\",\"chr1_KI270710v1_random\",\"chr1_KI270711v1_random\",\"chr1_KI270712v1_random\",\"chr1_KI270713v1_random\",\"chr1_KI270714v1_random\",\"chr2_KI270715v1_random\",\"chr2_KI270716v1_random\",\"chr3_GL000221v1_random\",\"chr4_GL000008v2_random\",\"chr5_GL000208v1_random\",\"chr9_KI270717v1_random\",\"chr9_KI270718v1_random\",\"chr9_KI270719v1_random\",\"chr9_KI270720v1_random\",\"chr11_KI270721v1_random\",\"chr14_GL000009v2_random\",\"chr14_GL000225v1_random\",\"chr14_KI270722v1_r..." (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"overwrite\":false}" (WriteMetadata "{\"name\":\"RelationalWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"overwrite\":false}" (Let __iruid_2447 (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows/parts/\"}" (ToStream False (Literal Array[Struct{s:String}] )) (Str "part-0")) (Let __iruid_2448 (CollectDistributedArray __iruid_2449 __iruid_2450 (StreamZip -1 AssertSameLength (__iruid_2451 __iruid_2452) (StreamZip -1 AssumeSameLength (__iruid_2453 __iruid_2454) (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Let __iruid_2455 (ToArray (StreamRange -1 False (I32 0) (I32 0) (I32 1))) (StreamMap __iruid_2456 (ToStream False (Literal Array[Struct{partitionBound:Interval[Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32]],parentPartitions:Array[Int32]}] )) (MakeStruct (partitionBound (GetField partitionBound (Ref __iruid_2456))) (oldContexts (ToArray (StreamMap __iruid_2457 (ToStream False (GetField parentPartitions (Ref __iruid_2456))) (ArrayRef -1 (Ref __iruid_2455) (Ref __iruid_2457)))))))) (MakeTuple (0 1) (Ref __iruid_2453) (Ref __iruid_2454))) (ToStream False (Literal Array[String] )) (MakeStruct (oldCtx (Ref __iruid_2451)) (writeCtx (Ref __iruid_2452)))) (Literal Struct{} ) (WritePartition "{\"spec1\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix1\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows/parts/\",\"spec2\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"partPrefix2\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows/parts/\",\"keyFieldNames\":[\"locus\",\"alleles\"],\"index\":{\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/index/\":\"+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}\"}}" (Let __iruid_2458 (GetField oldCtx (Ref __iruid_2449)) (StreamMap __iruid_2459 (StreamMultiMerge (locus alleles) (StreamFlatMap __iruid_2460 (StreamFlatMap __iruid_2461 (StreamGroupByKey (locus) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (GetTupleElement 0 (Ref __iruid_2458)))) (StreamMap __iruid_2462 (ToStream False (ArraySort __iruid_2463 __iruid_2464 (Ref __iruid_2461) (ApplyComparisonOp LT (Ref __iruid_2463) (Ref __iruid_2464)))) (InsertFields (Let __iruid_2465 (GetField alleles (Ref __iruid_2462)) (Let __iruid_2466 (GetField locus (Ref __iruid_2462)) (InsertFields (SelectFields (alleles rsid qual filters info) (Ref __iruid_2462)) None (__uid_3 (ArraySort __iruid_2467 __iruid_2468 (StreamFlatMap __iruid_2469 (StreamFilter __iruid_2470 (StreamRange 1 False (I32 1) (ArrayLen (Ref __iruid_2465)) (I32 1)) (ApplyComparisonOp NEQ (ArrayRef 2 (Ref __iruid_2465) (If (ApplyComparisonOp LT (Ref __iruid_2470) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2465)) (Ref __iruid_2470)) (Ref __iruid_2470))) (Str "*"))) (ToStream False (Let __iruid_2471 (Apply 8 min_rep () Struct{locus:Locus(GRCh38),alleles:Array[String]} (Ref __iruid_2466) (MakeArray Array[String] (ArrayRef 6 (Ref __iruid_2465) (I32 0)) (ArrayRef 7 (Ref __iruid_2465) (If (ApplyComparisonOp LT (Ref __iruid_2469) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2465)) (Ref __iruid_2469)) (Ref __iruid_2469))))) (If (ApplyComparisonOp EQ (GetField locus (Ref __iruid_2471)) (Ref __iruid_2466)) (MakeArray Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}] (MakeStruct (alleles (GetField alleles (Ref __iruid_2471))) (locus (GetField locus (Ref __iruid_2471))) (a_index (Ref __iruid_2469)) (was_split (ApplyComparisonOp GT (ArrayLen (GetField alleles (Ref __iruid_2462))) (I32 2))))) (NA Array[Struct{alleles:Array[String],locus:Locus(GRCh38),a_index:Int32,was_split:Boolean}]))))) (If (IsNA (Ref __iruid_2467)) (False) (If (IsNA (Ref __iruid_2468)) (True) (ApplyComparisonOp LT (ApplyComparisonOp Compare (Ref __iruid_2467) (Ref __iruid_2468)) (I32 0))))))))) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_2462)))))) (StreamMap __iruid_2472 (ToStream False (GetField __uid_3 (Ref __iruid_2460))) (InsertFields (SelectFields (rsid qual filters info `the entries! [877f12a8827e18f61222c6c8c5fb04a8]`) (Ref __iruid_2460)) ("locus" "alleles" "rsid" "qual" "filters" "info" "a_index" "was_split" "old_alleles" "the entries! [877f12a8827e18f61222c6c8c5fb04a8]") (locus (GetField locus (Ref __iruid_2472))) (alleles (GetField alleles (Ref __iruid_2472))) (a_index (GetField a_index (Ref __iruid_2472))) (was_split (GetField was_split (Ref __iruid_2472))) (old_alleles (GetField alleles (Ref __iruid_2460)))))) (Let __iruid_2473 (GetTupleElement 1 (Ref __iruid_2458)) (Let __iruid_2474 (GetField partitionBound (Ref __iruid_2473)) (StreamTakeWhile __iruid_2475 (StreamDropWhile __iruid_2476 (StreamFlatMap __iruid_2477 (ToStream True (GetField oldContexts (Ref __iruid_2473))) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean,old_alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]} "\"\"" (Ref __iruid_2477))) (Apply -1 pointLessThanPartitionIntervalLeftEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_2476)) (ApplySpecial -1 start () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_2474)) (Apply -1 includesStart () Boolean (Ref __iruid_2474)))) (Apply -1 pointLessThanPartitionIntervalRightEndpoint () Boolean (SelectFields (locus alleles) (Ref __iruid_2475)) (ApplySpecial -1 end () Tuple[Struct{locus:Locus(GRCh38),alleles:Array[String]},Int32] (Ref __iruid_2474)) (Apply -1 includesEnd () Boolean (Ref __iruid_2474))))))) (MakeStruct (locus (GetField locus (Ref __iruid_2459))) (alleles (GetField alleles (Ref __iruid_2459))) (rsid (GetField rsid (Ref __iruid_2459))) (qual (GetField qual (Ref __iruid_2459))) (filters (GetField filters (Ref __iruid_2459))) (info (GetField info (Ref __iruid_2459))) (a_index (GetField a_index (Ref __iruid_2459))) (was_split (GetField was_split (Ref __iruid_2459))) (the entries! [877f12a8827e18f61222c6c8c5fb04a8] (ToArray (StreamMap __iruid_2478 (ToStream False (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref __iruid_2459))) (Let __iruid_2479 (If (IsNA (GetField PL (Ref __iruid_2478))) (NA Array[Int32]) (ToArray (StreamMap __iruid_2480 (StreamRange 19 False (I32 0) (I32 3) (I32 1)) (StreamFold2 (__iruid_2486 __iruid_2487) __iruid_2481 (StreamFilter __iruid_2482 (StreamMap __iruid_2483 (StreamFilter __iruid_2484 (StreamRange 21 False (I32 0) (Apply 20 triangle () Int32 (ArrayLen (GetField old_alleles (Ref __iruid_2459)))) (I32 1)) (ApplyComparisonOp EQ (Apply 24 unphasedDiploidGtIndex () Int32 (Apply 23 downcode () Call (Apply 22 UnphasedDiploidGtIndexCall () Call (Ref __iruid_2484)) (GetField a_index (Ref __iruid_2459)))) (Ref __iruid_2480))) (Let __iruid_2485 (GetField PL (Ref __iruid_2478)) (ArrayRef 25 (Ref __iruid_2485) (If (ApplyComparisonOp LT (Ref __iruid_2483) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2485)) (Ref __iruid_2483)) (Ref __iruid_2483))))) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_2482)))) (NA Int32) (True) (If (Ref __iruid_2487) (Ref __iruid_2481) (If (ApplyComparisonOp LT (Ref __iruid_2486) (Ref __iruid_2481)) (Ref __iruid_2486) (Ref __iruid_2481))) (False) (Ref __iruid_2486))))) (InsertFields (Ref __iruid_2478) None (GT (Apply 15 downcode () Call (GetField GT (Ref __iruid_2478)) (GetField a_index (Ref __iruid_2459)))) (DP (GetField DP (Ref __iruid_2478))) (AD (If (IsNA (GetField AD (Ref __iruid_2478))) (NA Array[Int32]) (Let __iruid_2488 (GetField AD (Ref __iruid_2478)) (Let __iruid_2489 (GetField a_index (Ref __iruid_2459)) (MakeArray Array[Int32] (ApplyBinaryPrimOp Subtract (StreamFold __iruid_2490 __iruid_2491 (StreamFilter __iruid_2492 (ToStream False (Ref __iruid_2488)) (ApplyUnaryPrimOp Bang (IsNA (Ref __iruid_2492)))) (I32 0) (ApplyBinaryPrimOp Add (Ref __iruid_2490) (Ref __iruid_2491))) (ArrayRef 17 (Ref __iruid_2488) (If (ApplyComparisonOp LT (Ref __iruid_2489) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2488)) (Ref __iruid_2489)) (Ref __iruid_2489)))) (ArrayRef 18 (Ref __iruid_2488) (If (ApplyComparisonOp LT (Ref __iruid_2489) (I32 0)) (ApplyBinaryPrimOp Add (ArrayLen (Ref __iruid_2488)) (Ref __iruid_2489)) (Ref __iruid_2489)))))))) (PL (Ref __iruid_2479)) (GQ (Coalesce (Apply 27 gqFromPL () Int32 (Ref __iruid_2479)) (GetField GQ (Ref __iruid_2478)))))))))))) (Apply -1 concat () String (GetField writeCtx (Ref __iruid_2449)) (UUID4 __iruid_1196)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/globals/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (WritePartition "{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals/rows/parts/\"}" (MakeStream Stream[Struct{}] False (Literal Struct{} )) (Str "part-0"))))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/globals\",\"typ\":{\"rowType\":\"Struct{}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"globals\",\"refRelPath\":\"../references\",\"log\":false}" (Literal Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] )) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"EBaseStruct{s:EBinary}\",\"_vType\":\"Struct{s:String}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}" (MakeArray Array[String] (GetField filePath (Ref __iruid_2447)))) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/cols\",\"typ\":{\"rowType\":\"Struct{s:String}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (MakeArray Array[Struct{partitionCounts:Int64,distinctlyKeyed:Boolean,firstKey:Struct{},lastKey:Struct{}}] (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_2447)))) (Let __iruid_2493 (ToArray (StreamMap __iruid_2494 (ToStream False (Ref __iruid_2448)) (GetField filePath (Ref __iruid_2494)))) (Begin (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:+EBaseStruct{contig:+EBinary,position:+EInt32},alleles:+EArray[+EBinary],rsid:EBinary,qual:EFloat64,filters:EArray[+EBinary],info:+EBaseStruct{AC:EArray[EInt32],AF:EArray[EFloat64],AN:EInt32,DP:EInt32,FS:EFloat64,MQ:EFloat64,MQRankSum:EFloat64,QD:EFloat64,ReadPosRankSum:EFloat64,SOR:EFloat64},a_index:+EInt32,was_split:+EBoolean}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\"..." (Ref __iruid_2493)) (WriteMetadata "{\"name\":\"RVDSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+EArray[+EBaseStruct{AD:EArray[EInt32],AF:EArray[+EFloat64],DP:EInt32,F1R2:EArray[+EInt32],F2R1:EArray[+EInt32],FT:EBinary,GP:EArray[+EFloat64],GQ:EInt32,GT:EInt32,MIN_DP:EInt32,PL:EArray[EInt32],PS:EInt32,SQ:EArray[+EFloat64]}]}\",\"_vType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\"..." (Ref __iruid_2493)))) (Let __iruid_2495 (ToArray (StreamMap __iruid_2496 (ToStream False (Ref __iruid_2448)) (SelectFields (partitionCounts distinctlyKeyed firstKey lastKey) (Ref __iruid_2496)))) (Begin (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/rows\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"key\":[\"locus\",\"alleles\"],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (Ref __iruid_2495)) (WriteMetadata "{\"name\":\"TableSpecWriter\",\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt/entries\",\"typ\":{\"rowType\":\"Struct{`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}]}\",\"key\":[],\"globalType\":\"Struct{}\"},\"rowRelPath\":\"rows\",\"globalRelPath\":\"../globals/rows\",\"refRelPath\":\"../references\",\"log\":false}" (ToArray (StreamMap __iruid_2497 (ToStream False (Ref __iruid_2495)) (InsertFields (SelectFields (partitionCounts distinctlyKeyed) (Ref __iruid_2497)) None (firstKey (Literal Struct{} )) (lastKey (Literal Struct{} )))))) (WriteMetadata "{\"path\":\"/home/hj7968/Hail/Inputs/dragne-wgs-test.mt\",\"typ\":{\"globalType\":\"Struct{}\",\"colKey\":[\"s\"],\"colType\":\"Struct{s:String}\",\"rowKey\":[\"locus\",\"alleles\"],\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],rsid:String,qual:Float64,filters:Set[String],info:Struct{AC:Array[Int32],AF:Array[Float64],AN:Int32,DP:Int32,FS:Float64,MQ:Float64,MQRankSum:Float64,QD:Float64,ReadPosRankSum:Float64,SOR:Float64},a_index:Int32,was_split:Boolean}\",\"entryType\":\"Struct{AD:Array[Int32],AF:Array[Float64],DP:Int32,F1R2:Array[Int32],F2R1:Array[Int32],FT:String,GP:Array[Float64],GQ:Int32,GT:Call,MIN_DP:Int32,PL:Array[Int32],PS:Int32,SQ:Array[Float64]}\"},\"rowRelPath\":\"rows/rows\",\"globalRelPath\":\"globals/rows\",\"colRelPath\":\"cols/rows\",\"entryRelPath\":\"entries/rows\",\"refRelPath\":\"references\",\"log\":true}" (MakeStruct (cols (GetField partitionCounts (Ref __iruid_2447))) (rows (ToArray (StreamMap __iruid_2498 (ToStream False (Ref __iruid_2495)) (GetField partitionCounts (Ref __iruid_2498))))))))))))))))) 2023-02-10 11:12:04 root: INFO: optimize optimize: compileLowerer, initial IR: before: IR size 1: (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString],rsid:PCString,qual:PFloat64,filters:PCSet[+PCString],info:+PCStruct{AC:PCArray[PInt32],AF:PCArray[PFloat64],AN:PInt32,DP:PInt32,FS:PFloat64,MQ:PFloat64,MQRankSum:PFloat64,QD:PFloat64,ReadPosRankSum:PFloat64,SOR:PFloat64},a_index:+PInt32,was_split:+PBoolean,old_alleles:+PCArray[+PCString],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+PCArray[+PCStruct{AD:PCArray[+PInt32],AF:PCArray[+PFloat64],DP:PInt32,F1R2:PCArray[+PInt32],F2R1:PCArray[+PInt32],FT:PCString,GP:PCArray[+PFloat64],GQ:PInt32,GT:PCCall,MIN_DP:PInt32,PL:PCArray[+PInt32],PS:PInt32,SQ:PCArray[+PFloat64]}]})) 0) 2023-02-10 11:12:04 root: INFO: optimize optimize: compileLowerer, initial IR: after: IR size 1: (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString],rsid:PCString,qual:PFloat64,filters:PCSet[+PCString],info:+PCStruct{AC:PCArray[PInt32],AF:PCArray[PFloat64],AN:PInt32,DP:PInt32,FS:PFloat64,MQ:PFloat64,MQRankSum:PFloat64,QD:PFloat64,ReadPosRankSum:PFloat64,SOR:PFloat64},a_index:+PInt32,was_split:+PBoolean,old_alleles:+PCArray[+PCString],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+PCArray[+PCStruct{AD:PCArray[+PInt32],AF:PCArray[+PFloat64],DP:PInt32,F1R2:PCArray[+PInt32],F2R1:PCArray[+PInt32],FT:PCString,GP:PCArray[+PFloat64],GQ:PInt32,GT:PCCall,MIN_DP:PInt32,PL:PCArray[+PInt32],PS:PInt32,SQ:PCArray[+PFloat64]}]})) 0) 2023-02-10 11:12:04 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: before: IR size 1: (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString],rsid:PCString,qual:PFloat64,filters:PCSet[+PCString],info:+PCStruct{AC:PCArray[PInt32],AF:PCArray[PFloat64],AN:PInt32,DP:PInt32,FS:PFloat64,MQ:PFloat64,MQRankSum:PFloat64,QD:PFloat64,ReadPosRankSum:PFloat64,SOR:PFloat64},a_index:+PInt32,was_split:+PBoolean,old_alleles:+PCArray[+PCString],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+PCArray[+PCStruct{AD:PCArray[+PInt32],AF:PCArray[+PFloat64],DP:PInt32,F1R2:PCArray[+PInt32],F2R1:PCArray[+PInt32],FT:PCString,GP:PCArray[+PFloat64],GQ:PInt32,GT:PCCall,MIN_DP:PInt32,PL:PCArray[+PInt32],PS:PInt32,SQ:PCArray[+PFloat64]}]})) 0) 2023-02-10 11:12:04 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: after: IR size 1: (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString],rsid:PCString,qual:PFloat64,filters:PCSet[+PCString],info:+PCStruct{AC:PCArray[PInt32],AF:PCArray[PFloat64],AN:PInt32,DP:PInt32,FS:PFloat64,MQ:PFloat64,MQRankSum:PFloat64,QD:PFloat64,ReadPosRankSum:PFloat64,SOR:PFloat64},a_index:+PInt32,was_split:+PBoolean,old_alleles:+PCArray[+PCString],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+PCArray[+PCStruct{AD:PCArray[+PInt32],AF:PCArray[+PFloat64],DP:PInt32,F1R2:PCArray[+PInt32],F2R1:PCArray[+PInt32],FT:PCString,GP:PCArray[+PFloat64],GQ:PInt32,GT:PCCall,MIN_DP:PInt32,PL:PCArray[+PInt32],PS:PInt32,SQ:PCArray[+PFloat64]}]})) 0) 2023-02-10 11:12:04 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: before: IR size 1: (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString],rsid:PCString,qual:PFloat64,filters:PCSet[+PCString],info:+PCStruct{AC:PCArray[PInt32],AF:PCArray[PFloat64],AN:PInt32,DP:PInt32,FS:PFloat64,MQ:PFloat64,MQRankSum:PFloat64,QD:PFloat64,ReadPosRankSum:PFloat64,SOR:PFloat64},a_index:+PInt32,was_split:+PBoolean,old_alleles:+PCArray[+PCString],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+PCArray[+PCStruct{AD:PCArray[+PInt32],AF:PCArray[+PFloat64],DP:PInt32,F1R2:PCArray[+PInt32],F2R1:PCArray[+PInt32],FT:PCString,GP:PCArray[+PFloat64],GQ:PInt32,GT:PCCall,MIN_DP:PInt32,PL:PCArray[+PInt32],PS:PInt32,SQ:PCArray[+PFloat64]}]})) 0) 2023-02-10 11:12:04 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: after: IR size 1: (In SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString],rsid:PCString,qual:PFloat64,filters:PCSet[+PCString],info:+PCStruct{AC:PCArray[PInt32],AF:PCArray[PFloat64],AN:PInt32,DP:PInt32,FS:PFloat64,MQ:PFloat64,MQRankSum:PFloat64,QD:PFloat64,ReadPosRankSum:PFloat64,SOR:PFloat64},a_index:+PInt32,was_split:+PBoolean,old_alleles:+PCArray[+PCString],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:+PCArray[+PCStruct{AD:PCArray[+PInt32],AF:PCArray[+PFloat64],DP:PInt32,F1R2:PCArray[+PInt32],F2R1:PCArray[+PInt32],FT:PCString,GP:PCArray[+PFloat64],GQ:PInt32,GT:PCCall,MIN_DP:PInt32,PL:PCArray[+PInt32],PS:PInt32,SQ:PCArray[+PFloat64]}]})) 0) 2023-02-10 11:12:04 root: INFO: instruction count: 3: __C2023HailClassLoaderContainer. 2023-02-10 11:12:04 root: INFO: instruction count: 3: __C2023HailClassLoaderContainer. 2023-02-10 11:12:04 root: INFO: instruction count: 3: __C2024FSContainer. 2023-02-10 11:12:04 root: INFO: instruction count: 3: __C2024FSContainer. 2023-02-10 11:12:04 root: INFO: instruction count: 3: __C2025Compiled. 2023-02-10 11:12:04 root: INFO: instruction count: 12: __C2025Compiled.apply 2023-02-10 11:12:04 root: INFO: instruction count: 9: __C2025Compiled.setPartitionIndex 2023-02-10 11:12:04 root: INFO: instruction count: 4: __C2025Compiled.addPartitionRegion 2023-02-10 11:12:04 root: INFO: instruction count: 4: __C2025Compiled.setPool 2023-02-10 11:12:04 root: INFO: instruction count: 3: __C2025Compiled.addHailClassLoader 2023-02-10 11:12:04 root: INFO: instruction count: 3: __C2025Compiled.addFS 2023-02-10 11:12:04 MemoryStore: INFO: Block broadcast_12 stored as values in memory (estimated size 56.0 B, free 79.8 GiB) 2023-02-10 11:12:04 MemoryStore: INFO: Block broadcast_12_piece0 stored as bytes in memory (estimated size 75.0 B, free 79.8 GiB) 2023-02-10 11:12:04 BlockManagerInfo: INFO: Added broadcast_12_piece0 in memory on 163.152.180.157:46313 (size: 75.0 B, free: 79.8 GiB) 2023-02-10 11:12:04 SparkContext: INFO: Created broadcast 12 from broadcast at SparkBackend.scala:280 2023-02-10 11:12:05 root: INFO: encoder cache hit 2023-02-10 11:12:05 MemoryStore: INFO: Block broadcast_13 stored as values in memory (estimated size 104.0 B, free 79.8 GiB) 2023-02-10 11:12:05 MemoryStore: INFO: Block broadcast_13_piece0 stored as bytes in memory (estimated size 62.0 B, free 79.8 GiB) 2023-02-10 11:12:05 BlockManagerInfo: INFO: Added broadcast_13_piece0 in memory on 163.152.180.157:46313 (size: 62.0 B, free: 79.8 GiB) 2023-02-10 11:12:05 SparkContext: INFO: Created broadcast 13 from broadcast at SparkBackend.scala:280 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1790HailClassLoaderContainer. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1790HailClassLoaderContainer. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1791FSContainer. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1791FSContainer. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1792collect_distributed_array. 2023-02-10 11:12:05 root: INFO: instruction count: 457: __C1792collect_distributed_array.apply 2023-02-10 11:12:05 root: INFO: instruction count: 17: __C1792collect_distributed_array.apply 2023-02-10 11:12:05 root: INFO: instruction count: 27: __C1792collect_distributed_array.__m1793DECODE_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDANDr_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32ENDENDANDr_binaryENDEND_TO_SBaseStructPointer 2023-02-10 11:12:05 root: INFO: instruction count: 26: __C1792collect_distributed_array.__m1794INPLACE_DECODE_r_struct_of_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDANDr_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32ENDENDANDr_binaryEND_TO_r_struct_of_r_tuple_of_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolENDANDr_struct_of_r_interval_of_r_tuple_of_r_struct_of_r_locusANDo_array_of_r_stringENDANDr_int32ENDANDr_array_of_r_int32ENDENDANDr_stringEND 2023-02-10 11:12:05 root: INFO: instruction count: 26: __C1792collect_distributed_array.__m1795INPLACE_DECODE_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDANDr_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32ENDEND_TO_r_tuple_of_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolENDANDr_struct_of_r_interval_of_r_tuple_of_r_struct_of_r_locusANDo_array_of_r_stringENDANDr_int32ENDANDr_array_of_r_int32ENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 53: __C1792collect_distributed_array.__m1796INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:12:05 root: INFO: instruction count: 10: __C1792collect_distributed_array.__m1797INPLACE_DECODE_r_int32_TO_r_int32 2023-02-10 11:12:05 root: INFO: instruction count: 31: __C1792collect_distributed_array.__m1798INPLACE_DECODE_r_binary_TO_r_string 2023-02-10 11:12:05 root: INFO: instruction count: 10: __C1792collect_distributed_array.__m1799INPLACE_DECODE_r_int64_TO_r_int64 2023-02-10 11:12:05 root: INFO: instruction count: 10: __C1792collect_distributed_array.__m1800INPLACE_DECODE_r_bool_TO_r_bool 2023-02-10 11:12:05 root: INFO: instruction count: 26: __C1792collect_distributed_array.__m1801INPLACE_DECODE_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32END_TO_r_struct_of_r_interval_of_r_tuple_of_r_struct_of_r_locusANDo_array_of_r_stringENDANDr_int32ENDANDr_array_of_r_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 44: __C1792collect_distributed_array.__m1802INPLACE_DECODE_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolEND_TO_r_interval_of_r_tuple_of_r_struct_of_r_locusANDo_array_of_r_stringENDANDr_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 26: __C1792collect_distributed_array.__m1803INPLACE_DECODE_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32END_TO_r_tuple_of_r_struct_of_r_locusANDo_array_of_r_stringENDANDr_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 57: __C1792collect_distributed_array.__m1804INPLACE_DECODE_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryEND_TO_r_struct_of_r_locusANDo_array_of_r_stringEND 2023-02-10 11:12:05 root: INFO: instruction count: 26: __C1792collect_distributed_array.__m1805INPLACE_DECODE_r_struct_of_r_binaryANDr_int32END_TO_r_locus 2023-02-10 11:12:05 root: INFO: instruction count: 58: __C1792collect_distributed_array.__m1806INPLACE_DECODE_o_array_of_r_binary_TO_o_array_of_r_string 2023-02-10 11:12:05 root: INFO: instruction count: 58: __C1792collect_distributed_array.__m1807INPLACE_DECODE_r_array_of_r_int32_TO_r_array_of_r_int32 2023-02-10 11:12:05 root: INFO: instruction count: 27: __C1792collect_distributed_array.__m1809DECODE_r_struct_of_r_struct_of_ENDEND_TO_SBaseStructPointer 2023-02-10 11:12:05 root: INFO: instruction count: 8: __C1792collect_distributed_array.__m1810INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-02-10 11:12:05 root: INFO: instruction count: 49: __C1792collect_distributed_array.__m1814concat 2023-02-10 11:12:05 root: INFO: instruction count: 12: __C1792collect_distributed_array.__m1820setup_null 2023-02-10 11:12:05 root: INFO: instruction count: 63: __C1792collect_distributed_array.__m1836ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1792collect_distributed_array.__m1837ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 25: __C1792collect_distributed_array.__m1838ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 74: __C1792collect_distributed_array.__m1839ord_compareNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 9: __C1792collect_distributed_array.__m1841ord_compareNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 89: __C1792collect_distributed_array.__m1842ord_compareNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 12: __C1792collect_distributed_array.__m1847setup_jab 2023-02-10 11:12:05 root: INFO: instruction count: 31: __C1792collect_distributed_array.__m1850dependent_sorting_func 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1853ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 620: __C1792collect_distributed_array.__m1854ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1792collect_distributed_array.__m1855ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 25: __C1792collect_distributed_array.__m1856ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1792collect_distributed_array.__m1857ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1792collect_distributed_array.__m1858ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 102: __C1792collect_distributed_array.__m1859ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1860ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 21: __C1792collect_distributed_array.__m1861ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1862ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 21: __C1792collect_distributed_array.__m1863ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1792collect_distributed_array.__m1864ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 81: __C1792collect_distributed_array.__m1865ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 24: __C1792collect_distributed_array.__m1866ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 30: __C1792collect_distributed_array.__m1867ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 24: __C1792collect_distributed_array.__m1868ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 16: __C1792collect_distributed_array.__m1869ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 30: __C1792collect_distributed_array.__m1870ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 16: __C1792collect_distributed_array.__m1871ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 28: __C1792collect_distributed_array.__m1872ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 102: __C1792collect_distributed_array.__m1873ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 34: __C1792collect_distributed_array.__m1874ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 81: __C1792collect_distributed_array.__m1875ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1876ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 253: __C1792collect_distributed_array.__m1877ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 28: __C1792collect_distributed_array.__m1878ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 232: __C1792collect_distributed_array.__m1879ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 24: __C1792collect_distributed_array.__m1880ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 14: __C1792collect_distributed_array.__m1881ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 30: __C1792collect_distributed_array.__m1882ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 14: __C1792collect_distributed_array.__m1883ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 34: __C1792collect_distributed_array.__m1884ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 187: __C1792collect_distributed_array.__m1885ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 28: __C1792collect_distributed_array.__m1886ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 232: __C1792collect_distributed_array.__m1887ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 34: __C1792collect_distributed_array.__m1888ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 187: __C1792collect_distributed_array.__m1889ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1890ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 195: __C1792collect_distributed_array.__m1891ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1792collect_distributed_array.__m1892ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 94: __C1792collect_distributed_array.__m1893ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1894ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 231: __C1792collect_distributed_array.__m1895ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 28: __C1792collect_distributed_array.__m1896ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 102: __C1792collect_distributed_array.__m1897ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1898ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1899ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 34: __C1792collect_distributed_array.__m1900ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 81: __C1792collect_distributed_array.__m1901ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 28: __C1792collect_distributed_array.__m1902ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 102: __C1792collect_distributed_array.__m1903ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1904ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1905ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 34: __C1792collect_distributed_array.__m1906ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 81: __C1792collect_distributed_array.__m1907ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 24: __C1792collect_distributed_array.__m1908ord_lt 2023-02-10 11:12:05 root: INFO: instruction count: 21: __C1792collect_distributed_array.__m1909ord_ltNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 8: __C1792collect_distributed_array.__m1910ord_compareNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 30: __C1792collect_distributed_array.__m1911ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 21: __C1792collect_distributed_array.__m1912ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1913ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 173: __C1792collect_distributed_array.__m1914ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1792collect_distributed_array.__m1915ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 73: __C1792collect_distributed_array.__m1916ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 202: __C1792collect_distributed_array.__m1917arraySorter_outer 2023-02-10 11:12:05 root: INFO: instruction count: 66: __C1792collect_distributed_array.__m1918arraySorter_merge 2023-02-10 11:12:05 root: INFO: instruction count: 36: __C1792collect_distributed_array.__m1919arraySorter_splitMerge 2023-02-10 11:12:05 root: INFO: instruction count: 389: __C1792collect_distributed_array.__m1933split_ArraySort 2023-02-10 11:12:05 root: INFO: instruction count: 35: __C1792collect_distributed_array.__m1941arrayref_bounds_check 2023-02-10 11:12:05 root: INFO: instruction count: 442: __C1792collect_distributed_array.__m1946split_Let 2023-02-10 11:12:05 root: INFO: instruction count: 284: __C1792collect_distributed_array.__m1948min_rep 2023-02-10 11:12:05 root: INFO: instruction count: 12: __C1792collect_distributed_array.__m1951setup_null 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1957ord_gt 2023-02-10 11:12:05 root: INFO: instruction count: 14: __C1792collect_distributed_array.__m1958ord_gtNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 12: __C1792collect_distributed_array.__m1971setup_jab 2023-02-10 11:12:05 root: INFO: instruction count: 70: __C1792collect_distributed_array.__m1974dependent_sorting_func 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1977ord_compare 2023-02-10 11:12:05 root: INFO: instruction count: 241: __C1792collect_distributed_array.__m1978ord_compareNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1792collect_distributed_array.__m1979ord_compare 2023-02-10 11:12:05 root: INFO: instruction count: 82: __C1792collect_distributed_array.__m1980ord_compareNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1981ord_compare 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1792collect_distributed_array.__m1982ord_compare 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1983ord_compare 2023-02-10 11:12:05 root: INFO: instruction count: 8: __C1792collect_distributed_array.__m1984ord_compareNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1792collect_distributed_array.__m1985ord_compare 2023-02-10 11:12:05 root: INFO: instruction count: 8: __C1792collect_distributed_array.__m1986ord_compareNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 202: __C1792collect_distributed_array.__m1987arraySorter_outer 2023-02-10 11:12:05 root: INFO: instruction count: 66: __C1792collect_distributed_array.__m1988arraySorter_merge 2023-02-10 11:12:05 root: INFO: instruction count: 36: __C1792collect_distributed_array.__m1989arraySorter_splitMerge 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1792collect_distributed_array.setObjects 2023-02-10 11:12:05 root: INFO: instruction count: 2: __C1792collect_distributed_array.__m2039includesStart 2023-02-10 11:12:05 root: INFO: instruction count: 284: __C1792collect_distributed_array.__m2040pointLessThanPartitionIntervalLeftEndpoint 2023-02-10 11:12:05 root: INFO: instruction count: 22: __C1792collect_distributed_array.__m2041ord_compare 2023-02-10 11:12:05 root: INFO: instruction count: 2: __C1792collect_distributed_array.__m2043includesEnd 2023-02-10 11:12:05 root: INFO: instruction count: 275: __C1792collect_distributed_array.__m2044pointLessThanPartitionIntervalRightEndpoint 2023-02-10 11:12:05 root: INFO: instruction count: 163: __C1792collect_distributed_array.__m2053ord_compareNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1792collect_distributed_array.__m2054ord_compare 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1792collect_distributed_array.__m2055ord_compare 2023-02-10 11:12:05 root: INFO: instruction count: 503: __C1792collect_distributed_array.__m2057split_ToArray 2023-02-10 11:12:05 root: INFO: instruction count: 223: __C1792collect_distributed_array.__m2065split_ToArray 2023-02-10 11:12:05 root: INFO: instruction count: 395: __C1792collect_distributed_array.__m2072split_StreamFold2 2023-02-10 11:12:05 root: INFO: instruction count: 10: __C1792collect_distributed_array.__m2074triangle 2023-02-10 11:12:05 root: INFO: instruction count: 8: __C1792collect_distributed_array.__m2081UnphasedDiploidGtIndexCall 2023-02-10 11:12:05 root: INFO: instruction count: 9: __C1792collect_distributed_array.__m2082downcode 2023-02-10 11:12:05 root: INFO: instruction count: 8: __C1792collect_distributed_array.__m2083unphasedDiploidGtIndex 2023-02-10 11:12:05 root: INFO: instruction count: 416: __C1792collect_distributed_array.__m2106split_If 2023-02-10 11:12:05 root: INFO: instruction count: 106: __C1792collect_distributed_array.__m2113split_StreamFold 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m2130gqFromPL 2023-02-10 11:12:05 root: INFO: instruction count: 553: __C1792collect_distributed_array.__m2142writeInternalNode 2023-02-10 11:12:05 root: INFO: instruction count: 25: __C1792collect_distributed_array.__m2143ENCODE_SBaseStructPointer_TO_o_struct_of_r_array_of_r_struct_of_r_int64ANDr_int64ANDr_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_int64ANDr_struct_of_o_int64ENDENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 35: __C1792collect_distributed_array.__m2144ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_int64ANDr_int64ANDr_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_int64ANDr_struct_of_o_int64ENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 53: __C1792collect_distributed_array.__m2145ENCODE_SBaseStructPointer_TO_r_struct_of_r_int64ANDr_int64ANDr_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_int64ANDr_struct_of_o_int64ENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1792collect_distributed_array.__m2146ENCODE_SInt64$_TO_r_int64 2023-02-10 11:12:05 root: INFO: instruction count: 51: __C1792collect_distributed_array.__m2147ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND 2023-02-10 11:12:05 root: INFO: instruction count: 25: __C1792collect_distributed_array.__m2148ENCODE_SCanonicalLocusPointer_TO_r_struct_of_r_binaryANDr_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 16: __C1792collect_distributed_array.__m2149ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1792collect_distributed_array.__m2150ENCODE_SInt32$_TO_r_int32 2023-02-10 11:12:05 root: INFO: instruction count: 39: __C1792collect_distributed_array.__m2151ENCODE_SIndexablePointer_TO_r_array_of_r_binary 2023-02-10 11:12:05 root: INFO: instruction count: 36: __C1792collect_distributed_array.__m2152ENCODE_SBaseStructPointer_TO_r_struct_of_o_int64END 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1792collect_distributed_array.__m2153ENCODE_SInt64$_TO_o_int64 2023-02-10 11:12:05 root: INFO: instruction count: 448: __C1792collect_distributed_array.__m2155writeLeafNode 2023-02-10 11:12:05 root: INFO: instruction count: 37: __C1792collect_distributed_array.__m2156ENCODE_SBaseStructPointer_TO_o_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_int64ANDr_struct_of_o_int64ENDENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 35: __C1792collect_distributed_array.__m2157ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_int64ANDr_struct_of_o_int64ENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 29: __C1792collect_distributed_array.__m2158ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_int64ANDr_struct_of_o_int64ENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 52: __C1792collect_distributed_array.__m2159flush 2023-02-10 11:12:05 root: INFO: instruction count: 23: __C1792collect_distributed_array.__m2160ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 124: __C1792collect_distributed_array.__m2161ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 67: __C1792collect_distributed_array.__m2162ENCODE_SStackStruct_TO_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryANDo_binaryANDo_float64ANDo_array_of_r_binaryANDr_struct_of_o_array_of_o_int32ANDo_array_of_o_float64ANDo_int32ANDo_int32ANDo_float64ANDo_float64ANDo_float64ANDo_float64ANDo_float64ANDo_float64ENDANDr_int32ANDr_boolEND 2023-02-10 11:12:05 root: INFO: instruction count: 16: __C1792collect_distributed_array.__m2163ENCODE_SStringPointer_TO_o_binary 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1792collect_distributed_array.__m2164ENCODE_SFloat64$_TO_o_float64 2023-02-10 11:12:05 root: INFO: instruction count: 39: __C1792collect_distributed_array.__m2165ENCODE_SIndexablePointer_TO_o_array_of_r_binary 2023-02-10 11:12:05 root: INFO: instruction count: 293: __C1792collect_distributed_array.__m2166ENCODE_SBaseStructPointer_TO_r_struct_of_o_array_of_o_int32ANDo_array_of_o_float64ANDo_int32ANDo_int32ANDo_float64ANDo_float64ANDo_float64ANDo_float64ANDo_float64ANDo_float64END 2023-02-10 11:12:05 root: INFO: instruction count: 115: __C1792collect_distributed_array.__m2167ENCODE_SIndexablePointer_TO_o_array_of_o_int32 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1792collect_distributed_array.__m2168ENCODE_SInt32$_TO_o_int32 2023-02-10 11:12:05 root: INFO: instruction count: 115: __C1792collect_distributed_array.__m2169ENCODE_SIndexablePointer_TO_o_array_of_o_float64 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1792collect_distributed_array.__m2170ENCODE_SBoolean$_TO_r_bool 2023-02-10 11:12:05 root: INFO: instruction count: 7: __C1792collect_distributed_array.__m2171ENCODE_SStackStruct_TO_r_struct_of_r_array_of_r_struct_of_o_array_of_o_int32ANDo_array_of_r_float64ANDo_int32ANDo_array_of_r_int32ANDo_array_of_r_int32ANDo_binaryANDo_array_of_r_float64ANDo_int32ANDo_int32ANDo_int32ANDo_array_of_o_int32ANDo_int32ANDo_array_of_r_float64ENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 35: __C1792collect_distributed_array.__m2172ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_o_array_of_o_int32ANDo_array_of_r_float64ANDo_int32ANDo_array_of_r_int32ANDo_array_of_r_int32ANDo_binaryANDo_array_of_r_float64ANDo_int32ANDo_int32ANDo_int32ANDo_array_of_o_int32ANDo_int32ANDo_array_of_r_float64END 2023-02-10 11:12:05 root: INFO: instruction count: 422: __C1792collect_distributed_array.__m2173ENCODE_SBaseStructPointer_TO_r_struct_of_o_array_of_o_int32ANDo_array_of_r_float64ANDo_int32ANDo_array_of_r_int32ANDo_array_of_r_int32ANDo_binaryANDo_array_of_r_float64ANDo_int32ANDo_int32ANDo_int32ANDo_array_of_o_int32ANDo_int32ANDo_array_of_r_float64END 2023-02-10 11:12:05 root: INFO: instruction count: 39: __C1792collect_distributed_array.__m2174ENCODE_SIndexablePointer_TO_o_array_of_r_float64 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1792collect_distributed_array.__m2175ENCODE_SFloat64$_TO_r_float64 2023-02-10 11:12:05 root: INFO: instruction count: 39: __C1792collect_distributed_array.__m2176ENCODE_SIndexablePointer_TO_o_array_of_r_int32 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1792collect_distributed_array.__m2177ENCODE_SCanonicalCall$_TO_o_int32 2023-02-10 11:12:05 root: INFO: instruction count: 9: __C1792collect_distributed_array.__m2178ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDo_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 87: __C1792collect_distributed_array.__m2179ENCODE_SBaseStructPointer_TO_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDo_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 51: __C1792collect_distributed_array.__m2180ENCODE_SBaseStructPointer_TO_o_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND 2023-02-10 11:12:05 root: INFO: instruction count: 9: __C1792collect_distributed_array.setPartitionIndex 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1792collect_distributed_array.addPartitionRegion 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1792collect_distributed_array.setPool 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1792collect_distributed_array.addHailClassLoader 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1792collect_distributed_array.addFS 2023-02-10 11:12:05 root: INFO: instruction count: 43: __C1792collect_distributed_array.addReferenceGenomes 2023-02-10 11:12:05 root: INFO: instruction count: 39: __C1792collect_distributed_array.addLiterals 2023-02-10 11:12:05 root: INFO: instruction count: 27: __C1792collect_distributed_array.__m2183DECODE_r_struct_of_r_binaryEND_TO_SBaseStructPointer 2023-02-10 11:12:05 root: INFO: instruction count: 560: __C1792collect_distributed_array.apply_region2_2 2023-02-10 11:12:05 root: INFO: instruction count: 109: __C1792collect_distributed_array.apply_region72_78 2023-02-10 11:12:05 root: INFO: instruction count: 79: __C1792collect_distributed_array.apply_region114_120 2023-02-10 11:12:05 root: INFO: instruction count: 478: __C1792collect_distributed_array.apply_region71_128 2023-02-10 11:12:05 root: INFO: instruction count: 491: __C1792collect_distributed_array.apply_region210_224 2023-02-10 11:12:05 root: INFO: instruction count: 300: __C1792collect_distributed_array.apply_region203_209 2023-02-10 11:12:05 root: INFO: instruction count: 240: __C1792collect_distributed_array.apply_region150_157 2023-02-10 11:12:05 root: INFO: instruction count: 165: __C1792collect_distributed_array.apply_region64_70 2023-02-10 11:12:05 root: INFO: instruction count: 152: __C1792collect_distributed_array.apply_region195_202 2023-02-10 11:12:05 root: INFO: instruction count: 136: __C1792collect_distributed_array.apply_region57_63 2023-02-10 11:12:05 root: INFO: instruction count: 186: __C1792collect_distributed_array.apply_region225_227 2023-02-10 11:12:05 root: INFO: instruction count: 116: __C1792collect_distributed_array.apply_region176_192 2023-02-10 11:12:05 root: INFO: instruction count: 93: __C1792collect_distributed_array.apply_region40_46 2023-02-10 11:12:05 root: INFO: instruction count: 1541: __C1792collect_distributed_array.apply_region7_231 2023-02-10 11:12:05 root: INFO: instruction count: 119: __C1792collect_distributed_array.__m1854ord_ltNonnull_region0_0 2023-02-10 11:12:05 root: INFO: instruction count: 112: __C1792collect_distributed_array.__m1854ord_ltNonnull_region2_2 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1854ord_ltNonnull_region54_61 2023-02-10 11:12:05 root: INFO: instruction count: 118: __C1792collect_distributed_array.__m1877ord_ltNonnull_region26_33 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1877ord_ltNonnull_region226_233 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1877ord_ltNonnull_region201_208 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1877ord_ltNonnull_region176_183 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1877ord_ltNonnull_region151_158 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1877ord_ltNonnull_region126_133 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1877ord_ltNonnull_region101_108 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1877ord_ltNonnull_region76_83 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1877ord_ltNonnull_region51_58 2023-02-10 11:12:05 root: INFO: instruction count: 70: __C1792collect_distributed_array.__m1877ord_ltNonnull_region34_41 2023-02-10 11:12:05 root: INFO: instruction count: 75: __C1792collect_distributed_array.__m1877ord_ltNonnull_region42_49 2023-02-10 11:12:05 root: INFO: instruction count: 46: __C1792collect_distributed_array.__m1877ord_ltNonnull_region234_241 2023-02-10 11:12:05 root: INFO: instruction count: 46: __C1792collect_distributed_array.__m1877ord_ltNonnull_region209_216 2023-02-10 11:12:05 root: INFO: instruction count: 46: __C1792collect_distributed_array.__m1877ord_ltNonnull_region184_191 2023-02-10 11:12:05 root: INFO: instruction count: 46: __C1792collect_distributed_array.__m1877ord_ltNonnull_region159_166 2023-02-10 11:12:05 root: INFO: instruction count: 46: __C1792collect_distributed_array.__m1877ord_ltNonnull_region134_141 2023-02-10 11:12:05 root: INFO: instruction count: 46: __C1792collect_distributed_array.__m1877ord_ltNonnull_region109_116 2023-02-10 11:12:05 root: INFO: instruction count: 46: __C1792collect_distributed_array.__m1877ord_ltNonnull_region84_91 2023-02-10 11:12:05 root: INFO: instruction count: 520: __C1792collect_distributed_array.__m1877ord_ltNonnull_region24_250 2023-02-10 11:12:05 root: INFO: instruction count: 118: __C1792collect_distributed_array.__m1891ord_equivNonnull_region17_24 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1891ord_equivNonnull_region145_152 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1891ord_equivNonnull_region129_136 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1891ord_equivNonnull_region113_120 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1891ord_equivNonnull_region97_104 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1891ord_equivNonnull_region81_88 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1891ord_equivNonnull_region65_72 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1891ord_equivNonnull_region49_56 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1891ord_equivNonnull_region33_40 2023-02-10 11:12:05 root: INFO: instruction count: 505: __C1792collect_distributed_array.__m1891ord_equivNonnull_region16_161 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1895ord_ltNonnull_region301_308 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1895ord_ltNonnull_region251_258 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1895ord_ltNonnull_region151_158 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1895ord_ltNonnull_region101_108 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1895ord_ltNonnull_region76_83 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1895ord_ltNonnull_region26_33 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1895ord_ltNonnull_region276_283 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1895ord_ltNonnull_region226_233 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1895ord_ltNonnull_region201_208 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1895ord_ltNonnull_region176_183 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1895ord_ltNonnull_region126_133 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1895ord_ltNonnull_region51_58 2023-02-10 11:12:05 root: INFO: instruction count: 70: __C1792collect_distributed_array.__m1895ord_ltNonnull_region309_316 2023-02-10 11:12:05 root: INFO: instruction count: 70: __C1792collect_distributed_array.__m1895ord_ltNonnull_region259_266 2023-02-10 11:12:05 root: INFO: instruction count: 70: __C1792collect_distributed_array.__m1895ord_ltNonnull_region159_166 2023-02-10 11:12:05 root: INFO: instruction count: 70: __C1792collect_distributed_array.__m1895ord_ltNonnull_region109_116 2023-02-10 11:12:05 root: INFO: instruction count: 70: __C1792collect_distributed_array.__m1895ord_ltNonnull_region84_91 2023-02-10 11:12:05 root: INFO: instruction count: 70: __C1792collect_distributed_array.__m1895ord_ltNonnull_region34_41 2023-02-10 11:12:05 root: INFO: instruction count: 75: __C1792collect_distributed_array.__m1895ord_ltNonnull_region267_274 2023-02-10 11:12:05 root: INFO: instruction count: 75: __C1792collect_distributed_array.__m1895ord_ltNonnull_region167_174 2023-02-10 11:12:05 root: INFO: instruction count: 75: __C1792collect_distributed_array.__m1895ord_ltNonnull_region117_124 2023-02-10 11:12:05 root: INFO: instruction count: 75: __C1792collect_distributed_array.__m1895ord_ltNonnull_region92_99 2023-02-10 11:12:05 root: INFO: instruction count: 75: __C1792collect_distributed_array.__m1895ord_ltNonnull_region42_49 2023-02-10 11:12:05 root: INFO: instruction count: 67: __C1792collect_distributed_array.__m1895ord_ltNonnull_region317_324 2023-02-10 11:12:05 root: INFO: instruction count: 46: __C1792collect_distributed_array.__m1895ord_ltNonnull_region284_291 2023-02-10 11:12:05 root: INFO: instruction count: 46: __C1792collect_distributed_array.__m1895ord_ltNonnull_region234_241 2023-02-10 11:12:05 root: INFO: instruction count: 46: __C1792collect_distributed_array.__m1895ord_ltNonnull_region209_216 2023-02-10 11:12:05 root: INFO: instruction count: 46: __C1792collect_distributed_array.__m1895ord_ltNonnull_region184_191 2023-02-10 11:12:05 root: INFO: instruction count: 534: __C1792collect_distributed_array.__m1895ord_ltNonnull_region24_325 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1914ord_equivNonnull_region193_200 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1914ord_equivNonnull_region161_168 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1914ord_equivNonnull_region97_104 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1914ord_equivNonnull_region65_72 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1914ord_equivNonnull_region49_56 2023-02-10 11:12:05 root: INFO: instruction count: 96: __C1792collect_distributed_array.__m1914ord_equivNonnull_region17_24 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1914ord_equivNonnull_region177_184 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1914ord_equivNonnull_region145_152 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1914ord_equivNonnull_region129_136 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1914ord_equivNonnull_region113_120 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1914ord_equivNonnull_region81_88 2023-02-10 11:12:05 root: INFO: instruction count: 64: __C1792collect_distributed_array.__m1914ord_equivNonnull_region33_40 2023-02-10 11:12:05 root: INFO: instruction count: 77: __C1792collect_distributed_array.__m1914ord_equivNonnull_region169_176 2023-02-10 11:12:05 root: INFO: instruction count: 77: __C1792collect_distributed_array.__m1914ord_equivNonnull_region105_112 2023-02-10 11:12:05 root: INFO: instruction count: 77: __C1792collect_distributed_array.__m1914ord_equivNonnull_region73_80 2023-02-10 11:12:05 root: INFO: instruction count: 77: __C1792collect_distributed_array.__m1914ord_equivNonnull_region57_64 2023-02-10 11:12:05 root: INFO: instruction count: 512: __C1792collect_distributed_array.__m1914ord_equivNonnull_region16_209 2023-02-10 11:12:05 root: INFO: instruction count: 116: __C1792collect_distributed_array.__m2057split_ToArray_region10_17 2023-02-10 11:12:05 root: INFO: instruction count: 121: __C1792collect_distributed_array.__m2057split_ToArray_region1_9 2023-02-10 11:12:05 root: INFO: instruction count: 87: __C1792collect_distributed_array.__m2057split_ToArray_region26_36 2023-02-10 11:12:05 root: INFO: instruction count: 82: __C1792collect_distributed_array.__m2057split_ToArray_region53_60 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2185applySpills. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2266__m1854ord_ltNonnullSpills. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2304__m1877ord_ltNonnullSpills. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2394__m1891ord_equivNonnullSpills. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2460__m1895ord_ltNonnullSpills. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2638__m1914ord_equivNonnullSpills. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2762__m2057split_ToArraySpills. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2784__m2142writeInternalNodeSpills. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1840RGContainer_GRCh38. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1840RGContainer_GRCh38. 2023-02-10 11:12:05 root: INFO: encoder cache miss (2 hits, 7 misses, 0.222) 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2918HailClassLoaderContainer. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2918HailClassLoaderContainer. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2919FSContainer. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2919FSContainer. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2920etypeEncode. 2023-02-10 11:12:05 root: INFO: instruction count: 7: __C2920etypeEncode.apply 2023-02-10 11:12:05 root: INFO: instruction count: 141: __C2920etypeEncode.__m2921ENCODE_SBaseStructPointer_TO_r_struct_of_r_array_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32ENDANDr_struct_of_ENDANDr_array_of_r_struct_of_r_int64ANDr_boolANDr_struct_of_ENDANDr_struct_of_ENDENDANDr_array_of_r_struct_of_r_binaryENDANDr_array_of_r_binaryANDr_binaryANDr_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 35: __C2920etypeEncode.__m2922ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 51: __C2920etypeEncode.__m2923ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 41: __C2920etypeEncode.__m2924ENCODE_SIntervalPointer_TO_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolEND 2023-02-10 11:12:05 root: INFO: instruction count: 21: __C2920etypeEncode.__m2925ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 74: __C2920etypeEncode.__m2926ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryEND 2023-02-10 11:12:05 root: INFO: instruction count: 25: __C2920etypeEncode.__m2927ENCODE_SCanonicalLocusPointer_TO_r_struct_of_r_binaryANDr_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 16: __C2920etypeEncode.__m2928ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C2920etypeEncode.__m2929ENCODE_SInt32$_TO_r_int32 2023-02-10 11:12:05 root: INFO: instruction count: 39: __C2920etypeEncode.__m2930ENCODE_SIndexablePointer_TO_o_array_of_r_binary 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C2920etypeEncode.__m2931ENCODE_SBoolean$_TO_r_bool 2023-02-10 11:12:05 root: INFO: instruction count: 39: __C2920etypeEncode.__m2932ENCODE_SIndexablePointer_TO_r_array_of_r_int32 2023-02-10 11:12:05 root: INFO: instruction count: 1: __C2920etypeEncode.__m2933ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-02-10 11:12:05 root: INFO: instruction count: 35: __C2920etypeEncode.__m2934ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_int64ANDr_boolANDr_struct_of_ENDANDr_struct_of_ENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 41: __C2920etypeEncode.__m2935ENCODE_SBaseStructPointer_TO_r_struct_of_r_int64ANDr_boolANDr_struct_of_ENDANDr_struct_of_ENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C2920etypeEncode.__m2936ENCODE_SInt64$_TO_r_int64 2023-02-10 11:12:05 root: INFO: instruction count: 35: __C2920etypeEncode.__m2937ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_binaryEND 2023-02-10 11:12:05 root: INFO: instruction count: 13: __C2920etypeEncode.__m2938ENCODE_SBaseStructPointer_TO_r_struct_of_r_binaryEND 2023-02-10 11:12:05 root: INFO: instruction count: 39: __C2920etypeEncode.__m2939ENCODE_SIndexablePointer_TO_r_array_of_r_binary 2023-02-10 11:12:05 root: INFO: instruction count: 35: __C2920etypeEncode.__m2940ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:12:05 root: INFO: instruction count: 61: __C2920etypeEncode.__m2941ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:12:05 MemoryStore: INFO: Block broadcast_14 stored as values in memory (estimated size 19.0 KiB, free 79.8 GiB) 2023-02-10 11:12:05 MemoryStore: INFO: Block broadcast_14_piece0 stored as bytes in memory (estimated size 5.7 KiB, free 79.8 GiB) 2023-02-10 11:12:05 BlockManagerInfo: INFO: Added broadcast_14_piece0 in memory on 163.152.180.157:46313 (size: 5.7 KiB, free: 79.8 GiB) 2023-02-10 11:12:05 SparkContext: INFO: Created broadcast 14 from broadcast at SparkBackend.scala:280 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1695HailClassLoaderContainer. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1695HailClassLoaderContainer. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1696FSContainer. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1696FSContainer. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1697Compiled. 2023-02-10 11:12:05 root: INFO: instruction count: 386: __C1697Compiled.apply 2023-02-10 11:12:05 root: INFO: instruction count: 21: __C1697Compiled.__m1708ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryEND 2023-02-10 11:12:05 root: INFO: instruction count: 16: __C1697Compiled.__m1709ENCODE_SStringPointer_TO_o_binary 2023-02-10 11:12:05 root: INFO: instruction count: 427: __C1697Compiled.__m1717split_CollectDistributedArray 2023-02-10 11:12:05 root: INFO: instruction count: 162: __C1697Compiled.__m1727split_ToArray 2023-02-10 11:12:05 root: INFO: instruction count: 178: __C1697Compiled.__m1748split_ToArray 2023-02-10 11:12:05 root: INFO: instruction count: 35: __C1697Compiled.__m1756arrayref_bounds_check 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1697Compiled.setBackend 2023-02-10 11:12:05 root: INFO: instruction count: 9: __C1697Compiled.__m2792ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDANDr_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32ENDENDANDr_binaryENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 21: __C1697Compiled.__m2793ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDANDr_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32ENDENDANDr_binaryEND 2023-02-10 11:12:05 root: INFO: instruction count: 17: __C1697Compiled.__m2794ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDANDr_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32ENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 61: __C1697Compiled.__m2795ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1697Compiled.__m2796ENCODE_SInt32$_TO_r_int32 2023-02-10 11:12:05 root: INFO: instruction count: 16: __C1697Compiled.__m2797ENCODE_SStringPointer_TO_r_binary 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1697Compiled.__m2798ENCODE_SInt64$_TO_r_int64 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1697Compiled.__m2799ENCODE_SBoolean$_TO_r_bool 2023-02-10 11:12:05 root: INFO: instruction count: 51: __C1697Compiled.__m2800ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 41: __C1697Compiled.__m2801ENCODE_SIntervalPointer_TO_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolEND 2023-02-10 11:12:05 root: INFO: instruction count: 21: __C1697Compiled.__m2802ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 74: __C1697Compiled.__m2803ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryEND 2023-02-10 11:12:05 root: INFO: instruction count: 25: __C1697Compiled.__m2804ENCODE_SCanonicalLocusPointer_TO_r_struct_of_r_binaryANDr_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 39: __C1697Compiled.__m2805ENCODE_SIndexablePointer_TO_o_array_of_r_binary 2023-02-10 11:12:05 root: INFO: instruction count: 39: __C1697Compiled.__m2806ENCODE_SIndexablePointer_TO_r_array_of_r_int32 2023-02-10 11:12:05 root: INFO: instruction count: 9: __C1697Compiled.__m2807ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_ENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 1: __C1697Compiled.__m2808ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1697Compiled.setObjects 2023-02-10 11:12:05 root: INFO: instruction count: 27: __C1697Compiled.__m2810DECODE_r_struct_of_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDo_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDENDEND_TO_SBaseStructPointer 2023-02-10 11:12:05 root: INFO: instruction count: 102: __C1697Compiled.__m2811INPLACE_DECODE_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDo_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDEND_TO_r_struct_of_r_stringANDr_int64ANDr_boolANDo_struct_of_r_locusANDr_array_of_r_stringENDANDo_struct_of_r_locusANDr_array_of_r_stringENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 31: __C1697Compiled.__m2812INPLACE_DECODE_r_binary_TO_r_string 2023-02-10 11:12:05 root: INFO: instruction count: 10: __C1697Compiled.__m2813INPLACE_DECODE_r_int64_TO_r_int64 2023-02-10 11:12:05 root: INFO: instruction count: 10: __C1697Compiled.__m2814INPLACE_DECODE_r_bool_TO_r_bool 2023-02-10 11:12:05 root: INFO: instruction count: 26: __C1697Compiled.__m2815INPLACE_DECODE_o_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND_TO_o_struct_of_r_locusANDr_array_of_r_stringEND 2023-02-10 11:12:05 root: INFO: instruction count: 26: __C1697Compiled.__m2816INPLACE_DECODE_r_struct_of_r_binaryANDr_int32END_TO_r_locus 2023-02-10 11:12:05 root: INFO: instruction count: 10: __C1697Compiled.__m2817INPLACE_DECODE_r_int32_TO_r_int32 2023-02-10 11:12:05 root: INFO: instruction count: 58: __C1697Compiled.__m2818INPLACE_DECODE_r_array_of_r_binary_TO_r_array_of_r_string 2023-02-10 11:12:05 root: INFO: instruction count: 5: __C1697Compiled.__m2825split_Begin 2023-02-10 11:12:05 root: INFO: instruction count: 484: __C1697Compiled.__m2827begin_group_0 2023-02-10 11:12:05 root: INFO: instruction count: 143: __C1697Compiled.__m2837split_ToArray 2023-02-10 11:12:05 root: INFO: instruction count: 147: __C1697Compiled.__m2851begin_group_0 2023-02-10 11:12:05 root: INFO: instruction count: 229: __C1697Compiled.__m2852split_ToArray 2023-02-10 11:12:05 root: INFO: instruction count: 305: __C1697Compiled.__m2866begin_group_0 2023-02-10 11:12:05 root: INFO: instruction count: 18: __C1697Compiled.__m2867ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 162: __C1697Compiled.__m2868ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1697Compiled.__m2869ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 25: __C1697Compiled.__m2870ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 74: __C1697Compiled.__m2871ord_compareNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 9: __C1697Compiled.__m2872ord_compareNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 89: __C1697Compiled.__m2873ord_compareNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 15: __C1697Compiled.__m2874ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 81: __C1697Compiled.__m2875ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 11: __C1697Compiled.__m2876ord_equiv 2023-02-10 11:12:05 root: INFO: instruction count: 21: __C1697Compiled.__m2877ord_equivNonnull 2023-02-10 11:12:05 root: INFO: instruction count: 186: __C1697Compiled.__m2878split_ToArray 2023-02-10 11:12:05 root: INFO: instruction count: 143: __C1697Compiled.__m2889split_ToArray 2023-02-10 11:12:05 root: INFO: instruction count: 9: __C1697Compiled.setPartitionIndex 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1697Compiled.addPartitionRegion 2023-02-10 11:12:05 root: INFO: instruction count: 4: __C1697Compiled.setPool 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1697Compiled.addHailClassLoader 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1697Compiled.addFS 2023-02-10 11:12:05 root: INFO: instruction count: 43: __C1697Compiled.addReferenceGenomes 2023-02-10 11:12:05 root: INFO: instruction count: 181: __C1697Compiled.addLiterals 2023-02-10 11:12:05 root: INFO: instruction count: 81: __C1697Compiled.__m2903DECODE_r_struct_of_r_array_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32ENDANDr_struct_of_ENDANDr_array_of_r_struct_of_r_int64ANDr_boolANDr_struct_of_ENDANDr_struct_of_ENDENDANDr_array_of_r_struct_of_r_binaryENDANDr_array_of_r_binaryANDr_binaryANDr_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND_TO_SBaseStructPointer 2023-02-10 11:12:05 root: INFO: instruction count: 58: __C1697Compiled.__m2904INPLACE_DECODE_r_array_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32END_TO_r_array_of_r_struct_of_r_interval_of_r_tuple_of_r_struct_of_r_locusANDo_array_of_r_stringENDANDr_int32ENDANDr_array_of_r_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 26: __C1697Compiled.__m2905INPLACE_DECODE_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolENDANDr_array_of_r_int32END_TO_r_struct_of_r_interval_of_r_tuple_of_r_struct_of_r_locusANDo_array_of_r_stringENDANDr_int32ENDANDr_array_of_r_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 44: __C1697Compiled.__m2906INPLACE_DECODE_r_struct_of_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32ENDANDr_boolANDr_boolEND_TO_r_interval_of_r_tuple_of_r_struct_of_r_locusANDo_array_of_r_stringENDANDr_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 26: __C1697Compiled.__m2907INPLACE_DECODE_r_struct_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryENDANDr_int32END_TO_r_tuple_of_r_struct_of_r_locusANDo_array_of_r_stringENDANDr_int32END 2023-02-10 11:12:05 root: INFO: instruction count: 57: __C1697Compiled.__m2908INPLACE_DECODE_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDo_array_of_r_binaryEND_TO_r_struct_of_r_locusANDo_array_of_r_stringEND 2023-02-10 11:12:05 root: INFO: instruction count: 58: __C1697Compiled.__m2909INPLACE_DECODE_o_array_of_r_binary_TO_o_array_of_r_string 2023-02-10 11:12:05 root: INFO: instruction count: 58: __C1697Compiled.__m2910INPLACE_DECODE_r_array_of_r_int32_TO_r_array_of_r_int32 2023-02-10 11:12:05 root: INFO: instruction count: 8: __C1697Compiled.__m2911INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-02-10 11:12:05 root: INFO: instruction count: 58: __C1697Compiled.__m2912INPLACE_DECODE_r_array_of_r_struct_of_r_int64ANDr_boolANDr_struct_of_ENDANDr_struct_of_ENDEND_TO_r_array_of_r_struct_of_r_int64ANDr_boolANDr_struct_of_ENDANDr_struct_of_ENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 44: __C1697Compiled.__m2913INPLACE_DECODE_r_struct_of_r_int64ANDr_boolANDr_struct_of_ENDANDr_struct_of_ENDEND_TO_r_struct_of_r_int64ANDr_boolANDr_struct_of_ENDANDr_struct_of_ENDEND 2023-02-10 11:12:05 root: INFO: instruction count: 58: __C1697Compiled.__m2914INPLACE_DECODE_r_array_of_r_struct_of_r_binaryEND_TO_r_array_of_r_struct_of_r_stringEND 2023-02-10 11:12:05 root: INFO: instruction count: 17: __C1697Compiled.__m2915INPLACE_DECODE_r_struct_of_r_binaryEND_TO_r_struct_of_r_stringEND 2023-02-10 11:12:05 root: INFO: instruction count: 58: __C1697Compiled.__m2916INPLACE_DECODE_r_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_array_of_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:12:05 root: INFO: instruction count: 53: __C1697Compiled.__m2917INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2023-02-10 11:12:05 root: INFO: instruction count: 211: __C1697Compiled.__m1717split_CollectDistributedArray_region2_10 2023-02-10 11:12:05 root: INFO: instruction count: 571: __C1697Compiled.__m2827begin_group_0_region24_56 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2942__m1717split_CollectDistributedArraySpills. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C2943__m2827begin_group_0Spills. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1698RGContainer_GRCh38. 2023-02-10 11:12:05 root: INFO: instruction count: 3: __C1698RGContainer_GRCh38. 2023-02-10 11:12:05 MemoryStore: INFO: Block broadcast_15 stored as values in memory (estimated size 64.0 B, free 79.8 GiB) 2023-02-10 11:12:05 MemoryStore: INFO: Block broadcast_15_piece0 stored as bytes in memory (estimated size 49.0 B, free 79.8 GiB) 2023-02-10 11:12:05 BlockManagerInfo: INFO: Added broadcast_15_piece0 in memory on 163.152.180.157:46313 (size: 49.0 B, free: 79.8 GiB) 2023-02-10 11:12:05 SparkContext: INFO: Created broadcast 15 from broadcast at SparkBackend.scala:280 2023-02-10 11:12:05 SparkContext: INFO: Starting job: collect at SparkBackend.scala:288 2023-02-10 11:12:05 DAGScheduler: INFO: Got job 3 (collect at SparkBackend.scala:288) with 144 output partitions 2023-02-10 11:12:05 DAGScheduler: INFO: Final stage: ResultStage 3 (collect at SparkBackend.scala:288) 2023-02-10 11:12:05 DAGScheduler: INFO: Parents of final stage: List() 2023-02-10 11:12:05 DAGScheduler: INFO: Missing parents: List() 2023-02-10 11:12:05 DAGScheduler: INFO: Submitting ResultStage 3 (SparkBackendComputeRDD[7] at RDD at SparkBackend.scala:720), which has no missing parents 2023-02-10 11:12:05 MemoryStore: INFO: Block broadcast_16 stored as values in memory (estimated size 554.9 KiB, free 79.8 GiB) 2023-02-10 11:12:05 MemoryStore: INFO: Block broadcast_16_piece0 stored as bytes in memory (estimated size 264.4 KiB, free 79.8 GiB) 2023-02-10 11:12:05 BlockManagerInfo: INFO: Added broadcast_16_piece0 in memory on 163.152.180.157:46313 (size: 264.4 KiB, free: 79.8 GiB) 2023-02-10 11:12:05 SparkContext: INFO: Created broadcast 16 from broadcast at DAGScheduler.scala:1433 2023-02-10 11:12:05 DAGScheduler: INFO: Submitting 144 missing tasks from ResultStage 3 (SparkBackendComputeRDD[7] at RDD at SparkBackend.scala:720) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)) 2023-02-10 11:12:05 TaskSchedulerImpl: INFO: Adding task set 3.0 with 144 tasks resource profile 0 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 0.0 in stage 3.0 (TID 432) (163.152.180.157, executor driver, partition 0, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 1.0 in stage 3.0 (TID 433) (163.152.180.157, executor driver, partition 1, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 2.0 in stage 3.0 (TID 434) (163.152.180.157, executor driver, partition 2, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 3.0 in stage 3.0 (TID 435) (163.152.180.157, executor driver, partition 3, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 4.0 in stage 3.0 (TID 436) (163.152.180.157, executor driver, partition 4, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 5.0 in stage 3.0 (TID 437) (163.152.180.157, executor driver, partition 5, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 6.0 in stage 3.0 (TID 438) (163.152.180.157, executor driver, partition 6, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 7.0 in stage 3.0 (TID 439) (163.152.180.157, executor driver, partition 7, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 8.0 in stage 3.0 (TID 440) (163.152.180.157, executor driver, partition 8, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 9.0 in stage 3.0 (TID 441) (163.152.180.157, executor driver, partition 9, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 10.0 in stage 3.0 (TID 442) (163.152.180.157, executor driver, partition 10, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 11.0 in stage 3.0 (TID 443) (163.152.180.157, executor driver, partition 11, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 12.0 in stage 3.0 (TID 444) (163.152.180.157, executor driver, partition 12, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 13.0 in stage 3.0 (TID 445) (163.152.180.157, executor driver, partition 13, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 14.0 in stage 3.0 (TID 446) (163.152.180.157, executor driver, partition 14, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 15.0 in stage 3.0 (TID 447) (163.152.180.157, executor driver, partition 15, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 16.0 in stage 3.0 (TID 448) (163.152.180.157, executor driver, partition 16, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 17.0 in stage 3.0 (TID 449) (163.152.180.157, executor driver, partition 17, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 18.0 in stage 3.0 (TID 450) (163.152.180.157, executor driver, partition 18, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 19.0 in stage 3.0 (TID 451) (163.152.180.157, executor driver, partition 19, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 20.0 in stage 3.0 (TID 452) (163.152.180.157, executor driver, partition 20, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 21.0 in stage 3.0 (TID 453) (163.152.180.157, executor driver, partition 21, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 22.0 in stage 3.0 (TID 454) (163.152.180.157, executor driver, partition 22, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 23.0 in stage 3.0 (TID 455) (163.152.180.157, executor driver, partition 23, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 24.0 in stage 3.0 (TID 456) (163.152.180.157, executor driver, partition 24, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 25.0 in stage 3.0 (TID 457) (163.152.180.157, executor driver, partition 25, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 26.0 in stage 3.0 (TID 458) (163.152.180.157, executor driver, partition 26, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 27.0 in stage 3.0 (TID 459) (163.152.180.157, executor driver, partition 27, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 28.0 in stage 3.0 (TID 460) (163.152.180.157, executor driver, partition 28, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 29.0 in stage 3.0 (TID 461) (163.152.180.157, executor driver, partition 29, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 30.0 in stage 3.0 (TID 462) (163.152.180.157, executor driver, partition 30, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 31.0 in stage 3.0 (TID 463) (163.152.180.157, executor driver, partition 31, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 32.0 in stage 3.0 (TID 464) (163.152.180.157, executor driver, partition 32, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 33.0 in stage 3.0 (TID 465) (163.152.180.157, executor driver, partition 33, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 34.0 in stage 3.0 (TID 466) (163.152.180.157, executor driver, partition 34, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 35.0 in stage 3.0 (TID 467) (163.152.180.157, executor driver, partition 35, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 36.0 in stage 3.0 (TID 468) (163.152.180.157, executor driver, partition 36, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 37.0 in stage 3.0 (TID 469) (163.152.180.157, executor driver, partition 37, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 38.0 in stage 3.0 (TID 470) (163.152.180.157, executor driver, partition 38, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 TaskSetManager: INFO: Starting task 39.0 in stage 3.0 (TID 471) (163.152.180.157, executor driver, partition 39, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:05 Executor: INFO: Running task 1.0 in stage 3.0 (TID 433) 2023-02-10 11:12:05 Executor: INFO: Running task 2.0 in stage 3.0 (TID 434) 2023-02-10 11:12:05 Executor: INFO: Running task 5.0 in stage 3.0 (TID 437) 2023-02-10 11:12:05 Executor: INFO: Running task 17.0 in stage 3.0 (TID 449) 2023-02-10 11:12:05 Executor: INFO: Running task 3.0 in stage 3.0 (TID 435) 2023-02-10 11:12:05 Executor: INFO: Running task 24.0 in stage 3.0 (TID 456) 2023-02-10 11:12:05 Executor: INFO: Running task 4.0 in stage 3.0 (TID 436) 2023-02-10 11:12:05 Executor: INFO: Running task 9.0 in stage 3.0 (TID 441) 2023-02-10 11:12:05 Executor: INFO: Running task 13.0 in stage 3.0 (TID 445) 2023-02-10 11:12:05 Executor: INFO: Running task 0.0 in stage 3.0 (TID 432) 2023-02-10 11:12:05 Executor: INFO: Running task 36.0 in stage 3.0 (TID 468) 2023-02-10 11:12:05 Executor: INFO: Running task 34.0 in stage 3.0 (TID 466) 2023-02-10 11:12:05 Executor: INFO: Running task 33.0 in stage 3.0 (TID 465) 2023-02-10 11:12:05 Executor: INFO: Running task 18.0 in stage 3.0 (TID 450) 2023-02-10 11:12:05 Executor: INFO: Running task 39.0 in stage 3.0 (TID 471) 2023-02-10 11:12:05 Executor: INFO: Running task 37.0 in stage 3.0 (TID 469) 2023-02-10 11:12:05 Executor: INFO: Running task 30.0 in stage 3.0 (TID 462) 2023-02-10 11:12:05 Executor: INFO: Running task 38.0 in stage 3.0 (TID 470) 2023-02-10 11:12:05 Executor: INFO: Running task 35.0 in stage 3.0 (TID 467) 2023-02-10 11:12:05 Executor: INFO: Running task 21.0 in stage 3.0 (TID 453) 2023-02-10 11:12:05 Executor: INFO: Running task 23.0 in stage 3.0 (TID 455) 2023-02-10 11:12:05 Executor: INFO: Running task 32.0 in stage 3.0 (TID 464) 2023-02-10 11:12:05 Executor: INFO: Running task 6.0 in stage 3.0 (TID 438) 2023-02-10 11:12:05 Executor: INFO: Running task 10.0 in stage 3.0 (TID 442) 2023-02-10 11:12:05 Executor: INFO: Running task 16.0 in stage 3.0 (TID 448) 2023-02-10 11:12:05 Executor: INFO: Running task 26.0 in stage 3.0 (TID 458) 2023-02-10 11:12:05 Executor: INFO: Running task 28.0 in stage 3.0 (TID 460) 2023-02-10 11:12:05 Executor: INFO: Running task 31.0 in stage 3.0 (TID 463) 2023-02-10 11:12:05 Executor: INFO: Running task 20.0 in stage 3.0 (TID 452) 2023-02-10 11:12:05 Executor: INFO: Running task 19.0 in stage 3.0 (TID 451) 2023-02-10 11:12:05 Executor: INFO: Running task 29.0 in stage 3.0 (TID 461) 2023-02-10 11:12:05 Executor: INFO: Running task 22.0 in stage 3.0 (TID 454) 2023-02-10 11:12:05 Executor: INFO: Running task 27.0 in stage 3.0 (TID 459) 2023-02-10 11:12:05 Executor: INFO: Running task 25.0 in stage 3.0 (TID 457) 2023-02-10 11:12:05 Executor: INFO: Running task 12.0 in stage 3.0 (TID 444) 2023-02-10 11:12:05 Executor: INFO: Running task 11.0 in stage 3.0 (TID 443) 2023-02-10 11:12:05 Executor: INFO: Running task 8.0 in stage 3.0 (TID 440) 2023-02-10 11:12:05 Executor: INFO: Running task 7.0 in stage 3.0 (TID 439) 2023-02-10 11:12:05 Executor: INFO: Running task 14.0 in stage 3.0 (TID 446) 2023-02-10 11:12:05 Executor: INFO: Running task 15.0 in stage 3.0 (TID 447) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 17.0 in stage 3.0 (TID 449) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 34.0 in stage 3.0 (TID 466) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 38.0 in stage 3.0 (TID 470) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 28.0 in stage 3.0 (TID 460) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 10.0 in stage 3.0 (TID 442) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 20.0 in stage 3.0 (TID 452) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 27.0 in stage 3.0 (TID 459) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 158: Executor task launch worker for task 1.0 in stage 3.0 (TID 433) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 121: Executor task launch worker for task 25.0 in stage 3.0 (TID 457) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 37.0 in stage 3.0 (TID 469) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 33.0 in stage 3.0 (TID 465) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 35.0 in stage 3.0 (TID 467) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 21.0 in stage 3.0 (TID 453) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 125: Executor task launch worker for task 29.0 in stage 3.0 (TID 461) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 4.0 in stage 3.0 (TID 436) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 18.0 in stage 3.0 (TID 450) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 19.0 in stage 3.0 (TID 451) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 6.0 in stage 3.0 (TID 438) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 30.0 in stage 3.0 (TID 462) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 7.0 in stage 3.0 (TID 439) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 14.0 in stage 3.0 (TID 446) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 16.0 in stage 3.0 (TID 448) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 31.0 in stage 3.0 (TID 463) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 2.0 in stage 3.0 (TID 434) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 32.0 in stage 3.0 (TID 464) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 3.0 in stage 3.0 (TID 435) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 123: Executor task launch worker for task 23.0 in stage 3.0 (TID 455) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 5.0 in stage 3.0 (TID 437) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 24.0 in stage 3.0 (TID 456) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 9.0 in stage 3.0 (TID 441) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 13.0 in stage 3.0 (TID 445) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 149: Executor task launch worker for task 36.0 in stage 3.0 (TID 468) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 15.0 in stage 3.0 (TID 447) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 8.0 in stage 3.0 (TID 440) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 12.0 in stage 3.0 (TID 444) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 22.0 in stage 3.0 (TID 454) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 26.0 in stage 3.0 (TID 458) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 11.0 in stage 3.0 (TID 443) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 0.0 in stage 3.0 (TID 432) 2023-02-10 11:12:05 root: INFO: RegionPool: initialized for thread 138: Executor task launch worker for task 39.0 in stage 3.0 (TID 471) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 128: Executor task launch worker for task 5.0 in stage 3.0 (TID 437) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 128: Executor task launch worker for task 5.0 in stage 3.0 (TID 437) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 124: Executor task launch worker for task 13.0 in stage 3.0 (TID 445) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 124: Executor task launch worker for task 13.0 in stage 3.0 (TID 445) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 137: Executor task launch worker for task 11.0 in stage 3.0 (TID 443) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 137: Executor task launch worker for task 11.0 in stage 3.0 (TID 443) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 145: Executor task launch worker for task 12.0 in stage 3.0 (TID 444) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 145: Executor task launch worker for task 12.0 in stage 3.0 (TID 444) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 143: Executor task launch worker for task 16.0 in stage 3.0 (TID 448) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 143: Executor task launch worker for task 16.0 in stage 3.0 (TID 448) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 114: Executor task launch worker for task 4.0 in stage 3.0 (TID 436) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 148: Executor task launch worker for task 38.0 in stage 3.0 (TID 470) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 114: Executor task launch worker for task 4.0 in stage 3.0 (TID 436) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 148: Executor task launch worker for task 38.0 in stage 3.0 (TID 470) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 144: Executor task launch worker for task 28.0 in stage 3.0 (TID 460) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 144: Executor task launch worker for task 28.0 in stage 3.0 (TID 460) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 122: Executor task launch worker for task 20.0 in stage 3.0 (TID 452) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 117: Executor task launch worker for task 26.0 in stage 3.0 (TID 458) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 122: Executor task launch worker for task 20.0 in stage 3.0 (TID 452) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 117: Executor task launch worker for task 26.0 in stage 3.0 (TID 458) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 142: Executor task launch worker for task 3.0 in stage 3.0 (TID 435) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 142: Executor task launch worker for task 3.0 in stage 3.0 (TID 435) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 151: Executor task launch worker for task 2.0 in stage 3.0 (TID 434) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 151: Executor task launch worker for task 2.0 in stage 3.0 (TID 434) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 152: Executor task launch worker for task 33.0 in stage 3.0 (TID 465) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 152: Executor task launch worker for task 33.0 in stage 3.0 (TID 465) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 133: Executor task launch worker for task 24.0 in stage 3.0 (TID 456) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 133: Executor task launch worker for task 24.0 in stage 3.0 (TID 456) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 139: Executor task launch worker for task 27.0 in stage 3.0 (TID 459) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 139: Executor task launch worker for task 27.0 in stage 3.0 (TID 459) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 121: Executor task launch worker for task 25.0 in stage 3.0 (TID 457) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 121: Executor task launch worker for task 25.0 in stage 3.0 (TID 457) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 123: Executor task launch worker for task 23.0 in stage 3.0 (TID 455) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 140: Executor task launch worker for task 34.0 in stage 3.0 (TID 466) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 123: Executor task launch worker for task 23.0 in stage 3.0 (TID 455) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 140: Executor task launch worker for task 34.0 in stage 3.0 (TID 466) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 141: Executor task launch worker for task 14.0 in stage 3.0 (TID 446) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 141: Executor task launch worker for task 14.0 in stage 3.0 (TID 446) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 115: Executor task launch worker for task 9.0 in stage 3.0 (TID 441) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 115: Executor task launch worker for task 9.0 in stage 3.0 (TID 441) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 136: Executor task launch worker for task 21.0 in stage 3.0 (TID 453) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 149: Executor task launch worker for task 36.0 in stage 3.0 (TID 468) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 136: Executor task launch worker for task 21.0 in stage 3.0 (TID 453) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 149: Executor task launch worker for task 36.0 in stage 3.0 (TID 468) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 132: Executor task launch worker for task 31.0 in stage 3.0 (TID 463) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 132: Executor task launch worker for task 31.0 in stage 3.0 (TID 463) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 134: Executor task launch worker for task 7.0 in stage 3.0 (TID 439) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 134: Executor task launch worker for task 7.0 in stage 3.0 (TID 439) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 147: Executor task launch worker for task 6.0 in stage 3.0 (TID 438) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 147: Executor task launch worker for task 6.0 in stage 3.0 (TID 438) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 120: Executor task launch worker for task 35.0 in stage 3.0 (TID 467) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 120: Executor task launch worker for task 35.0 in stage 3.0 (TID 467) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 159: Executor task launch worker for task 17.0 in stage 3.0 (TID 449) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 119: Executor task launch worker for task 32.0 in stage 3.0 (TID 464) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 159: Executor task launch worker for task 17.0 in stage 3.0 (TID 449) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 119: Executor task launch worker for task 32.0 in stage 3.0 (TID 464) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 131: Executor task launch worker for task 15.0 in stage 3.0 (TID 447) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 131: Executor task launch worker for task 15.0 in stage 3.0 (TID 447) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 138: Executor task launch worker for task 39.0 in stage 3.0 (TID 471) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 118: Executor task launch worker for task 37.0 in stage 3.0 (TID 469) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 138: Executor task launch worker for task 39.0 in stage 3.0 (TID 471) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 127: Executor task launch worker for task 18.0 in stage 3.0 (TID 450) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 118: Executor task launch worker for task 37.0 in stage 3.0 (TID 469) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 127: Executor task launch worker for task 18.0 in stage 3.0 (TID 450) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 116: Executor task launch worker for task 10.0 in stage 3.0 (TID 442) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 116: Executor task launch worker for task 10.0 in stage 3.0 (TID 442) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 153: Executor task launch worker for task 0.0 in stage 3.0 (TID 432) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 150: Executor task launch worker for task 30.0 in stage 3.0 (TID 462) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 150: Executor task launch worker for task 30.0 in stage 3.0 (TID 462) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 153: Executor task launch worker for task 0.0 in stage 3.0 (TID 432) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 130: Executor task launch worker for task 22.0 in stage 3.0 (TID 454) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 125: Executor task launch worker for task 29.0 in stage 3.0 (TID 461) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 130: Executor task launch worker for task 22.0 in stage 3.0 (TID 454) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 125: Executor task launch worker for task 29.0 in stage 3.0 (TID 461) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 126: Executor task launch worker for task 19.0 in stage 3.0 (TID 451) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 126: Executor task launch worker for task 19.0 in stage 3.0 (TID 451) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 158: Executor task launch worker for task 1.0 in stage 3.0 (TID 433) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 158: Executor task launch worker for task 1.0 in stage 3.0 (TID 433) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 146: Executor task launch worker for task 8.0 in stage 3.0 (TID 440) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 146: Executor task launch worker for task 8.0 in stage 3.0 (TID 440) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 133: Executor task launch worker for task 24.0 in stage 3.0 (TID 456) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 121: Executor task launch worker for task 25.0 in stage 3.0 (TID 457) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 145: Executor task launch worker for task 12.0 in stage 3.0 (TID 444) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 114: Executor task launch worker for task 4.0 in stage 3.0 (TID 436) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 122: Executor task launch worker for task 20.0 in stage 3.0 (TID 452) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 148: Executor task launch worker for task 38.0 in stage 3.0 (TID 470) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 143: Executor task launch worker for task 16.0 in stage 3.0 (TID 448) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 128: Executor task launch worker for task 5.0 in stage 3.0 (TID 437) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 151: Executor task launch worker for task 2.0 in stage 3.0 (TID 434) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 115: Executor task launch worker for task 9.0 in stage 3.0 (TID 441) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 144: Executor task launch worker for task 28.0 in stage 3.0 (TID 460) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 137: Executor task launch worker for task 11.0 in stage 3.0 (TID 443) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 123: Executor task launch worker for task 23.0 in stage 3.0 (TID 455) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 142: Executor task launch worker for task 3.0 in stage 3.0 (TID 435) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 117: Executor task launch worker for task 26.0 in stage 3.0 (TID 458) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 139: Executor task launch worker for task 27.0 in stage 3.0 (TID 459) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 125: Executor task launch worker for task 29.0 in stage 3.0 (TID 461) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 141: Executor task launch worker for task 14.0 in stage 3.0 (TID 446) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 119: Executor task launch worker for task 32.0 in stage 3.0 (TID 464) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 149: Executor task launch worker for task 36.0 in stage 3.0 (TID 468) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 132: Executor task launch worker for task 31.0 in stage 3.0 (TID 463) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 140: Executor task launch worker for task 34.0 in stage 3.0 (TID 466) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 152: Executor task launch worker for task 33.0 in stage 3.0 (TID 465) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 159: Executor task launch worker for task 17.0 in stage 3.0 (TID 449) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 124: Executor task launch worker for task 13.0 in stage 3.0 (TID 445) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 134: Executor task launch worker for task 7.0 in stage 3.0 (TID 439) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 118: Executor task launch worker for task 37.0 in stage 3.0 (TID 469) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 116: Executor task launch worker for task 10.0 in stage 3.0 (TID 442) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 138: Executor task launch worker for task 39.0 in stage 3.0 (TID 471) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 120: Executor task launch worker for task 35.0 in stage 3.0 (TID 467) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 150: Executor task launch worker for task 30.0 in stage 3.0 (TID 462) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 130: Executor task launch worker for task 22.0 in stage 3.0 (TID 454) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 153: Executor task launch worker for task 0.0 in stage 3.0 (TID 432) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 127: Executor task launch worker for task 18.0 in stage 3.0 (TID 450) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 131: Executor task launch worker for task 15.0 in stage 3.0 (TID 447) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 147: Executor task launch worker for task 6.0 in stage 3.0 (TID 438) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 126: Executor task launch worker for task 19.0 in stage 3.0 (TID 451) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 158: Executor task launch worker for task 1.0 in stage 3.0 (TID 433) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 136: Executor task launch worker for task 21.0 in stage 3.0 (TID 453) 2023-02-10 11:12:06 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 146: Executor task launch worker for task 8.0 in stage 3.0 (TID 440) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 122: Executor task launch worker for task 20.0 in stage 3.0 (TID 452) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 139: Executor task launch worker for task 27.0 in stage 3.0 (TID 459) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 147: Executor task launch worker for task 6.0 in stage 3.0 (TID 438) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 143: Executor task launch worker for task 16.0 in stage 3.0 (TID 448) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 132: Executor task launch worker for task 31.0 in stage 3.0 (TID 463) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 126: Executor task launch worker for task 19.0 in stage 3.0 (TID 451) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 151: Executor task launch worker for task 2.0 in stage 3.0 (TID 434) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 121: Executor task launch worker for task 25.0 in stage 3.0 (TID 457) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 130: Executor task launch worker for task 22.0 in stage 3.0 (TID 454) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 131: Executor task launch worker for task 15.0 in stage 3.0 (TID 447) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 146: Executor task launch worker for task 8.0 in stage 3.0 (TID 440) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 140: Executor task launch worker for task 34.0 in stage 3.0 (TID 466) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 123: Executor task launch worker for task 23.0 in stage 3.0 (TID 455) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 115: Executor task launch worker for task 9.0 in stage 3.0 (TID 441) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 153: Executor task launch worker for task 0.0 in stage 3.0 (TID 432) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 118: Executor task launch worker for task 37.0 in stage 3.0 (TID 469) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 136: Executor task launch worker for task 21.0 in stage 3.0 (TID 453) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 150: Executor task launch worker for task 30.0 in stage 3.0 (TID 462) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 125: Executor task launch worker for task 29.0 in stage 3.0 (TID 461) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 117: Executor task launch worker for task 26.0 in stage 3.0 (TID 458) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 158: Executor task launch worker for task 1.0 in stage 3.0 (TID 433) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 137: Executor task launch worker for task 11.0 in stage 3.0 (TID 443) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 145: Executor task launch worker for task 12.0 in stage 3.0 (TID 444) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 116: Executor task launch worker for task 10.0 in stage 3.0 (TID 442) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 159: Executor task launch worker for task 17.0 in stage 3.0 (TID 449) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 119: Executor task launch worker for task 32.0 in stage 3.0 (TID 464) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 138: Executor task launch worker for task 39.0 in stage 3.0 (TID 471) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 114: Executor task launch worker for task 4.0 in stage 3.0 (TID 436) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 149: Executor task launch worker for task 36.0 in stage 3.0 (TID 468) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 127: Executor task launch worker for task 18.0 in stage 3.0 (TID 450) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 124: Executor task launch worker for task 13.0 in stage 3.0 (TID 445) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 120: Executor task launch worker for task 35.0 in stage 3.0 (TID 467) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 141: Executor task launch worker for task 14.0 in stage 3.0 (TID 446) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 128: Executor task launch worker for task 5.0 in stage 3.0 (TID 437) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 152: Executor task launch worker for task 33.0 in stage 3.0 (TID 465) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 133: Executor task launch worker for task 24.0 in stage 3.0 (TID 456) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 142: Executor task launch worker for task 3.0 in stage 3.0 (TID 435) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 134: Executor task launch worker for task 7.0 in stage 3.0 (TID 439) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 144: Executor task launch worker for task 28.0 in stage 3.0 (TID 460) 2023-02-10 11:12:07 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 148: Executor task launch worker for task 38.0 in stage 3.0 (TID 470) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 122: Executor task launch worker for task 20.0 in stage 3.0 (TID 452) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 147: Executor task launch worker for task 6.0 in stage 3.0 (TID 438) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 130: Executor task launch worker for task 22.0 in stage 3.0 (TID 454) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 132: Executor task launch worker for task 31.0 in stage 3.0 (TID 463) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 143: Executor task launch worker for task 16.0 in stage 3.0 (TID 448) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 138: Executor task launch worker for task 39.0 in stage 3.0 (TID 471) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 121: Executor task launch worker for task 25.0 in stage 3.0 (TID 457) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 151: Executor task launch worker for task 2.0 in stage 3.0 (TID 434) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 134: Executor task launch worker for task 7.0 in stage 3.0 (TID 439) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 118: Executor task launch worker for task 37.0 in stage 3.0 (TID 469) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 125: Executor task launch worker for task 29.0 in stage 3.0 (TID 461) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 146: Executor task launch worker for task 8.0 in stage 3.0 (TID 440) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 153: Executor task launch worker for task 0.0 in stage 3.0 (TID 432) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 145: Executor task launch worker for task 12.0 in stage 3.0 (TID 444) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 115: Executor task launch worker for task 9.0 in stage 3.0 (TID 441) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 126: Executor task launch worker for task 19.0 in stage 3.0 (TID 451) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 131: Executor task launch worker for task 15.0 in stage 3.0 (TID 447) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 158: Executor task launch worker for task 1.0 in stage 3.0 (TID 433) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 116: Executor task launch worker for task 10.0 in stage 3.0 (TID 442) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 127: Executor task launch worker for task 18.0 in stage 3.0 (TID 450) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 137: Executor task launch worker for task 11.0 in stage 3.0 (TID 443) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 144: Executor task launch worker for task 28.0 in stage 3.0 (TID 460) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 136: Executor task launch worker for task 21.0 in stage 3.0 (TID 453) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 140: Executor task launch worker for task 34.0 in stage 3.0 (TID 466) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 150: Executor task launch worker for task 30.0 in stage 3.0 (TID 462) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 159: Executor task launch worker for task 17.0 in stage 3.0 (TID 449) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 123: Executor task launch worker for task 23.0 in stage 3.0 (TID 455) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 124: Executor task launch worker for task 13.0 in stage 3.0 (TID 445) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 152: Executor task launch worker for task 33.0 in stage 3.0 (TID 465) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 128: Executor task launch worker for task 5.0 in stage 3.0 (TID 437) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 139: Executor task launch worker for task 27.0 in stage 3.0 (TID 459) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 149: Executor task launch worker for task 36.0 in stage 3.0 (TID 468) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 133: Executor task launch worker for task 24.0 in stage 3.0 (TID 456) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 120: Executor task launch worker for task 35.0 in stage 3.0 (TID 467) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 141: Executor task launch worker for task 14.0 in stage 3.0 (TID 446) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 148: Executor task launch worker for task 38.0 in stage 3.0 (TID 470) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 119: Executor task launch worker for task 32.0 in stage 3.0 (TID 464) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 117: Executor task launch worker for task 26.0 in stage 3.0 (TID 458) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 142: Executor task launch worker for task 3.0 in stage 3.0 (TID 435) 2023-02-10 11:12:10 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 114: Executor task launch worker for task 4.0 in stage 3.0 (TID 436) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=20, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 122: Executor task launch worker for task 20.0 in stage 3.0 (TID 452) 2023-02-10 11:12:12 Executor: INFO: Finished task 20.0 in stage 3.0 (TID 452). 966 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 40.0 in stage 3.0 (TID 472) (163.152.180.157, executor driver, partition 40, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 40.0 in stage 3.0 (TID 472) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 20.0 in stage 3.0 (TID 452) in 6796 ms on 163.152.180.157 (executor driver) (1/144) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 40.0 in stage 3.0 (TID 472) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=7, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 134: Executor task launch worker for task 7.0 in stage 3.0 (TID 439) 2023-02-10 11:12:12 Executor: INFO: Finished task 7.0 in stage 3.0 (TID 439). 970 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 41.0 in stage 3.0 (TID 473) (163.152.180.157, executor driver, partition 41, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 41.0 in stage 3.0 (TID 473) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 7.0 in stage 3.0 (TID 439) in 6834 ms on 163.152.180.157 (executor driver) (2/144) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 41.0 in stage 3.0 (TID 473) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=36, attempt=0, peakBytes=6356992, peakBytesReadable=6.06 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.1M allocated (5.3M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 149: Executor task launch worker for task 36.0 in stage 3.0 (TID 468) 2023-02-10 11:12:12 Executor: INFO: Finished task 36.0 in stage 3.0 (TID 468). 964 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 42.0 in stage 3.0 (TID 474) (163.152.180.157, executor driver, partition 42, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 42.0 in stage 3.0 (TID 474) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 36.0 in stage 3.0 (TID 468) in 6852 ms on 163.152.180.157 (executor driver) (3/144) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=8, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 146: Executor task launch worker for task 8.0 in stage 3.0 (TID 440) 2023-02-10 11:12:12 Executor: INFO: Finished task 8.0 in stage 3.0 (TID 440). 965 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 43.0 in stage 3.0 (TID 475) (163.152.180.157, executor driver, partition 43, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 43.0 in stage 3.0 (TID 475) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 8.0 in stage 3.0 (TID 440) in 6868 ms on 163.152.180.157 (executor driver) (4/144) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 149: Executor task launch worker for task 42.0 in stage 3.0 (TID 474) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=22, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 130: Executor task launch worker for task 22.0 in stage 3.0 (TID 454) 2023-02-10 11:12:12 Executor: INFO: Finished task 22.0 in stage 3.0 (TID 454). 964 bytes result sent to driver 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 134: Executor task launch worker for task 41.0 in stage 3.0 (TID 473) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 134: Executor task launch worker for task 41.0 in stage 3.0 (TID 473) 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 44.0 in stage 3.0 (TID 476) (163.152.180.157, executor driver, partition 44, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 22.0 in stage 3.0 (TID 454) in 6878 ms on 163.152.180.157 (executor driver) (5/144) 2023-02-10 11:12:12 Executor: INFO: Running task 44.0 in stage 3.0 (TID 476) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 43.0 in stage 3.0 (TID 475) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 44.0 in stage 3.0 (TID 476) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 122: Executor task launch worker for task 40.0 in stage 3.0 (TID 472) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 122: Executor task launch worker for task 40.0 in stage 3.0 (TID 472) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 134: Executor task launch worker for task 41.0 in stage 3.0 (TID 473) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 146: Executor task launch worker for task 43.0 in stage 3.0 (TID 475) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 146: Executor task launch worker for task 43.0 in stage 3.0 (TID 475) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=39, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 138: Executor task launch worker for task 39.0 in stage 3.0 (TID 471) 2023-02-10 11:12:12 Executor: INFO: Finished task 39.0 in stage 3.0 (TID 471). 965 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 45.0 in stage 3.0 (TID 477) (163.152.180.157, executor driver, partition 45, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=10, attempt=0, peakBytes=6488064, peakBytesReadable=6.19 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.2M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 116: Executor task launch worker for task 10.0 in stage 3.0 (TID 442) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 39.0 in stage 3.0 (TID 471) in 6912 ms on 163.152.180.157 (executor driver) (6/144) 2023-02-10 11:12:12 Executor: INFO: Running task 45.0 in stage 3.0 (TID 477) 2023-02-10 11:12:12 Executor: INFO: Finished task 10.0 in stage 3.0 (TID 442). 964 bytes result sent to driver 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=37, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 118: Executor task launch worker for task 37.0 in stage 3.0 (TID 469) 2023-02-10 11:12:12 Executor: INFO: Finished task 37.0 in stage 3.0 (TID 469). 970 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 46.0 in stage 3.0 (TID 478) (163.152.180.157, executor driver, partition 46, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 46.0 in stage 3.0 (TID 478) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 10.0 in stage 3.0 (TID 442) in 6922 ms on 163.152.180.157 (executor driver) (7/144) 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 47.0 in stage 3.0 (TID 479) (163.152.180.157, executor driver, partition 47, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 47.0 in stage 3.0 (TID 479) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 37.0 in stage 3.0 (TID 469) in 6924 ms on 163.152.180.157 (executor driver) (8/144) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 149: Executor task launch worker for task 42.0 in stage 3.0 (TID 474) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 149: Executor task launch worker for task 42.0 in stage 3.0 (TID 474) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 138: Executor task launch worker for task 45.0 in stage 3.0 (TID 477) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 46.0 in stage 3.0 (TID 478) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 130: Executor task launch worker for task 44.0 in stage 3.0 (TID 476) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 130: Executor task launch worker for task 44.0 in stage 3.0 (TID 476) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 47.0 in stage 3.0 (TID 479) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=0, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 153: Executor task launch worker for task 0.0 in stage 3.0 (TID 432) 2023-02-10 11:12:12 Executor: INFO: Finished task 0.0 in stage 3.0 (TID 432). 964 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 48.0 in stage 3.0 (TID 480) (163.152.180.157, executor driver, partition 48, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 0.0 in stage 3.0 (TID 432) in 6943 ms on 163.152.180.157 (executor driver) (9/144) 2023-02-10 11:12:12 Executor: INFO: Running task 48.0 in stage 3.0 (TID 480) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=6, attempt=0, peakBytes=6684672, peakBytesReadable=6.38 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.4M allocated (5.6M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 147: Executor task launch worker for task 6.0 in stage 3.0 (TID 438) 2023-02-10 11:12:12 Executor: INFO: Finished task 6.0 in stage 3.0 (TID 438). 964 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 49.0 in stage 3.0 (TID 481) (163.152.180.157, executor driver, partition 49, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 49.0 in stage 3.0 (TID 481) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 6.0 in stage 3.0 (TID 438) in 6949 ms on 163.152.180.157 (executor driver) (10/144) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 146: Executor task launch worker for task 43.0 in stage 3.0 (TID 475) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 48.0 in stage 3.0 (TID 480) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 49.0 in stage 3.0 (TID 481) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 122: Executor task launch worker for task 40.0 in stage 3.0 (TID 472) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 138: Executor task launch worker for task 45.0 in stage 3.0 (TID 477) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 138: Executor task launch worker for task 45.0 in stage 3.0 (TID 477) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=11, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 137: Executor task launch worker for task 11.0 in stage 3.0 (TID 443) 2023-02-10 11:12:12 Executor: INFO: Finished task 11.0 in stage 3.0 (TID 443). 964 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 50.0 in stage 3.0 (TID 482) (163.152.180.157, executor driver, partition 50, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=14, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 141: Executor task launch worker for task 14.0 in stage 3.0 (TID 446) 2023-02-10 11:12:12 Executor: INFO: Running task 50.0 in stage 3.0 (TID 482) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 11.0 in stage 3.0 (TID 443) in 6981 ms on 163.152.180.157 (executor driver) (11/144) 2023-02-10 11:12:12 Executor: INFO: Finished task 14.0 in stage 3.0 (TID 446). 965 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 51.0 in stage 3.0 (TID 483) (163.152.180.157, executor driver, partition 51, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 14.0 in stage 3.0 (TID 446) in 6982 ms on 163.152.180.157 (executor driver) (12/144) 2023-02-10 11:12:12 Executor: INFO: Running task 51.0 in stage 3.0 (TID 483) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=2, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 151: Executor task launch worker for task 2.0 in stage 3.0 (TID 434) 2023-02-10 11:12:12 Executor: INFO: Finished task 2.0 in stage 3.0 (TID 434). 968 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 52.0 in stage 3.0 (TID 484) (163.152.180.157, executor driver, partition 52, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 52.0 in stage 3.0 (TID 484) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 2.0 in stage 3.0 (TID 434) in 6990 ms on 163.152.180.157 (executor driver) (13/144) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 51.0 in stage 3.0 (TID 483) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 149: Executor task launch worker for task 42.0 in stage 3.0 (TID 474) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 118: Executor task launch worker for task 46.0 in stage 3.0 (TID 478) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 118: Executor task launch worker for task 46.0 in stage 3.0 (TID 478) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 50.0 in stage 3.0 (TID 482) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=31, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 132: Executor task launch worker for task 31.0 in stage 3.0 (TID 463) 2023-02-10 11:12:12 Executor: INFO: Finished task 31.0 in stage 3.0 (TID 463). 964 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 53.0 in stage 3.0 (TID 485) (163.152.180.157, executor driver, partition 53, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 53.0 in stage 3.0 (TID 485) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 31.0 in stage 3.0 (TID 463) in 6995 ms on 163.152.180.157 (executor driver) (14/144) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 116: Executor task launch worker for task 47.0 in stage 3.0 (TID 479) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 116: Executor task launch worker for task 47.0 in stage 3.0 (TID 479) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 130: Executor task launch worker for task 44.0 in stage 3.0 (TID 476) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=19, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 126: Executor task launch worker for task 19.0 in stage 3.0 (TID 451) 2023-02-10 11:12:12 Executor: INFO: Finished task 19.0 in stage 3.0 (TID 451). 965 bytes result sent to driver 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 52.0 in stage 3.0 (TID 484) 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 54.0 in stage 3.0 (TID 486) (163.152.180.157, executor driver, partition 54, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 54.0 in stage 3.0 (TID 486) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 19.0 in stage 3.0 (TID 451) in 7003 ms on 163.152.180.157 (executor driver) (15/144) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=9, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 115: Executor task launch worker for task 9.0 in stage 3.0 (TID 441) 2023-02-10 11:12:12 Executor: INFO: Finished task 9.0 in stage 3.0 (TID 441). 965 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 55.0 in stage 3.0 (TID 487) (163.152.180.157, executor driver, partition 55, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 9.0 in stage 3.0 (TID 441) in 7006 ms on 163.152.180.157 (executor driver) (16/144) 2023-02-10 11:12:12 Executor: INFO: Running task 55.0 in stage 3.0 (TID 487) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 53.0 in stage 3.0 (TID 485) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 153: Executor task launch worker for task 48.0 in stage 3.0 (TID 480) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 153: Executor task launch worker for task 48.0 in stage 3.0 (TID 480) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=12, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 145: Executor task launch worker for task 12.0 in stage 3.0 (TID 444) 2023-02-10 11:12:12 Executor: INFO: Finished task 12.0 in stage 3.0 (TID 444). 966 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 56.0 in stage 3.0 (TID 488) (163.152.180.157, executor driver, partition 56, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 56.0 in stage 3.0 (TID 488) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 12.0 in stage 3.0 (TID 444) in 7014 ms on 163.152.180.157 (executor driver) (17/144) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 54.0 in stage 3.0 (TID 486) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=16, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 143: Executor task launch worker for task 16.0 in stage 3.0 (TID 448) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 55.0 in stage 3.0 (TID 487) 2023-02-10 11:12:12 Executor: INFO: Finished task 16.0 in stage 3.0 (TID 448). 964 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 57.0 in stage 3.0 (TID 489) (163.152.180.157, executor driver, partition 57, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 16.0 in stage 3.0 (TID 448) in 7021 ms on 163.152.180.157 (executor driver) (18/144) 2023-02-10 11:12:12 Executor: INFO: Running task 57.0 in stage 3.0 (TID 489) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=3, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 142: Executor task launch worker for task 3.0 in stage 3.0 (TID 435) 2023-02-10 11:12:12 Executor: INFO: Finished task 3.0 in stage 3.0 (TID 435). 964 bytes result sent to driver 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 56.0 in stage 3.0 (TID 488) 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 58.0 in stage 3.0 (TID 490) (163.152.180.157, executor driver, partition 58, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 58.0 in stage 3.0 (TID 490) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 3.0 in stage 3.0 (TID 435) in 7027 ms on 163.152.180.157 (executor driver) (19/144) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=28, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 144: Executor task launch worker for task 28.0 in stage 3.0 (TID 460) 2023-02-10 11:12:12 Executor: INFO: Finished task 28.0 in stage 3.0 (TID 460). 965 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 59.0 in stage 3.0 (TID 491) (163.152.180.157, executor driver, partition 59, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 59.0 in stage 3.0 (TID 491) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 147: Executor task launch worker for task 49.0 in stage 3.0 (TID 481) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 28.0 in stage 3.0 (TID 460) in 7025 ms on 163.152.180.157 (executor driver) (20/144) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 147: Executor task launch worker for task 49.0 in stage 3.0 (TID 481) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=21, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 136: Executor task launch worker for task 21.0 in stage 3.0 (TID 453) 2023-02-10 11:12:12 Executor: INFO: Finished task 21.0 in stage 3.0 (TID 453). 967 bytes result sent to driver 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=4, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 114: Executor task launch worker for task 4.0 in stage 3.0 (TID 436) 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 60.0 in stage 3.0 (TID 492) (163.152.180.157, executor driver, partition 60, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Finished task 4.0 in stage 3.0 (TID 436). 964 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 21.0 in stage 3.0 (TID 453) in 7028 ms on 163.152.180.157 (executor driver) (21/144) 2023-02-10 11:12:12 Executor: INFO: Running task 60.0 in stage 3.0 (TID 492) 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 61.0 in stage 3.0 (TID 493) (163.152.180.157, executor driver, partition 61, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 61.0 in stage 3.0 (TID 493) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 4.0 in stage 3.0 (TID 436) in 7031 ms on 163.152.180.157 (executor driver) (22/144) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 57.0 in stage 3.0 (TID 489) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=27, attempt=0, peakBytes=6488064, peakBytesReadable=6.19 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.2M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 139: Executor task launch worker for task 27.0 in stage 3.0 (TID 459) 2023-02-10 11:12:12 Executor: INFO: Finished task 27.0 in stage 3.0 (TID 459). 964 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 62.0 in stage 3.0 (TID 494) (163.152.180.157, executor driver, partition 62, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 62.0 in stage 3.0 (TID 494) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 27.0 in stage 3.0 (TID 459) in 7038 ms on 163.152.180.157 (executor driver) (23/144) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 58.0 in stage 3.0 (TID 490) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 59.0 in stage 3.0 (TID 491) 2023-02-10 11:12:12 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 138: Executor task launch worker for task 45.0 in stage 3.0 (TID 477) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 60.0 in stage 3.0 (TID 492) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=38, attempt=0, peakBytes=6356992, peakBytesReadable=6.06 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.1M allocated (5.3M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 148: Executor task launch worker for task 38.0 in stage 3.0 (TID 470) 2023-02-10 11:12:12 Executor: INFO: Finished task 38.0 in stage 3.0 (TID 470). 964 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 63.0 in stage 3.0 (TID 495) (163.152.180.157, executor driver, partition 63, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 63.0 in stage 3.0 (TID 495) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 38.0 in stage 3.0 (TID 470) in 7046 ms on 163.152.180.157 (executor driver) (24/144) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=17, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 159: Executor task launch worker for task 17.0 in stage 3.0 (TID 449) 2023-02-10 11:12:12 Executor: INFO: Finished task 17.0 in stage 3.0 (TID 449). 964 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 64.0 in stage 3.0 (TID 496) (163.152.180.157, executor driver, partition 64, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 17.0 in stage 3.0 (TID 449) in 7050 ms on 163.152.180.157 (executor driver) (25/144) 2023-02-10 11:12:12 Executor: INFO: Running task 64.0 in stage 3.0 (TID 496) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 61.0 in stage 3.0 (TID 493) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=29, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 125: Executor task launch worker for task 29.0 in stage 3.0 (TID 461) 2023-02-10 11:12:12 Executor: INFO: Finished task 29.0 in stage 3.0 (TID 461). 977 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 65.0 in stage 3.0 (TID 497) (163.152.180.157, executor driver, partition 65, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 29.0 in stage 3.0 (TID 461) in 7050 ms on 163.152.180.157 (executor driver) (26/144) 2023-02-10 11:12:12 Executor: INFO: Running task 65.0 in stage 3.0 (TID 497) 2023-02-10 11:12:12 root: INFO: TaskReport: stage=3, partition=30, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:12 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 150: Executor task launch worker for task 30.0 in stage 3.0 (TID 462) 2023-02-10 11:12:12 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 62.0 in stage 3.0 (TID 494) 2023-02-10 11:12:12 Executor: INFO: Finished task 30.0 in stage 3.0 (TID 462). 970 bytes result sent to driver 2023-02-10 11:12:12 TaskSetManager: INFO: Starting task 66.0 in stage 3.0 (TID 498) (163.152.180.157, executor driver, partition 66, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:12 Executor: INFO: Running task 66.0 in stage 3.0 (TID 498) 2023-02-10 11:12:12 TaskSetManager: INFO: Finished task 30.0 in stage 3.0 (TID 462) in 7053 ms on 163.152.180.157 (executor driver) (27/144) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 63.0 in stage 3.0 (TID 495) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 64.0 in stage 3.0 (TID 496) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 125: Executor task launch worker for task 65.0 in stage 3.0 (TID 497) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 141: Executor task launch worker for task 51.0 in stage 3.0 (TID 483) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 141: Executor task launch worker for task 51.0 in stage 3.0 (TID 483) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 66.0 in stage 3.0 (TID 498) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 151: Executor task launch worker for task 52.0 in stage 3.0 (TID 484) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 151: Executor task launch worker for task 52.0 in stage 3.0 (TID 484) 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=23, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 123: Executor task launch worker for task 23.0 in stage 3.0 (TID 455) 2023-02-10 11:12:13 Executor: INFO: Finished task 23.0 in stage 3.0 (TID 455). 964 bytes result sent to driver 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 67.0 in stage 3.0 (TID 499) (163.152.180.157, executor driver, partition 67, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 Executor: INFO: Running task 67.0 in stage 3.0 (TID 499) 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 23.0 in stage 3.0 (TID 455) in 7073 ms on 163.152.180.157 (executor driver) (28/144) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 137: Executor task launch worker for task 50.0 in stage 3.0 (TID 482) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 137: Executor task launch worker for task 50.0 in stage 3.0 (TID 482) 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=35, attempt=0, peakBytes=6488064, peakBytesReadable=6.19 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.2M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 120: Executor task launch worker for task 35.0 in stage 3.0 (TID 467) 2023-02-10 11:12:13 Executor: INFO: Finished task 35.0 in stage 3.0 (TID 467). 966 bytes result sent to driver 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 68.0 in stage 3.0 (TID 500) (163.152.180.157, executor driver, partition 68, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 Executor: INFO: Running task 68.0 in stage 3.0 (TID 500) 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 35.0 in stage 3.0 (TID 467) in 7075 ms on 163.152.180.157 (executor driver) (29/144) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 123: Executor task launch worker for task 67.0 in stage 3.0 (TID 499) 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=34, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 140: Executor task launch worker for task 34.0 in stage 3.0 (TID 466) 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=24, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 133: Executor task launch worker for task 24.0 in stage 3.0 (TID 456) 2023-02-10 11:12:13 Executor: INFO: Finished task 34.0 in stage 3.0 (TID 466). 964 bytes result sent to driver 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=13, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 124: Executor task launch worker for task 13.0 in stage 3.0 (TID 445) 2023-02-10 11:12:13 Executor: INFO: Finished task 24.0 in stage 3.0 (TID 456). 965 bytes result sent to driver 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 69.0 in stage 3.0 (TID 501) (163.152.180.157, executor driver, partition 69, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 68.0 in stage 3.0 (TID 500) 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 34.0 in stage 3.0 (TID 466) in 7086 ms on 163.152.180.157 (executor driver) (30/144) 2023-02-10 11:12:13 Executor: INFO: Running task 69.0 in stage 3.0 (TID 501) 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 70.0 in stage 3.0 (TID 502) (163.152.180.157, executor driver, partition 70, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 Executor: INFO: Finished task 13.0 in stage 3.0 (TID 445). 964 bytes result sent to driver 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 24.0 in stage 3.0 (TID 456) in 7087 ms on 163.152.180.157 (executor driver) (31/144) 2023-02-10 11:12:13 Executor: INFO: Running task 70.0 in stage 3.0 (TID 502) 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 71.0 in stage 3.0 (TID 503) (163.152.180.157, executor driver, partition 71, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 132: Executor task launch worker for task 53.0 in stage 3.0 (TID 485) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 132: Executor task launch worker for task 53.0 in stage 3.0 (TID 485) 2023-02-10 11:12:13 Executor: INFO: Running task 71.0 in stage 3.0 (TID 503) 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 13.0 in stage 3.0 (TID 445) in 7090 ms on 163.152.180.157 (executor driver) (32/144) 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=33, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 152: Executor task launch worker for task 33.0 in stage 3.0 (TID 465) 2023-02-10 11:12:13 Executor: INFO: Finished task 33.0 in stage 3.0 (TID 465). 964 bytes result sent to driver 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 72.0 in stage 3.0 (TID 504) (163.152.180.157, executor driver, partition 72, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 33.0 in stage 3.0 (TID 465) in 7098 ms on 163.152.180.157 (executor driver) (33/144) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 126: Executor task launch worker for task 54.0 in stage 3.0 (TID 486) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 126: Executor task launch worker for task 54.0 in stage 3.0 (TID 486) 2023-02-10 11:12:13 Executor: INFO: Running task 72.0 in stage 3.0 (TID 504) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 71.0 in stage 3.0 (TID 503) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 129: Executor task launch worker for task 70.0 in stage 3.0 (TID 502) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 69.0 in stage 3.0 (TID 501) 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=18, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 127: Executor task launch worker for task 18.0 in stage 3.0 (TID 450) 2023-02-10 11:12:13 Executor: INFO: Finished task 18.0 in stage 3.0 (TID 450). 975 bytes result sent to driver 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 73.0 in stage 3.0 (TID 505) (163.152.180.157, executor driver, partition 73, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 18.0 in stage 3.0 (TID 450) in 7107 ms on 163.152.180.157 (executor driver) (34/144) 2023-02-10 11:12:13 Executor: INFO: Running task 73.0 in stage 3.0 (TID 505) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 72.0 in stage 3.0 (TID 504) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 115: Executor task launch worker for task 55.0 in stage 3.0 (TID 487) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 115: Executor task launch worker for task 55.0 in stage 3.0 (TID 487) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 116: Executor task launch worker for task 47.0 in stage 3.0 (TID 479) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 118: Executor task launch worker for task 46.0 in stage 3.0 (TID 478) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 73.0 in stage 3.0 (TID 505) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 145: Executor task launch worker for task 56.0 in stage 3.0 (TID 488) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 145: Executor task launch worker for task 56.0 in stage 3.0 (TID 488) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 142: Executor task launch worker for task 58.0 in stage 3.0 (TID 490) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 142: Executor task launch worker for task 58.0 in stage 3.0 (TID 490) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 153: Executor task launch worker for task 48.0 in stage 3.0 (TID 480) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 143: Executor task launch worker for task 57.0 in stage 3.0 (TID 489) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 143: Executor task launch worker for task 57.0 in stage 3.0 (TID 489) 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=26, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 117: Executor task launch worker for task 26.0 in stage 3.0 (TID 458) 2023-02-10 11:12:13 Executor: INFO: Finished task 26.0 in stage 3.0 (TID 458). 968 bytes result sent to driver 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 74.0 in stage 3.0 (TID 506) (163.152.180.157, executor driver, partition 74, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=25, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 121: Executor task launch worker for task 25.0 in stage 3.0 (TID 457) 2023-02-10 11:12:13 Executor: INFO: Running task 74.0 in stage 3.0 (TID 506) 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 26.0 in stage 3.0 (TID 458) in 7132 ms on 163.152.180.157 (executor driver) (35/144) 2023-02-10 11:12:13 Executor: INFO: Finished task 25.0 in stage 3.0 (TID 457). 964 bytes result sent to driver 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 75.0 in stage 3.0 (TID 507) (163.152.180.157, executor driver, partition 75, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 25.0 in stage 3.0 (TID 457) in 7133 ms on 163.152.180.157 (executor driver) (36/144) 2023-02-10 11:12:13 Executor: INFO: Running task 75.0 in stage 3.0 (TID 507) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 114: Executor task launch worker for task 61.0 in stage 3.0 (TID 493) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 144: Executor task launch worker for task 59.0 in stage 3.0 (TID 491) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 114: Executor task launch worker for task 61.0 in stage 3.0 (TID 493) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 144: Executor task launch worker for task 59.0 in stage 3.0 (TID 491) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 136: Executor task launch worker for task 60.0 in stage 3.0 (TID 492) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 136: Executor task launch worker for task 60.0 in stage 3.0 (TID 492) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 139: Executor task launch worker for task 62.0 in stage 3.0 (TID 494) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 139: Executor task launch worker for task 62.0 in stage 3.0 (TID 494) 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=15, attempt=0, peakBytes=6815744, peakBytesReadable=6.50 MiB, chunks requested=21, cache hits=19 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.5M allocated (5.8M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 131: Executor task launch worker for task 15.0 in stage 3.0 (TID 447) 2023-02-10 11:12:13 Executor: INFO: Finished task 15.0 in stage 3.0 (TID 447). 965 bytes result sent to driver 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 76.0 in stage 3.0 (TID 508) (163.152.180.157, executor driver, partition 76, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 Executor: INFO: Running task 76.0 in stage 3.0 (TID 508) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 74.0 in stage 3.0 (TID 506) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 121: Executor task launch worker for task 75.0 in stage 3.0 (TID 507) 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 15.0 in stage 3.0 (TID 447) in 7147 ms on 163.152.180.157 (executor driver) (37/144) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 147: Executor task launch worker for task 49.0 in stage 3.0 (TID 481) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 148: Executor task launch worker for task 63.0 in stage 3.0 (TID 495) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 148: Executor task launch worker for task 63.0 in stage 3.0 (TID 495) 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=1, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 158: Executor task launch worker for task 1.0 in stage 3.0 (TID 433) 2023-02-10 11:12:13 Executor: INFO: Finished task 1.0 in stage 3.0 (TID 433). 964 bytes result sent to driver 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 77.0 in stage 3.0 (TID 509) (163.152.180.157, executor driver, partition 77, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 1.0 in stage 3.0 (TID 433) in 7160 ms on 163.152.180.157 (executor driver) (38/144) 2023-02-10 11:12:13 Executor: INFO: Running task 77.0 in stage 3.0 (TID 509) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 76.0 in stage 3.0 (TID 508) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 159: Executor task launch worker for task 64.0 in stage 3.0 (TID 496) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 125: Executor task launch worker for task 65.0 in stage 3.0 (TID 497) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 159: Executor task launch worker for task 64.0 in stage 3.0 (TID 496) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 125: Executor task launch worker for task 65.0 in stage 3.0 (TID 497) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 150: Executor task launch worker for task 66.0 in stage 3.0 (TID 498) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 150: Executor task launch worker for task 66.0 in stage 3.0 (TID 498) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 158: Executor task launch worker for task 77.0 in stage 3.0 (TID 509) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 120: Executor task launch worker for task 68.0 in stage 3.0 (TID 500) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 120: Executor task launch worker for task 68.0 in stage 3.0 (TID 500) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 123: Executor task launch worker for task 67.0 in stage 3.0 (TID 499) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 123: Executor task launch worker for task 67.0 in stage 3.0 (TID 499) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 141: Executor task launch worker for task 51.0 in stage 3.0 (TID 483) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 133: Executor task launch worker for task 71.0 in stage 3.0 (TID 503) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 151: Executor task launch worker for task 52.0 in stage 3.0 (TID 484) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 133: Executor task launch worker for task 71.0 in stage 3.0 (TID 503) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 129: Executor task launch worker for task 70.0 in stage 3.0 (TID 502) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 129: Executor task launch worker for task 70.0 in stage 3.0 (TID 502) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 140: Executor task launch worker for task 69.0 in stage 3.0 (TID 501) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 140: Executor task launch worker for task 69.0 in stage 3.0 (TID 501) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 137: Executor task launch worker for task 50.0 in stage 3.0 (TID 482) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 152: Executor task launch worker for task 72.0 in stage 3.0 (TID 504) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 127: Executor task launch worker for task 73.0 in stage 3.0 (TID 505) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 152: Executor task launch worker for task 72.0 in stage 3.0 (TID 504) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 127: Executor task launch worker for task 73.0 in stage 3.0 (TID 505) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 132: Executor task launch worker for task 53.0 in stage 3.0 (TID 485) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 126: Executor task launch worker for task 54.0 in stage 3.0 (TID 486) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 121: Executor task launch worker for task 75.0 in stage 3.0 (TID 507) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 121: Executor task launch worker for task 75.0 in stage 3.0 (TID 507) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 145: Executor task launch worker for task 56.0 in stage 3.0 (TID 488) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 115: Executor task launch worker for task 55.0 in stage 3.0 (TID 487) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 117: Executor task launch worker for task 74.0 in stage 3.0 (TID 506) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 117: Executor task launch worker for task 74.0 in stage 3.0 (TID 506) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 142: Executor task launch worker for task 58.0 in stage 3.0 (TID 490) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 143: Executor task launch worker for task 57.0 in stage 3.0 (TID 489) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 144: Executor task launch worker for task 59.0 in stage 3.0 (TID 491) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 148: Executor task launch worker for task 63.0 in stage 3.0 (TID 495) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 114: Executor task launch worker for task 61.0 in stage 3.0 (TID 493) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 136: Executor task launch worker for task 60.0 in stage 3.0 (TID 492) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 139: Executor task launch worker for task 62.0 in stage 3.0 (TID 494) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 131: Executor task launch worker for task 76.0 in stage 3.0 (TID 508) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 131: Executor task launch worker for task 76.0 in stage 3.0 (TID 508) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 125: Executor task launch worker for task 65.0 in stage 3.0 (TID 497) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 158: Executor task launch worker for task 77.0 in stage 3.0 (TID 509) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 158: Executor task launch worker for task 77.0 in stage 3.0 (TID 509) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 159: Executor task launch worker for task 64.0 in stage 3.0 (TID 496) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 150: Executor task launch worker for task 66.0 in stage 3.0 (TID 498) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 123: Executor task launch worker for task 67.0 in stage 3.0 (TID 499) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 133: Executor task launch worker for task 71.0 in stage 3.0 (TID 503) 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=32, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 119: Executor task launch worker for task 32.0 in stage 3.0 (TID 464) 2023-02-10 11:12:13 Executor: INFO: Finished task 32.0 in stage 3.0 (TID 464). 964 bytes result sent to driver 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 78.0 in stage 3.0 (TID 510) (163.152.180.157, executor driver, partition 78, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 Executor: INFO: Running task 78.0 in stage 3.0 (TID 510) 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 32.0 in stage 3.0 (TID 464) in 7270 ms on 163.152.180.157 (executor driver) (39/144) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 127: Executor task launch worker for task 73.0 in stage 3.0 (TID 505) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 140: Executor task launch worker for task 69.0 in stage 3.0 (TID 501) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 78.0 in stage 3.0 (TID 510) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 117: Executor task launch worker for task 74.0 in stage 3.0 (TID 506) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 121: Executor task launch worker for task 75.0 in stage 3.0 (TID 507) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 120: Executor task launch worker for task 68.0 in stage 3.0 (TID 500) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 152: Executor task launch worker for task 72.0 in stage 3.0 (TID 504) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 129: Executor task launch worker for task 70.0 in stage 3.0 (TID 502) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 134: Executor task launch worker for task 41.0 in stage 3.0 (TID 473) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 119: Executor task launch worker for task 78.0 in stage 3.0 (TID 510) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 119: Executor task launch worker for task 78.0 in stage 3.0 (TID 510) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 158: Executor task launch worker for task 77.0 in stage 3.0 (TID 509) 2023-02-10 11:12:13 root: INFO: TaskReport: stage=3, partition=5, attempt=0, peakBytes=6881280, peakBytesReadable=6.56 MiB, chunks requested=21, cache hits=19 2023-02-10 11:12:13 root: INFO: RegionPool: FREE: 6.6M allocated (5.8M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 128: Executor task launch worker for task 5.0 in stage 3.0 (TID 437) 2023-02-10 11:12:13 Executor: INFO: Finished task 5.0 in stage 3.0 (TID 437). 965 bytes result sent to driver 2023-02-10 11:12:13 TaskSetManager: INFO: Starting task 79.0 in stage 3.0 (TID 511) (163.152.180.157, executor driver, partition 79, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:13 TaskSetManager: INFO: Finished task 5.0 in stage 3.0 (TID 437) in 7397 ms on 163.152.180.157 (executor driver) (40/144) 2023-02-10 11:12:13 Executor: INFO: Running task 79.0 in stage 3.0 (TID 511) 2023-02-10 11:12:13 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 79.0 in stage 3.0 (TID 511) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 131: Executor task launch worker for task 76.0 in stage 3.0 (TID 508) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 122: Executor task launch worker for task 40.0 in stage 3.0 (TID 472) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 146: Executor task launch worker for task 43.0 in stage 3.0 (TID 475) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 149: Executor task launch worker for task 42.0 in stage 3.0 (TID 474) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 130: Executor task launch worker for task 44.0 in stage 3.0 (TID 476) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 128: Executor task launch worker for task 79.0 in stage 3.0 (TID 511) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 128: Executor task launch worker for task 79.0 in stage 3.0 (TID 511) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 138: Executor task launch worker for task 45.0 in stage 3.0 (TID 477) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 119: Executor task launch worker for task 78.0 in stage 3.0 (TID 510) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 116: Executor task launch worker for task 47.0 in stage 3.0 (TID 479) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 128: Executor task launch worker for task 79.0 in stage 3.0 (TID 511) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 118: Executor task launch worker for task 46.0 in stage 3.0 (TID 478) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 153: Executor task launch worker for task 48.0 in stage 3.0 (TID 480) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 137: Executor task launch worker for task 50.0 in stage 3.0 (TID 482) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 141: Executor task launch worker for task 51.0 in stage 3.0 (TID 483) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 147: Executor task launch worker for task 49.0 in stage 3.0 (TID 481) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 145: Executor task launch worker for task 56.0 in stage 3.0 (TID 488) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 144: Executor task launch worker for task 59.0 in stage 3.0 (TID 491) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 114: Executor task launch worker for task 61.0 in stage 3.0 (TID 493) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 115: Executor task launch worker for task 55.0 in stage 3.0 (TID 487) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 126: Executor task launch worker for task 54.0 in stage 3.0 (TID 486) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 143: Executor task launch worker for task 57.0 in stage 3.0 (TID 489) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 151: Executor task launch worker for task 52.0 in stage 3.0 (TID 484) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 139: Executor task launch worker for task 62.0 in stage 3.0 (TID 494) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 136: Executor task launch worker for task 60.0 in stage 3.0 (TID 492) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 150: Executor task launch worker for task 66.0 in stage 3.0 (TID 498) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 123: Executor task launch worker for task 67.0 in stage 3.0 (TID 499) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 148: Executor task launch worker for task 63.0 in stage 3.0 (TID 495) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 125: Executor task launch worker for task 65.0 in stage 3.0 (TID 497) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 142: Executor task launch worker for task 58.0 in stage 3.0 (TID 490) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 121: Executor task launch worker for task 75.0 in stage 3.0 (TID 507) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 159: Executor task launch worker for task 64.0 in stage 3.0 (TID 496) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 152: Executor task launch worker for task 72.0 in stage 3.0 (TID 504) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 117: Executor task launch worker for task 74.0 in stage 3.0 (TID 506) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 158: Executor task launch worker for task 77.0 in stage 3.0 (TID 509) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 127: Executor task launch worker for task 73.0 in stage 3.0 (TID 505) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 120: Executor task launch worker for task 68.0 in stage 3.0 (TID 500) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 140: Executor task launch worker for task 69.0 in stage 3.0 (TID 501) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 133: Executor task launch worker for task 71.0 in stage 3.0 (TID 503) 2023-02-10 11:12:13 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 132: Executor task launch worker for task 53.0 in stage 3.0 (TID 485) 2023-02-10 11:12:14 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 129: Executor task launch worker for task 70.0 in stage 3.0 (TID 502) 2023-02-10 11:12:14 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 131: Executor task launch worker for task 76.0 in stage 3.0 (TID 508) 2023-02-10 11:12:14 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 119: Executor task launch worker for task 78.0 in stage 3.0 (TID 510) 2023-02-10 11:12:14 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 128: Executor task launch worker for task 79.0 in stage 3.0 (TID 511) 2023-02-10 11:12:15 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 134: Executor task launch worker for task 41.0 in stage 3.0 (TID 473) 2023-02-10 11:12:15 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 149: Executor task launch worker for task 42.0 in stage 3.0 (TID 474) 2023-02-10 11:12:15 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 122: Executor task launch worker for task 40.0 in stage 3.0 (TID 472) 2023-02-10 11:12:15 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 130: Executor task launch worker for task 44.0 in stage 3.0 (TID 476) 2023-02-10 11:12:15 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 146: Executor task launch worker for task 43.0 in stage 3.0 (TID 475) 2023-02-10 11:12:15 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 116: Executor task launch worker for task 47.0 in stage 3.0 (TID 479) 2023-02-10 11:12:15 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 138: Executor task launch worker for task 45.0 in stage 3.0 (TID 477) 2023-02-10 11:12:15 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 137: Executor task launch worker for task 50.0 in stage 3.0 (TID 482) 2023-02-10 11:12:15 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 153: Executor task launch worker for task 48.0 in stage 3.0 (TID 480) 2023-02-10 11:12:15 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 118: Executor task launch worker for task 46.0 in stage 3.0 (TID 478) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 147: Executor task launch worker for task 49.0 in stage 3.0 (TID 481) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 141: Executor task launch worker for task 51.0 in stage 3.0 (TID 483) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 151: Executor task launch worker for task 52.0 in stage 3.0 (TID 484) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 114: Executor task launch worker for task 61.0 in stage 3.0 (TID 493) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 139: Executor task launch worker for task 62.0 in stage 3.0 (TID 494) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 150: Executor task launch worker for task 66.0 in stage 3.0 (TID 498) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 143: Executor task launch worker for task 57.0 in stage 3.0 (TID 489) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 158: Executor task launch worker for task 77.0 in stage 3.0 (TID 509) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 115: Executor task launch worker for task 55.0 in stage 3.0 (TID 487) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 136: Executor task launch worker for task 60.0 in stage 3.0 (TID 492) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 126: Executor task launch worker for task 54.0 in stage 3.0 (TID 486) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 144: Executor task launch worker for task 59.0 in stage 3.0 (TID 491) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 117: Executor task launch worker for task 74.0 in stage 3.0 (TID 506) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 152: Executor task launch worker for task 72.0 in stage 3.0 (TID 504) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 120: Executor task launch worker for task 68.0 in stage 3.0 (TID 500) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 159: Executor task launch worker for task 64.0 in stage 3.0 (TID 496) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 145: Executor task launch worker for task 56.0 in stage 3.0 (TID 488) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 140: Executor task launch worker for task 69.0 in stage 3.0 (TID 501) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 127: Executor task launch worker for task 73.0 in stage 3.0 (TID 505) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 142: Executor task launch worker for task 58.0 in stage 3.0 (TID 490) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 123: Executor task launch worker for task 67.0 in stage 3.0 (TID 499) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 131: Executor task launch worker for task 76.0 in stage 3.0 (TID 508) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 132: Executor task launch worker for task 53.0 in stage 3.0 (TID 485) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 129: Executor task launch worker for task 70.0 in stage 3.0 (TID 502) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 148: Executor task launch worker for task 63.0 in stage 3.0 (TID 495) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 128: Executor task launch worker for task 79.0 in stage 3.0 (TID 511) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 133: Executor task launch worker for task 71.0 in stage 3.0 (TID 503) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 125: Executor task launch worker for task 65.0 in stage 3.0 (TID 497) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 119: Executor task launch worker for task 78.0 in stage 3.0 (TID 510) 2023-02-10 11:12:16 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 121: Executor task launch worker for task 75.0 in stage 3.0 (TID 507) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=41, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 134: Executor task launch worker for task 41.0 in stage 3.0 (TID 473) 2023-02-10 11:12:18 Executor: INFO: Finished task 41.0 in stage 3.0 (TID 473). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 80.0 in stage 3.0 (TID 512) (163.152.180.157, executor driver, partition 80, PROCESS_LOCAL, 4432 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 41.0 in stage 3.0 (TID 473) in 5462 ms on 163.152.180.157 (executor driver) (41/144) 2023-02-10 11:12:18 Executor: INFO: Running task 80.0 in stage 3.0 (TID 512) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 80.0 in stage 3.0 (TID 512) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 134: Executor task launch worker for task 80.0 in stage 3.0 (TID 512) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 134: Executor task launch worker for task 80.0 in stage 3.0 (TID 512) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=42, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 149: Executor task launch worker for task 42.0 in stage 3.0 (TID 474) 2023-02-10 11:12:18 Executor: INFO: Finished task 42.0 in stage 3.0 (TID 474). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 81.0 in stage 3.0 (TID 513) (163.152.180.157, executor driver, partition 81, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 42.0 in stage 3.0 (TID 474) in 5496 ms on 163.152.180.157 (executor driver) (42/144) 2023-02-10 11:12:18 Executor: INFO: Running task 81.0 in stage 3.0 (TID 513) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=43, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 146: Executor task launch worker for task 43.0 in stage 3.0 (TID 475) 2023-02-10 11:12:18 Executor: INFO: Finished task 43.0 in stage 3.0 (TID 475). 987 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 82.0 in stage 3.0 (TID 514) (163.152.180.157, executor driver, partition 82, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 43.0 in stage 3.0 (TID 475) in 5492 ms on 163.152.180.157 (executor driver) (43/144) 2023-02-10 11:12:18 Executor: INFO: Running task 82.0 in stage 3.0 (TID 514) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 149: Executor task launch worker for task 81.0 in stage 3.0 (TID 513) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 134: Executor task launch worker for task 80.0 in stage 3.0 (TID 512) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 82.0 in stage 3.0 (TID 514) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 149: Executor task launch worker for task 81.0 in stage 3.0 (TID 513) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 149: Executor task launch worker for task 81.0 in stage 3.0 (TID 513) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 146: Executor task launch worker for task 82.0 in stage 3.0 (TID 514) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 146: Executor task launch worker for task 82.0 in stage 3.0 (TID 514) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 146: Executor task launch worker for task 82.0 in stage 3.0 (TID 514) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=47, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 116: Executor task launch worker for task 47.0 in stage 3.0 (TID 479) 2023-02-10 11:12:18 Executor: INFO: Finished task 47.0 in stage 3.0 (TID 479). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 83.0 in stage 3.0 (TID 515) (163.152.180.157, executor driver, partition 83, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 47.0 in stage 3.0 (TID 479) in 5545 ms on 163.152.180.157 (executor driver) (44/144) 2023-02-10 11:12:18 Executor: INFO: Running task 83.0 in stage 3.0 (TID 515) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 149: Executor task launch worker for task 81.0 in stage 3.0 (TID 513) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 83.0 in stage 3.0 (TID 515) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=40, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 122: Executor task launch worker for task 40.0 in stage 3.0 (TID 472) 2023-02-10 11:12:18 Executor: INFO: Finished task 40.0 in stage 3.0 (TID 472). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 84.0 in stage 3.0 (TID 516) (163.152.180.157, executor driver, partition 84, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 40.0 in stage 3.0 (TID 472) in 5711 ms on 163.152.180.157 (executor driver) (45/144) 2023-02-10 11:12:18 Executor: INFO: Running task 84.0 in stage 3.0 (TID 516) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 116: Executor task launch worker for task 83.0 in stage 3.0 (TID 515) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 116: Executor task launch worker for task 83.0 in stage 3.0 (TID 515) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 84.0 in stage 3.0 (TID 516) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=46, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 118: Executor task launch worker for task 46.0 in stage 3.0 (TID 478) 2023-02-10 11:12:18 Executor: INFO: Finished task 46.0 in stage 3.0 (TID 478). 966 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 85.0 in stage 3.0 (TID 517) (163.152.180.157, executor driver, partition 85, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 46.0 in stage 3.0 (TID 478) in 5603 ms on 163.152.180.157 (executor driver) (46/144) 2023-02-10 11:12:18 Executor: INFO: Running task 85.0 in stage 3.0 (TID 517) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 85.0 in stage 3.0 (TID 517) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=50, attempt=0, peakBytes=6488064, peakBytesReadable=6.19 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.2M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 137: Executor task launch worker for task 50.0 in stage 3.0 (TID 482) 2023-02-10 11:12:18 Executor: INFO: Finished task 50.0 in stage 3.0 (TID 482). 967 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 86.0 in stage 3.0 (TID 518) (163.152.180.157, executor driver, partition 86, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 Executor: INFO: Running task 86.0 in stage 3.0 (TID 518) 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 50.0 in stage 3.0 (TID 482) in 5563 ms on 163.152.180.157 (executor driver) (47/144) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 116: Executor task launch worker for task 83.0 in stage 3.0 (TID 515) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 122: Executor task launch worker for task 84.0 in stage 3.0 (TID 516) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 122: Executor task launch worker for task 84.0 in stage 3.0 (TID 516) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 86.0 in stage 3.0 (TID 518) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 118: Executor task launch worker for task 85.0 in stage 3.0 (TID 517) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 118: Executor task launch worker for task 85.0 in stage 3.0 (TID 517) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=45, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 138: Executor task launch worker for task 45.0 in stage 3.0 (TID 477) 2023-02-10 11:12:18 Executor: INFO: Finished task 45.0 in stage 3.0 (TID 477). 969 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 87.0 in stage 3.0 (TID 519) (163.152.180.157, executor driver, partition 87, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 45.0 in stage 3.0 (TID 477) in 5659 ms on 163.152.180.157 (executor driver) (48/144) 2023-02-10 11:12:18 Executor: INFO: Running task 87.0 in stage 3.0 (TID 519) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 137: Executor task launch worker for task 86.0 in stage 3.0 (TID 518) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 137: Executor task launch worker for task 86.0 in stage 3.0 (TID 518) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 138: Executor task launch worker for task 87.0 in stage 3.0 (TID 519) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 122: Executor task launch worker for task 84.0 in stage 3.0 (TID 516) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=49, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 147: Executor task launch worker for task 49.0 in stage 3.0 (TID 481) 2023-02-10 11:12:18 Executor: INFO: Finished task 49.0 in stage 3.0 (TID 481). 968 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 88.0 in stage 3.0 (TID 520) (163.152.180.157, executor driver, partition 88, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 Executor: INFO: Running task 88.0 in stage 3.0 (TID 520) 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 49.0 in stage 3.0 (TID 481) in 5657 ms on 163.152.180.157 (executor driver) (49/144) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=52, attempt=0, peakBytes=6488064, peakBytesReadable=6.19 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.2M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 151: Executor task launch worker for task 52.0 in stage 3.0 (TID 484) 2023-02-10 11:12:18 Executor: INFO: Finished task 52.0 in stage 3.0 (TID 484). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 89.0 in stage 3.0 (TID 521) (163.152.180.157, executor driver, partition 89, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 52.0 in stage 3.0 (TID 484) in 5625 ms on 163.152.180.157 (executor driver) (50/144) 2023-02-10 11:12:18 Executor: INFO: Running task 89.0 in stage 3.0 (TID 521) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 138: Executor task launch worker for task 87.0 in stage 3.0 (TID 519) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 138: Executor task launch worker for task 87.0 in stage 3.0 (TID 519) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 118: Executor task launch worker for task 85.0 in stage 3.0 (TID 517) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 88.0 in stage 3.0 (TID 520) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=51, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 141: Executor task launch worker for task 51.0 in stage 3.0 (TID 483) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=66, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 150: Executor task launch worker for task 66.0 in stage 3.0 (TID 498) 2023-02-10 11:12:18 Executor: INFO: Finished task 51.0 in stage 3.0 (TID 483). 964 bytes result sent to driver 2023-02-10 11:12:18 Executor: INFO: Finished task 66.0 in stage 3.0 (TID 498). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 90.0 in stage 3.0 (TID 522) (163.152.180.157, executor driver, partition 90, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 Executor: INFO: Running task 90.0 in stage 3.0 (TID 522) 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 91.0 in stage 3.0 (TID 523) (163.152.180.157, executor driver, partition 91, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 Executor: INFO: Running task 91.0 in stage 3.0 (TID 523) 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 51.0 in stage 3.0 (TID 483) in 5639 ms on 163.152.180.157 (executor driver) (51/144) 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 66.0 in stage 3.0 (TID 498) in 5567 ms on 163.152.180.157 (executor driver) (52/144) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 137: Executor task launch worker for task 86.0 in stage 3.0 (TID 518) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 89.0 in stage 3.0 (TID 521) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 91.0 in stage 3.0 (TID 523) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=48, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 153: Executor task launch worker for task 48.0 in stage 3.0 (TID 480) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 150: Executor task launch worker for task 90.0 in stage 3.0 (TID 522) 2023-02-10 11:12:18 Executor: INFO: Finished task 48.0 in stage 3.0 (TID 480). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 92.0 in stage 3.0 (TID 524) (163.152.180.157, executor driver, partition 92, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 Executor: INFO: Running task 92.0 in stage 3.0 (TID 524) 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 48.0 in stage 3.0 (TID 480) in 5709 ms on 163.152.180.157 (executor driver) (53/144) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 147: Executor task launch worker for task 88.0 in stage 3.0 (TID 520) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 147: Executor task launch worker for task 88.0 in stage 3.0 (TID 520) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=74, attempt=0, peakBytes=6356992, peakBytesReadable=6.06 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.1M allocated (5.3M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 117: Executor task launch worker for task 74.0 in stage 3.0 (TID 506) 2023-02-10 11:12:18 Executor: INFO: Finished task 74.0 in stage 3.0 (TID 506). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 93.0 in stage 3.0 (TID 525) (163.152.180.157, executor driver, partition 93, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 Executor: INFO: Running task 93.0 in stage 3.0 (TID 525) 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 74.0 in stage 3.0 (TID 506) in 5527 ms on 163.152.180.157 (executor driver) (54/144) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 151: Executor task launch worker for task 89.0 in stage 3.0 (TID 521) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 141: Executor task launch worker for task 91.0 in stage 3.0 (TID 523) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 151: Executor task launch worker for task 89.0 in stage 3.0 (TID 521) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 141: Executor task launch worker for task 91.0 in stage 3.0 (TID 523) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 138: Executor task launch worker for task 87.0 in stage 3.0 (TID 519) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 92.0 in stage 3.0 (TID 524) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 93.0 in stage 3.0 (TID 525) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 150: Executor task launch worker for task 90.0 in stage 3.0 (TID 522) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 150: Executor task launch worker for task 90.0 in stage 3.0 (TID 522) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=60, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 136: Executor task launch worker for task 60.0 in stage 3.0 (TID 492) 2023-02-10 11:12:18 Executor: INFO: Finished task 60.0 in stage 3.0 (TID 492). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 94.0 in stage 3.0 (TID 526) (163.152.180.157, executor driver, partition 94, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 60.0 in stage 3.0 (TID 492) in 5679 ms on 163.152.180.157 (executor driver) (55/144) 2023-02-10 11:12:18 Executor: INFO: Running task 94.0 in stage 3.0 (TID 526) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=57, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 143: Executor task launch worker for task 57.0 in stage 3.0 (TID 489) 2023-02-10 11:12:18 Executor: INFO: Finished task 57.0 in stage 3.0 (TID 489). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 95.0 in stage 3.0 (TID 527) (163.152.180.157, executor driver, partition 95, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 57.0 in stage 3.0 (TID 489) in 5690 ms on 163.152.180.157 (executor driver) (56/144) 2023-02-10 11:12:18 Executor: INFO: Running task 95.0 in stage 3.0 (TID 527) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 147: Executor task launch worker for task 88.0 in stage 3.0 (TID 520) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 153: Executor task launch worker for task 92.0 in stage 3.0 (TID 524) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 153: Executor task launch worker for task 92.0 in stage 3.0 (TID 524) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 141: Executor task launch worker for task 91.0 in stage 3.0 (TID 523) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 94.0 in stage 3.0 (TID 526) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 151: Executor task launch worker for task 89.0 in stage 3.0 (TID 521) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 95.0 in stage 3.0 (TID 527) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 117: Executor task launch worker for task 93.0 in stage 3.0 (TID 525) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 117: Executor task launch worker for task 93.0 in stage 3.0 (TID 525) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 150: Executor task launch worker for task 90.0 in stage 3.0 (TID 522) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=61, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 114: Executor task launch worker for task 61.0 in stage 3.0 (TID 493) 2023-02-10 11:12:18 Executor: INFO: Finished task 61.0 in stage 3.0 (TID 493). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 96.0 in stage 3.0 (TID 528) (163.152.180.157, executor driver, partition 96, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 Executor: INFO: Running task 96.0 in stage 3.0 (TID 528) 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 61.0 in stage 3.0 (TID 493) in 5715 ms on 163.152.180.157 (executor driver) (57/144) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=62, attempt=0, peakBytes=6684672, peakBytesReadable=6.38 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.4M allocated (5.6M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 139: Executor task launch worker for task 62.0 in stage 3.0 (TID 494) 2023-02-10 11:12:18 Executor: INFO: Finished task 62.0 in stage 3.0 (TID 494). 966 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 97.0 in stage 3.0 (TID 529) (163.152.180.157, executor driver, partition 97, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 62.0 in stage 3.0 (TID 494) in 5717 ms on 163.152.180.157 (executor driver) (58/144) 2023-02-10 11:12:18 Executor: INFO: Running task 97.0 in stage 3.0 (TID 529) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 153: Executor task launch worker for task 92.0 in stage 3.0 (TID 524) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 143: Executor task launch worker for task 95.0 in stage 3.0 (TID 527) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 143: Executor task launch worker for task 95.0 in stage 3.0 (TID 527) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 96.0 in stage 3.0 (TID 528) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 136: Executor task launch worker for task 94.0 in stage 3.0 (TID 526) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 136: Executor task launch worker for task 94.0 in stage 3.0 (TID 526) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=69, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 140: Executor task launch worker for task 69.0 in stage 3.0 (TID 501) 2023-02-10 11:12:18 Executor: INFO: Finished task 69.0 in stage 3.0 (TID 501). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 98.0 in stage 3.0 (TID 530) (163.152.180.157, executor driver, partition 98, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 69.0 in stage 3.0 (TID 501) in 5695 ms on 163.152.180.157 (executor driver) (59/144) 2023-02-10 11:12:18 Executor: INFO: Running task 98.0 in stage 3.0 (TID 530) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=72, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 152: Executor task launch worker for task 72.0 in stage 3.0 (TID 504) 2023-02-10 11:12:18 Executor: INFO: Finished task 72.0 in stage 3.0 (TID 504). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 99.0 in stage 3.0 (TID 531) (163.152.180.157, executor driver, partition 99, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 72.0 in stage 3.0 (TID 504) in 5683 ms on 163.152.180.157 (executor driver) (60/144) 2023-02-10 11:12:18 Executor: INFO: Running task 99.0 in stage 3.0 (TID 531) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 97.0 in stage 3.0 (TID 529) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 117: Executor task launch worker for task 93.0 in stage 3.0 (TID 525) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=64, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 159: Executor task launch worker for task 64.0 in stage 3.0 (TID 496) 2023-02-10 11:12:18 Executor: INFO: Finished task 64.0 in stage 3.0 (TID 496). 996 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 100.0 in stage 3.0 (TID 532) (163.152.180.157, executor driver, partition 100, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 Executor: INFO: Running task 100.0 in stage 3.0 (TID 532) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 146: Executor task launch worker for task 82.0 in stage 3.0 (TID 514) 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 64.0 in stage 3.0 (TID 496) in 5759 ms on 163.152.180.157 (executor driver) (61/144) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 98.0 in stage 3.0 (TID 530) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 99.0 in stage 3.0 (TID 531) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 114: Executor task launch worker for task 96.0 in stage 3.0 (TID 528) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 114: Executor task launch worker for task 96.0 in stage 3.0 (TID 528) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 100.0 in stage 3.0 (TID 532) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 149: Executor task launch worker for task 81.0 in stage 3.0 (TID 513) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 143: Executor task launch worker for task 95.0 in stage 3.0 (TID 527) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 139: Executor task launch worker for task 97.0 in stage 3.0 (TID 529) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 139: Executor task launch worker for task 97.0 in stage 3.0 (TID 529) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 152: Executor task launch worker for task 99.0 in stage 3.0 (TID 531) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 152: Executor task launch worker for task 99.0 in stage 3.0 (TID 531) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 136: Executor task launch worker for task 94.0 in stage 3.0 (TID 526) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=58, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 142: Executor task launch worker for task 58.0 in stage 3.0 (TID 490) 2023-02-10 11:12:18 Executor: INFO: Finished task 58.0 in stage 3.0 (TID 490). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 101.0 in stage 3.0 (TID 533) (163.152.180.157, executor driver, partition 101, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 58.0 in stage 3.0 (TID 490) in 5814 ms on 163.152.180.157 (executor driver) (62/144) 2023-02-10 11:12:18 Executor: INFO: Running task 101.0 in stage 3.0 (TID 533) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=44, attempt=0, peakBytes=6750208, peakBytesReadable=6.44 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.4M allocated (5.7M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 130: Executor task launch worker for task 44.0 in stage 3.0 (TID 476) 2023-02-10 11:12:18 Executor: INFO: Finished task 44.0 in stage 3.0 (TID 476). 1005 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 102.0 in stage 3.0 (TID 534) (163.152.180.157, executor driver, partition 102, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 Executor: INFO: Running task 102.0 in stage 3.0 (TID 534) 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 44.0 in stage 3.0 (TID 476) in 5964 ms on 163.152.180.157 (executor driver) (63/144) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 140: Executor task launch worker for task 98.0 in stage 3.0 (TID 530) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 140: Executor task launch worker for task 98.0 in stage 3.0 (TID 530) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 159: Executor task launch worker for task 100.0 in stage 3.0 (TID 532) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 159: Executor task launch worker for task 100.0 in stage 3.0 (TID 532) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=68, attempt=0, peakBytes=6488064, peakBytesReadable=6.19 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.2M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 120: Executor task launch worker for task 68.0 in stage 3.0 (TID 500) 2023-02-10 11:12:18 Executor: INFO: Finished task 68.0 in stage 3.0 (TID 500). 964 bytes result sent to driver 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 114: Executor task launch worker for task 96.0 in stage 3.0 (TID 528) 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 103.0 in stage 3.0 (TID 535) (163.152.180.157, executor driver, partition 103, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 102.0 in stage 3.0 (TID 534) 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 68.0 in stage 3.0 (TID 500) in 5788 ms on 163.152.180.157 (executor driver) (64/144) 2023-02-10 11:12:18 Executor: INFO: Running task 103.0 in stage 3.0 (TID 535) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 101.0 in stage 3.0 (TID 533) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 139: Executor task launch worker for task 97.0 in stage 3.0 (TID 529) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 120: Executor task launch worker for task 103.0 in stage 3.0 (TID 535) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 152: Executor task launch worker for task 99.0 in stage 3.0 (TID 531) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 140: Executor task launch worker for task 98.0 in stage 3.0 (TID 530) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=54, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 126: Executor task launch worker for task 54.0 in stage 3.0 (TID 486) 2023-02-10 11:12:18 Executor: INFO: Finished task 54.0 in stage 3.0 (TID 486). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 104.0 in stage 3.0 (TID 536) (163.152.180.157, executor driver, partition 104, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 Executor: INFO: Running task 104.0 in stage 3.0 (TID 536) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 130: Executor task launch worker for task 102.0 in stage 3.0 (TID 534) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 130: Executor task launch worker for task 102.0 in stage 3.0 (TID 534) 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 54.0 in stage 3.0 (TID 486) in 5899 ms on 163.152.180.157 (executor driver) (65/144) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 142: Executor task launch worker for task 101.0 in stage 3.0 (TID 533) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 142: Executor task launch worker for task 101.0 in stage 3.0 (TID 533) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 159: Executor task launch worker for task 100.0 in stage 3.0 (TID 532) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 120: Executor task launch worker for task 103.0 in stage 3.0 (TID 535) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 120: Executor task launch worker for task 103.0 in stage 3.0 (TID 535) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=56, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 145: Executor task launch worker for task 56.0 in stage 3.0 (TID 488) 2023-02-10 11:12:18 Executor: INFO: Finished task 56.0 in stage 3.0 (TID 488). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 105.0 in stage 3.0 (TID 537) (163.152.180.157, executor driver, partition 105, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 56.0 in stage 3.0 (TID 488) in 5910 ms on 163.152.180.157 (executor driver) (66/144) 2023-02-10 11:12:18 Executor: INFO: Running task 105.0 in stage 3.0 (TID 537) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 116: Executor task launch worker for task 83.0 in stage 3.0 (TID 515) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 104.0 in stage 3.0 (TID 536) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 130: Executor task launch worker for task 102.0 in stage 3.0 (TID 534) 2023-02-10 11:12:18 root: INFO: TaskReport: stage=3, partition=76, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:18 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 131: Executor task launch worker for task 76.0 in stage 3.0 (TID 508) 2023-02-10 11:12:18 Executor: INFO: Finished task 76.0 in stage 3.0 (TID 508). 964 bytes result sent to driver 2023-02-10 11:12:18 TaskSetManager: INFO: Starting task 106.0 in stage 3.0 (TID 538) (163.152.180.157, executor driver, partition 106, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:18 Executor: INFO: Running task 106.0 in stage 3.0 (TID 538) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 145: Executor task launch worker for task 105.0 in stage 3.0 (TID 537) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 134: Executor task launch worker for task 80.0 in stage 3.0 (TID 512) 2023-02-10 11:12:18 TaskSetManager: INFO: Finished task 76.0 in stage 3.0 (TID 508) in 5804 ms on 163.152.180.157 (executor driver) (67/144) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 142: Executor task launch worker for task 101.0 in stage 3.0 (TID 533) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 120: Executor task launch worker for task 103.0 in stage 3.0 (TID 535) 2023-02-10 11:12:18 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 106.0 in stage 3.0 (TID 538) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 126: Executor task launch worker for task 104.0 in stage 3.0 (TID 536) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 126: Executor task launch worker for task 104.0 in stage 3.0 (TID 536) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 145: Executor task launch worker for task 105.0 in stage 3.0 (TID 537) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 145: Executor task launch worker for task 105.0 in stage 3.0 (TID 537) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 122: Executor task launch worker for task 84.0 in stage 3.0 (TID 516) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 131: Executor task launch worker for task 106.0 in stage 3.0 (TID 538) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 131: Executor task launch worker for task 106.0 in stage 3.0 (TID 538) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 118: Executor task launch worker for task 85.0 in stage 3.0 (TID 517) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 126: Executor task launch worker for task 104.0 in stage 3.0 (TID 536) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 137: Executor task launch worker for task 86.0 in stage 3.0 (TID 518) 2023-02-10 11:12:18 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 145: Executor task launch worker for task 105.0 in stage 3.0 (TID 537) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 138: Executor task launch worker for task 87.0 in stage 3.0 (TID 519) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 131: Executor task launch worker for task 106.0 in stage 3.0 (TID 538) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=53, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 132: Executor task launch worker for task 53.0 in stage 3.0 (TID 485) 2023-02-10 11:12:19 Executor: INFO: Finished task 53.0 in stage 3.0 (TID 485). 964 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 107.0 in stage 3.0 (TID 539) (163.152.180.157, executor driver, partition 107, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 Executor: INFO: Running task 107.0 in stage 3.0 (TID 539) 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 53.0 in stage 3.0 (TID 485) in 6129 ms on 163.152.180.157 (executor driver) (68/144) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 147: Executor task launch worker for task 88.0 in stage 3.0 (TID 520) 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 107.0 in stage 3.0 (TID 539) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 141: Executor task launch worker for task 91.0 in stage 3.0 (TID 523) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=67, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 123: Executor task launch worker for task 67.0 in stage 3.0 (TID 499) 2023-02-10 11:12:19 Executor: INFO: Finished task 67.0 in stage 3.0 (TID 499). 966 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 108.0 in stage 3.0 (TID 540) (163.152.180.157, executor driver, partition 108, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 Executor: INFO: Running task 108.0 in stage 3.0 (TID 540) 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 67.0 in stage 3.0 (TID 499) in 6089 ms on 163.152.180.157 (executor driver) (69/144) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 151: Executor task launch worker for task 89.0 in stage 3.0 (TID 521) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 150: Executor task launch worker for task 90.0 in stage 3.0 (TID 522) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=73, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 127: Executor task launch worker for task 73.0 in stage 3.0 (TID 505) 2023-02-10 11:12:19 Executor: INFO: Finished task 73.0 in stage 3.0 (TID 505). 964 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 109.0 in stage 3.0 (TID 541) (163.152.180.157, executor driver, partition 109, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 Executor: INFO: Running task 109.0 in stage 3.0 (TID 541) 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 73.0 in stage 3.0 (TID 505) in 6061 ms on 163.152.180.157 (executor driver) (70/144) 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 123: Executor task launch worker for task 108.0 in stage 3.0 (TID 540) 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 127: Executor task launch worker for task 109.0 in stage 3.0 (TID 541) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 132: Executor task launch worker for task 107.0 in stage 3.0 (TID 539) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 132: Executor task launch worker for task 107.0 in stage 3.0 (TID 539) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 153: Executor task launch worker for task 92.0 in stage 3.0 (TID 524) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=59, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 144: Executor task launch worker for task 59.0 in stage 3.0 (TID 491) 2023-02-10 11:12:19 Executor: INFO: Finished task 59.0 in stage 3.0 (TID 491). 964 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 110.0 in stage 3.0 (TID 542) (163.152.180.157, executor driver, partition 110, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 59.0 in stage 3.0 (TID 491) in 6166 ms on 163.152.180.157 (executor driver) (71/144) 2023-02-10 11:12:19 Executor: INFO: Running task 110.0 in stage 3.0 (TID 542) 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 144: Executor task launch worker for task 110.0 in stage 3.0 (TID 542) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 123: Executor task launch worker for task 108.0 in stage 3.0 (TID 540) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 123: Executor task launch worker for task 108.0 in stage 3.0 (TID 540) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 127: Executor task launch worker for task 109.0 in stage 3.0 (TID 541) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 127: Executor task launch worker for task 109.0 in stage 3.0 (TID 541) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=55, attempt=0, peakBytes=6488064, peakBytesReadable=6.19 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.2M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 115: Executor task launch worker for task 55.0 in stage 3.0 (TID 487) 2023-02-10 11:12:19 Executor: INFO: Finished task 55.0 in stage 3.0 (TID 487). 965 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 111.0 in stage 3.0 (TID 543) (163.152.180.157, executor driver, partition 111, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 Executor: INFO: Running task 111.0 in stage 3.0 (TID 543) 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 55.0 in stage 3.0 (TID 487) in 6205 ms on 163.152.180.157 (executor driver) (72/144) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 117: Executor task launch worker for task 93.0 in stage 3.0 (TID 525) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 132: Executor task launch worker for task 107.0 in stage 3.0 (TID 539) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=63, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 148: Executor task launch worker for task 63.0 in stage 3.0 (TID 495) 2023-02-10 11:12:19 Executor: INFO: Finished task 63.0 in stage 3.0 (TID 495). 964 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 112.0 in stage 3.0 (TID 544) (163.152.180.157, executor driver, partition 112, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 63.0 in stage 3.0 (TID 495) in 6170 ms on 163.152.180.157 (executor driver) (73/144) 2023-02-10 11:12:19 Executor: INFO: Running task 112.0 in stage 3.0 (TID 544) 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 115: Executor task launch worker for task 111.0 in stage 3.0 (TID 543) 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 148: Executor task launch worker for task 112.0 in stage 3.0 (TID 544) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 144: Executor task launch worker for task 110.0 in stage 3.0 (TID 542) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 144: Executor task launch worker for task 110.0 in stage 3.0 (TID 542) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 143: Executor task launch worker for task 95.0 in stage 3.0 (TID 527) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 139: Executor task launch worker for task 97.0 in stage 3.0 (TID 529) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 123: Executor task launch worker for task 108.0 in stage 3.0 (TID 540) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 115: Executor task launch worker for task 111.0 in stage 3.0 (TID 543) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 115: Executor task launch worker for task 111.0 in stage 3.0 (TID 543) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 136: Executor task launch worker for task 94.0 in stage 3.0 (TID 526) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=79, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 128: Executor task launch worker for task 79.0 in stage 3.0 (TID 511) 2023-02-10 11:12:19 Executor: INFO: Finished task 79.0 in stage 3.0 (TID 511). 964 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 113.0 in stage 3.0 (TID 545) (163.152.180.157, executor driver, partition 113, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 Executor: INFO: Running task 113.0 in stage 3.0 (TID 545) 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 79.0 in stage 3.0 (TID 511) in 5871 ms on 163.152.180.157 (executor driver) (74/144) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 114: Executor task launch worker for task 96.0 in stage 3.0 (TID 528) 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 128: Executor task launch worker for task 113.0 in stage 3.0 (TID 545) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=77, attempt=0, peakBytes=6815744, peakBytesReadable=6.50 MiB, chunks requested=21, cache hits=19 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.5M allocated (5.8M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 158: Executor task launch worker for task 77.0 in stage 3.0 (TID 509) 2023-02-10 11:12:19 Executor: INFO: Finished task 77.0 in stage 3.0 (TID 509). 964 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 114.0 in stage 3.0 (TID 546) (163.152.180.157, executor driver, partition 114, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 77.0 in stage 3.0 (TID 509) in 6132 ms on 163.152.180.157 (executor driver) (75/144) 2023-02-10 11:12:19 Executor: INFO: Running task 114.0 in stage 3.0 (TID 546) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 148: Executor task launch worker for task 112.0 in stage 3.0 (TID 544) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 148: Executor task launch worker for task 112.0 in stage 3.0 (TID 544) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 127: Executor task launch worker for task 109.0 in stage 3.0 (TID 541) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 140: Executor task launch worker for task 98.0 in stage 3.0 (TID 530) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 159: Executor task launch worker for task 100.0 in stage 3.0 (TID 532) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 152: Executor task launch worker for task 99.0 in stage 3.0 (TID 531) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 128: Executor task launch worker for task 113.0 in stage 3.0 (TID 545) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 128: Executor task launch worker for task 113.0 in stage 3.0 (TID 545) 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 158: Executor task launch worker for task 114.0 in stage 3.0 (TID 546) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 144: Executor task launch worker for task 110.0 in stage 3.0 (TID 542) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 130: Executor task launch worker for task 102.0 in stage 3.0 (TID 534) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 158: Executor task launch worker for task 114.0 in stage 3.0 (TID 546) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 158: Executor task launch worker for task 114.0 in stage 3.0 (TID 546) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 148: Executor task launch worker for task 112.0 in stage 3.0 (TID 544) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 120: Executor task launch worker for task 103.0 in stage 3.0 (TID 535) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 128: Executor task launch worker for task 113.0 in stage 3.0 (TID 545) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 115: Executor task launch worker for task 111.0 in stage 3.0 (TID 543) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 142: Executor task launch worker for task 101.0 in stage 3.0 (TID 533) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=71, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 133: Executor task launch worker for task 71.0 in stage 3.0 (TID 503) 2023-02-10 11:12:19 Executor: INFO: Finished task 71.0 in stage 3.0 (TID 503). 979 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 115.0 in stage 3.0 (TID 547) (163.152.180.157, executor driver, partition 115, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 71.0 in stage 3.0 (TID 503) in 6315 ms on 163.152.180.157 (executor driver) (76/144) 2023-02-10 11:12:19 Executor: INFO: Running task 115.0 in stage 3.0 (TID 547) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=70, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 158: Executor task launch worker for task 114.0 in stage 3.0 (TID 546) 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 129: Executor task launch worker for task 70.0 in stage 3.0 (TID 502) 2023-02-10 11:12:19 Executor: INFO: Finished task 70.0 in stage 3.0 (TID 502). 964 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 116.0 in stage 3.0 (TID 548) (163.152.180.157, executor driver, partition 116, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 133: Executor task launch worker for task 115.0 in stage 3.0 (TID 547) 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 70.0 in stage 3.0 (TID 502) in 6334 ms on 163.152.180.157 (executor driver) (77/144) 2023-02-10 11:12:19 Executor: INFO: Running task 116.0 in stage 3.0 (TID 548) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 133: Executor task launch worker for task 115.0 in stage 3.0 (TID 547) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 133: Executor task launch worker for task 115.0 in stage 3.0 (TID 547) 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 129: Executor task launch worker for task 116.0 in stage 3.0 (TID 548) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 145: Executor task launch worker for task 105.0 in stage 3.0 (TID 537) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 126: Executor task launch worker for task 104.0 in stage 3.0 (TID 536) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 131: Executor task launch worker for task 106.0 in stage 3.0 (TID 538) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 129: Executor task launch worker for task 116.0 in stage 3.0 (TID 548) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 129: Executor task launch worker for task 116.0 in stage 3.0 (TID 548) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=65, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 125: Executor task launch worker for task 65.0 in stage 3.0 (TID 497) 2023-02-10 11:12:19 Executor: INFO: Finished task 65.0 in stage 3.0 (TID 497). 970 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 117.0 in stage 3.0 (TID 549) (163.152.180.157, executor driver, partition 117, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 Executor: INFO: Running task 117.0 in stage 3.0 (TID 549) 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 65.0 in stage 3.0 (TID 497) in 6439 ms on 163.152.180.157 (executor driver) (78/144) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=75, attempt=0, peakBytes=6422528, peakBytesReadable=6.13 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.1M allocated (5.4M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 121: Executor task launch worker for task 75.0 in stage 3.0 (TID 507) 2023-02-10 11:12:19 Executor: INFO: Finished task 75.0 in stage 3.0 (TID 507). 964 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 118.0 in stage 3.0 (TID 550) (163.152.180.157, executor driver, partition 118, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 75.0 in stage 3.0 (TID 507) in 6362 ms on 163.152.180.157 (executor driver) (79/144) 2023-02-10 11:12:19 Executor: INFO: Running task 118.0 in stage 3.0 (TID 550) 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 125: Executor task launch worker for task 117.0 in stage 3.0 (TID 549) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 133: Executor task launch worker for task 115.0 in stage 3.0 (TID 547) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 129: Executor task launch worker for task 116.0 in stage 3.0 (TID 548) 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 121: Executor task launch worker for task 118.0 in stage 3.0 (TID 550) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 125: Executor task launch worker for task 117.0 in stage 3.0 (TID 549) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 125: Executor task launch worker for task 117.0 in stage 3.0 (TID 549) 2023-02-10 11:12:19 root: INFO: TaskReport: stage=3, partition=78, attempt=0, peakBytes=6553600, peakBytesReadable=6.25 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:19 root: INFO: RegionPool: FREE: 6.3M allocated (5.5M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 119: Executor task launch worker for task 78.0 in stage 3.0 (TID 510) 2023-02-10 11:12:19 Executor: INFO: Finished task 78.0 in stage 3.0 (TID 510). 964 bytes result sent to driver 2023-02-10 11:12:19 TaskSetManager: INFO: Starting task 119.0 in stage 3.0 (TID 551) (163.152.180.157, executor driver, partition 119, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:19 Executor: INFO: Running task 119.0 in stage 3.0 (TID 551) 2023-02-10 11:12:19 TaskSetManager: INFO: Finished task 78.0 in stage 3.0 (TID 510) in 6271 ms on 163.152.180.157 (executor driver) (80/144) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 132: Executor task launch worker for task 107.0 in stage 3.0 (TID 539) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 125: Executor task launch worker for task 117.0 in stage 3.0 (TID 549) 2023-02-10 11:12:19 root: INFO: RegionPool: initialized for thread 124: Executor task launch worker for task 119.0 in stage 3.0 (TID 551) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 121: Executor task launch worker for task 118.0 in stage 3.0 (TID 550) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 121: Executor task launch worker for task 118.0 in stage 3.0 (TID 550) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 123: Executor task launch worker for task 108.0 in stage 3.0 (TID 540) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 127: Executor task launch worker for task 109.0 in stage 3.0 (TID 541) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 124: Executor task launch worker for task 119.0 in stage 3.0 (TID 551) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 124: Executor task launch worker for task 119.0 in stage 3.0 (TID 551) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 121: Executor task launch worker for task 118.0 in stage 3.0 (TID 550) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 124: Executor task launch worker for task 119.0 in stage 3.0 (TID 551) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 144: Executor task launch worker for task 110.0 in stage 3.0 (TID 542) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 128: Executor task launch worker for task 113.0 in stage 3.0 (TID 545) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 148: Executor task launch worker for task 112.0 in stage 3.0 (TID 544) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 115: Executor task launch worker for task 111.0 in stage 3.0 (TID 543) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 158: Executor task launch worker for task 114.0 in stage 3.0 (TID 546) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 133: Executor task launch worker for task 115.0 in stage 3.0 (TID 547) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 129: Executor task launch worker for task 116.0 in stage 3.0 (TID 548) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 125: Executor task launch worker for task 117.0 in stage 3.0 (TID 549) 2023-02-10 11:12:19 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 121: Executor task launch worker for task 118.0 in stage 3.0 (TID 550) 2023-02-10 11:12:20 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 124: Executor task launch worker for task 119.0 in stage 3.0 (TID 551) 2023-02-10 11:12:20 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 139: Executor task launch worker for task 97.0 in stage 3.0 (TID 529) 2023-02-10 11:12:20 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 146: Executor task launch worker for task 82.0 in stage 3.0 (TID 514) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 116: Executor task launch worker for task 83.0 in stage 3.0 (TID 515) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 149: Executor task launch worker for task 81.0 in stage 3.0 (TID 513) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 118: Executor task launch worker for task 85.0 in stage 3.0 (TID 517) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 141: Executor task launch worker for task 91.0 in stage 3.0 (TID 523) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 147: Executor task launch worker for task 88.0 in stage 3.0 (TID 520) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 134: Executor task launch worker for task 80.0 in stage 3.0 (TID 512) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 153: Executor task launch worker for task 92.0 in stage 3.0 (TID 524) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 151: Executor task launch worker for task 89.0 in stage 3.0 (TID 521) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 150: Executor task launch worker for task 90.0 in stage 3.0 (TID 522) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 122: Executor task launch worker for task 84.0 in stage 3.0 (TID 516) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 152: Executor task launch worker for task 99.0 in stage 3.0 (TID 531) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 117: Executor task launch worker for task 93.0 in stage 3.0 (TID 525) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 136: Executor task launch worker for task 94.0 in stage 3.0 (TID 526) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 159: Executor task launch worker for task 100.0 in stage 3.0 (TID 532) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 140: Executor task launch worker for task 98.0 in stage 3.0 (TID 530) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 114: Executor task launch worker for task 96.0 in stage 3.0 (TID 528) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 130: Executor task launch worker for task 102.0 in stage 3.0 (TID 534) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 143: Executor task launch worker for task 95.0 in stage 3.0 (TID 527) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 137: Executor task launch worker for task 86.0 in stage 3.0 (TID 518) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 126: Executor task launch worker for task 104.0 in stage 3.0 (TID 536) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 142: Executor task launch worker for task 101.0 in stage 3.0 (TID 533) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 132: Executor task launch worker for task 107.0 in stage 3.0 (TID 539) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 131: Executor task launch worker for task 106.0 in stage 3.0 (TID 538) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 138: Executor task launch worker for task 87.0 in stage 3.0 (TID 519) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 145: Executor task launch worker for task 105.0 in stage 3.0 (TID 537) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 127: Executor task launch worker for task 109.0 in stage 3.0 (TID 541) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 115: Executor task launch worker for task 111.0 in stage 3.0 (TID 543) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 148: Executor task launch worker for task 112.0 in stage 3.0 (TID 544) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 144: Executor task launch worker for task 110.0 in stage 3.0 (TID 542) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 120: Executor task launch worker for task 103.0 in stage 3.0 (TID 535) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 123: Executor task launch worker for task 108.0 in stage 3.0 (TID 540) 2023-02-10 11:12:21 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 158: Executor task launch worker for task 114.0 in stage 3.0 (TID 546) 2023-02-10 11:12:22 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 133: Executor task launch worker for task 115.0 in stage 3.0 (TID 547) 2023-02-10 11:12:22 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 128: Executor task launch worker for task 113.0 in stage 3.0 (TID 545) 2023-02-10 11:12:22 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 121: Executor task launch worker for task 118.0 in stage 3.0 (TID 550) 2023-02-10 11:12:22 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 129: Executor task launch worker for task 116.0 in stage 3.0 (TID 548) 2023-02-10 11:12:22 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 124: Executor task launch worker for task 119.0 in stage 3.0 (TID 551) 2023-02-10 11:12:22 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 125: Executor task launch worker for task 117.0 in stage 3.0 (TID 549) 2023-02-10 11:12:23 root: INFO: TaskReport: stage=3, partition=82, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:23 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 146: Executor task launch worker for task 82.0 in stage 3.0 (TID 514) 2023-02-10 11:12:23 Executor: INFO: Finished task 82.0 in stage 3.0 (TID 514). 966 bytes result sent to driver 2023-02-10 11:12:23 TaskSetManager: INFO: Starting task 120.0 in stage 3.0 (TID 552) (163.152.180.157, executor driver, partition 120, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:23 TaskSetManager: INFO: Finished task 82.0 in stage 3.0 (TID 514) in 5482 ms on 163.152.180.157 (executor driver) (81/144) 2023-02-10 11:12:23 Executor: INFO: Running task 120.0 in stage 3.0 (TID 552) 2023-02-10 11:12:23 root: INFO: RegionPool: initialized for thread 146: Executor task launch worker for task 120.0 in stage 3.0 (TID 552) 2023-02-10 11:12:23 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 146: Executor task launch worker for task 120.0 in stage 3.0 (TID 552) 2023-02-10 11:12:23 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 146: Executor task launch worker for task 120.0 in stage 3.0 (TID 552) 2023-02-10 11:12:23 root: INFO: TaskReport: stage=3, partition=80, attempt=0, peakBytes=6619136, peakBytesReadable=6.31 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:23 root: INFO: RegionPool: FREE: 6.3M allocated (5.6M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 134: Executor task launch worker for task 80.0 in stage 3.0 (TID 512) 2023-02-10 11:12:23 Executor: INFO: Finished task 80.0 in stage 3.0 (TID 512). 965 bytes result sent to driver 2023-02-10 11:12:23 TaskSetManager: INFO: Starting task 121.0 in stage 3.0 (TID 553) (163.152.180.157, executor driver, partition 121, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:23 TaskSetManager: INFO: Finished task 80.0 in stage 3.0 (TID 512) in 5604 ms on 163.152.180.157 (executor driver) (82/144) 2023-02-10 11:12:23 Executor: INFO: Running task 121.0 in stage 3.0 (TID 553) 2023-02-10 11:12:23 root: INFO: RegionPool: initialized for thread 134: Executor task launch worker for task 121.0 in stage 3.0 (TID 553) 2023-02-10 11:12:23 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 146: Executor task launch worker for task 120.0 in stage 3.0 (TID 552) 2023-02-10 11:12:23 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 134: Executor task launch worker for task 121.0 in stage 3.0 (TID 553) 2023-02-10 11:12:23 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 134: Executor task launch worker for task 121.0 in stage 3.0 (TID 553) 2023-02-10 11:12:23 root: INFO: TaskReport: stage=3, partition=97, attempt=0, peakBytes=7208960, peakBytesReadable=6.88 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:23 root: INFO: RegionPool: FREE: 6.9M allocated (6.1M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 139: Executor task launch worker for task 97.0 in stage 3.0 (TID 529) 2023-02-10 11:12:23 Executor: INFO: Finished task 97.0 in stage 3.0 (TID 529). 966 bytes result sent to driver 2023-02-10 11:12:23 TaskSetManager: INFO: Starting task 122.0 in stage 3.0 (TID 554) (163.152.180.157, executor driver, partition 122, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:23 Executor: INFO: Running task 122.0 in stage 3.0 (TID 554) 2023-02-10 11:12:23 TaskSetManager: INFO: Finished task 97.0 in stage 3.0 (TID 529) in 5225 ms on 163.152.180.157 (executor driver) (83/144) 2023-02-10 11:12:23 root: INFO: RegionPool: initialized for thread 139: Executor task launch worker for task 122.0 in stage 3.0 (TID 554) 2023-02-10 11:12:23 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 134: Executor task launch worker for task 121.0 in stage 3.0 (TID 553) 2023-02-10 11:12:23 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 139: Executor task launch worker for task 122.0 in stage 3.0 (TID 554) 2023-02-10 11:12:23 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 139: Executor task launch worker for task 122.0 in stage 3.0 (TID 554) 2023-02-10 11:12:23 root: INFO: TaskReport: stage=3, partition=81, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:23 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 149: Executor task launch worker for task 81.0 in stage 3.0 (TID 513) 2023-02-10 11:12:23 Executor: INFO: Finished task 81.0 in stage 3.0 (TID 513). 966 bytes result sent to driver 2023-02-10 11:12:23 TaskSetManager: INFO: Starting task 123.0 in stage 3.0 (TID 555) (163.152.180.157, executor driver, partition 123, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:23 TaskSetManager: INFO: Finished task 81.0 in stage 3.0 (TID 513) in 5683 ms on 163.152.180.157 (executor driver) (84/144) 2023-02-10 11:12:23 Executor: INFO: Running task 123.0 in stage 3.0 (TID 555) 2023-02-10 11:12:23 root: INFO: TaskReport: stage=3, partition=88, attempt=0, peakBytes=6881280, peakBytesReadable=6.56 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:23 root: INFO: RegionPool: FREE: 6.6M allocated (5.8M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 147: Executor task launch worker for task 88.0 in stage 3.0 (TID 520) 2023-02-10 11:12:23 Executor: INFO: Finished task 88.0 in stage 3.0 (TID 520). 966 bytes result sent to driver 2023-02-10 11:12:23 TaskSetManager: INFO: Starting task 124.0 in stage 3.0 (TID 556) (163.152.180.157, executor driver, partition 124, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:23 Executor: INFO: Running task 124.0 in stage 3.0 (TID 556) 2023-02-10 11:12:23 TaskSetManager: INFO: Finished task 88.0 in stage 3.0 (TID 520) in 5432 ms on 163.152.180.157 (executor driver) (85/144) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 119: Executor task launch worker for task 123.0 in stage 3.0 (TID 555) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 147: Executor task launch worker for task 124.0 in stage 3.0 (TID 556) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 119: Executor task launch worker for task 123.0 in stage 3.0 (TID 555) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 119: Executor task launch worker for task 123.0 in stage 3.0 (TID 555) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 147: Executor task launch worker for task 124.0 in stage 3.0 (TID 556) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 147: Executor task launch worker for task 124.0 in stage 3.0 (TID 556) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 139: Executor task launch worker for task 122.0 in stage 3.0 (TID 554) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=85, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 118: Executor task launch worker for task 85.0 in stage 3.0 (TID 517) 2023-02-10 11:12:24 Executor: INFO: Finished task 85.0 in stage 3.0 (TID 517). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 125.0 in stage 3.0 (TID 557) (163.152.180.157, executor driver, partition 125, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 Executor: INFO: Running task 125.0 in stage 3.0 (TID 557) 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 85.0 in stage 3.0 (TID 517) in 5641 ms on 163.152.180.157 (executor driver) (86/144) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 119: Executor task launch worker for task 123.0 in stage 3.0 (TID 555) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 118: Executor task launch worker for task 125.0 in stage 3.0 (TID 557) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 147: Executor task launch worker for task 124.0 in stage 3.0 (TID 556) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 118: Executor task launch worker for task 125.0 in stage 3.0 (TID 557) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 118: Executor task launch worker for task 125.0 in stage 3.0 (TID 557) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=91, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 141: Executor task launch worker for task 91.0 in stage 3.0 (TID 523) 2023-02-10 11:12:24 Executor: INFO: Finished task 91.0 in stage 3.0 (TID 523). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 126.0 in stage 3.0 (TID 558) (163.152.180.157, executor driver, partition 126, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 91.0 in stage 3.0 (TID 523) in 5635 ms on 163.152.180.157 (executor driver) (87/144) 2023-02-10 11:12:24 Executor: INFO: Running task 126.0 in stage 3.0 (TID 558) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=92, attempt=0, peakBytes=7012352, peakBytesReadable=6.69 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.7M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 153: Executor task launch worker for task 92.0 in stage 3.0 (TID 524) 2023-02-10 11:12:24 Executor: INFO: Finished task 92.0 in stage 3.0 (TID 524). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 127.0 in stage 3.0 (TID 559) (163.152.180.157, executor driver, partition 127, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 92.0 in stage 3.0 (TID 524) in 5615 ms on 163.152.180.157 (executor driver) (88/144) 2023-02-10 11:12:24 Executor: INFO: Running task 127.0 in stage 3.0 (TID 559) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 141: Executor task launch worker for task 126.0 in stage 3.0 (TID 558) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 153: Executor task launch worker for task 127.0 in stage 3.0 (TID 559) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=83, attempt=0, peakBytes=7274496, peakBytesReadable=6.94 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.9M allocated (6.2M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 116: Executor task launch worker for task 83.0 in stage 3.0 (TID 515) 2023-02-10 11:12:24 Executor: INFO: Finished task 83.0 in stage 3.0 (TID 515). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 128.0 in stage 3.0 (TID 560) (163.152.180.157, executor driver, partition 128, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 Executor: INFO: Running task 128.0 in stage 3.0 (TID 560) 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 83.0 in stage 3.0 (TID 515) in 5815 ms on 163.152.180.157 (executor driver) (89/144) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=93, attempt=0, peakBytes=6881280, peakBytesReadable=6.56 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.6M allocated (5.8M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 117: Executor task launch worker for task 93.0 in stage 3.0 (TID 525) 2023-02-10 11:12:24 Executor: INFO: Finished task 93.0 in stage 3.0 (TID 525). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 129.0 in stage 3.0 (TID 561) (163.152.180.157, executor driver, partition 129, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 93.0 in stage 3.0 (TID 525) in 5622 ms on 163.152.180.157 (executor driver) (90/144) 2023-02-10 11:12:24 Executor: INFO: Running task 129.0 in stage 3.0 (TID 561) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 116: Executor task launch worker for task 128.0 in stage 3.0 (TID 560) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 118: Executor task launch worker for task 125.0 in stage 3.0 (TID 557) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 146: Executor task launch worker for task 120.0 in stage 3.0 (TID 552) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 117: Executor task launch worker for task 129.0 in stage 3.0 (TID 561) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 141: Executor task launch worker for task 126.0 in stage 3.0 (TID 558) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 141: Executor task launch worker for task 126.0 in stage 3.0 (TID 558) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=84, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 122: Executor task launch worker for task 84.0 in stage 3.0 (TID 516) 2023-02-10 11:12:24 Executor: INFO: Finished task 84.0 in stage 3.0 (TID 516). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 130.0 in stage 3.0 (TID 562) (163.152.180.157, executor driver, partition 130, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 84.0 in stage 3.0 (TID 516) in 5810 ms on 163.152.180.157 (executor driver) (91/144) 2023-02-10 11:12:24 Executor: INFO: Running task 130.0 in stage 3.0 (TID 562) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 122: Executor task launch worker for task 130.0 in stage 3.0 (TID 562) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 153: Executor task launch worker for task 127.0 in stage 3.0 (TID 559) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 153: Executor task launch worker for task 127.0 in stage 3.0 (TID 559) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 116: Executor task launch worker for task 128.0 in stage 3.0 (TID 560) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 116: Executor task launch worker for task 128.0 in stage 3.0 (TID 560) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=100, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 159: Executor task launch worker for task 100.0 in stage 3.0 (TID 532) 2023-02-10 11:12:24 Executor: INFO: Finished task 100.0 in stage 3.0 (TID 532). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 131.0 in stage 3.0 (TID 563) (163.152.180.157, executor driver, partition 131, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 100.0 in stage 3.0 (TID 532) in 5550 ms on 163.152.180.157 (executor driver) (92/144) 2023-02-10 11:12:24 Executor: INFO: Running task 131.0 in stage 3.0 (TID 563) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 117: Executor task launch worker for task 129.0 in stage 3.0 (TID 561) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 117: Executor task launch worker for task 129.0 in stage 3.0 (TID 561) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=99, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 152: Executor task launch worker for task 99.0 in stage 3.0 (TID 531) 2023-02-10 11:12:24 Executor: INFO: Finished task 99.0 in stage 3.0 (TID 531). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 132.0 in stage 3.0 (TID 564) (163.152.180.157, executor driver, partition 132, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 Executor: INFO: Running task 132.0 in stage 3.0 (TID 564) 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 99.0 in stage 3.0 (TID 531) in 5571 ms on 163.152.180.157 (executor driver) (93/144) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 134: Executor task launch worker for task 121.0 in stage 3.0 (TID 553) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 122: Executor task launch worker for task 130.0 in stage 3.0 (TID 562) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 122: Executor task launch worker for task 130.0 in stage 3.0 (TID 562) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 141: Executor task launch worker for task 126.0 in stage 3.0 (TID 558) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 159: Executor task launch worker for task 131.0 in stage 3.0 (TID 563) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 153: Executor task launch worker for task 127.0 in stage 3.0 (TID 559) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 152: Executor task launch worker for task 132.0 in stage 3.0 (TID 564) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 116: Executor task launch worker for task 128.0 in stage 3.0 (TID 560) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=96, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 114: Executor task launch worker for task 96.0 in stage 3.0 (TID 528) 2023-02-10 11:12:24 Executor: INFO: Finished task 96.0 in stage 3.0 (TID 528). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 133.0 in stage 3.0 (TID 565) (163.152.180.157, executor driver, partition 133, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 96.0 in stage 3.0 (TID 528) in 5651 ms on 163.152.180.157 (executor driver) (94/144) 2023-02-10 11:12:24 Executor: INFO: Running task 133.0 in stage 3.0 (TID 565) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 114: Executor task launch worker for task 133.0 in stage 3.0 (TID 565) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=94, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 136: Executor task launch worker for task 94.0 in stage 3.0 (TID 526) 2023-02-10 11:12:24 Executor: INFO: Finished task 94.0 in stage 3.0 (TID 526). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 134.0 in stage 3.0 (TID 566) (163.152.180.157, executor driver, partition 134, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 Executor: INFO: Running task 134.0 in stage 3.0 (TID 566) 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 94.0 in stage 3.0 (TID 526) in 5707 ms on 163.152.180.157 (executor driver) (95/144) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 117: Executor task launch worker for task 129.0 in stage 3.0 (TID 561) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 159: Executor task launch worker for task 131.0 in stage 3.0 (TID 563) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 159: Executor task launch worker for task 131.0 in stage 3.0 (TID 563) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 122: Executor task launch worker for task 130.0 in stage 3.0 (TID 562) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 136: Executor task launch worker for task 134.0 in stage 3.0 (TID 566) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 114: Executor task launch worker for task 133.0 in stage 3.0 (TID 565) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 114: Executor task launch worker for task 133.0 in stage 3.0 (TID 565) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 152: Executor task launch worker for task 132.0 in stage 3.0 (TID 564) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 152: Executor task launch worker for task 132.0 in stage 3.0 (TID 564) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 139: Executor task launch worker for task 122.0 in stage 3.0 (TID 554) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=98, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 140: Executor task launch worker for task 98.0 in stage 3.0 (TID 530) 2023-02-10 11:12:24 Executor: INFO: Finished task 98.0 in stage 3.0 (TID 530). 975 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 135.0 in stage 3.0 (TID 567) (163.152.180.157, executor driver, partition 135, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 98.0 in stage 3.0 (TID 530) in 5669 ms on 163.152.180.157 (executor driver) (96/144) 2023-02-10 11:12:24 Executor: INFO: Running task 135.0 in stage 3.0 (TID 567) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 136: Executor task launch worker for task 134.0 in stage 3.0 (TID 566) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 136: Executor task launch worker for task 134.0 in stage 3.0 (TID 566) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 152: Executor task launch worker for task 132.0 in stage 3.0 (TID 564) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 159: Executor task launch worker for task 131.0 in stage 3.0 (TID 563) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 140: Executor task launch worker for task 135.0 in stage 3.0 (TID 567) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=89, attempt=0, peakBytes=7012352, peakBytesReadable=6.69 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.7M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 151: Executor task launch worker for task 89.0 in stage 3.0 (TID 521) 2023-02-10 11:12:24 Executor: INFO: Finished task 89.0 in stage 3.0 (TID 521). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 136.0 in stage 3.0 (TID 568) (163.152.180.157, executor driver, partition 136, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 Executor: INFO: Running task 136.0 in stage 3.0 (TID 568) 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 89.0 in stage 3.0 (TID 521) in 5861 ms on 163.152.180.157 (executor driver) (97/144) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 114: Executor task launch worker for task 133.0 in stage 3.0 (TID 565) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 140: Executor task launch worker for task 135.0 in stage 3.0 (TID 567) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 140: Executor task launch worker for task 135.0 in stage 3.0 (TID 567) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 151: Executor task launch worker for task 136.0 in stage 3.0 (TID 568) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 136: Executor task launch worker for task 134.0 in stage 3.0 (TID 566) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 151: Executor task launch worker for task 136.0 in stage 3.0 (TID 568) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 151: Executor task launch worker for task 136.0 in stage 3.0 (TID 568) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=102, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 130: Executor task launch worker for task 102.0 in stage 3.0 (TID 534) 2023-02-10 11:12:24 Executor: INFO: Finished task 102.0 in stage 3.0 (TID 534). 966 bytes result sent to driver 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=86, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 137: Executor task launch worker for task 86.0 in stage 3.0 (TID 518) 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 137.0 in stage 3.0 (TID 569) (163.152.180.157, executor driver, partition 137, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 Executor: INFO: Finished task 86.0 in stage 3.0 (TID 518). 966 bytes result sent to driver 2023-02-10 11:12:24 Executor: INFO: Running task 137.0 in stage 3.0 (TID 569) 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 138.0 in stage 3.0 (TID 570) (163.152.180.157, executor driver, partition 138, PROCESS_LOCAL, 4433 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 102.0 in stage 3.0 (TID 534) in 5678 ms on 163.152.180.157 (executor driver) (98/144) 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 86.0 in stage 3.0 (TID 518) in 5976 ms on 163.152.180.157 (executor driver) (99/144) 2023-02-10 11:12:24 Executor: INFO: Running task 138.0 in stage 3.0 (TID 570) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 140: Executor task launch worker for task 135.0 in stage 3.0 (TID 567) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 147: Executor task launch worker for task 124.0 in stage 3.0 (TID 556) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=95, attempt=0, peakBytes=6946816, peakBytesReadable=6.63 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.6M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 143: Executor task launch worker for task 95.0 in stage 3.0 (TID 527) 2023-02-10 11:12:24 Executor: INFO: Finished task 95.0 in stage 3.0 (TID 527). 975 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 139.0 in stage 3.0 (TID 571) (163.152.180.157, executor driver, partition 139, PROCESS_LOCAL, 4432 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 95.0 in stage 3.0 (TID 527) in 5830 ms on 163.152.180.157 (executor driver) (100/144) 2023-02-10 11:12:24 Executor: INFO: Running task 139.0 in stage 3.0 (TID 571) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=106, attempt=0, peakBytes=7012352, peakBytesReadable=6.69 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.7M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 131: Executor task launch worker for task 106.0 in stage 3.0 (TID 538) 2023-02-10 11:12:24 Executor: INFO: Finished task 106.0 in stage 3.0 (TID 538). 966 bytes result sent to driver 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 137: Executor task launch worker for task 138.0 in stage 3.0 (TID 570) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 119: Executor task launch worker for task 123.0 in stage 3.0 (TID 555) 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 140.0 in stage 3.0 (TID 572) (163.152.180.157, executor driver, partition 140, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 106.0 in stage 3.0 (TID 538) in 5609 ms on 163.152.180.157 (executor driver) (101/144) 2023-02-10 11:12:24 Executor: INFO: Running task 140.0 in stage 3.0 (TID 572) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 151: Executor task launch worker for task 136.0 in stage 3.0 (TID 568) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 130: Executor task launch worker for task 137.0 in stage 3.0 (TID 569) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 143: Executor task launch worker for task 139.0 in stage 3.0 (TID 571) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 131: Executor task launch worker for task 140.0 in stage 3.0 (TID 572) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 137: Executor task launch worker for task 138.0 in stage 3.0 (TID 570) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 137: Executor task launch worker for task 138.0 in stage 3.0 (TID 570) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 143: Executor task launch worker for task 139.0 in stage 3.0 (TID 571) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 143: Executor task launch worker for task 139.0 in stage 3.0 (TID 571) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 130: Executor task launch worker for task 137.0 in stage 3.0 (TID 569) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 130: Executor task launch worker for task 137.0 in stage 3.0 (TID 569) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=107, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 132: Executor task launch worker for task 107.0 in stage 3.0 (TID 539) 2023-02-10 11:12:24 Executor: INFO: Finished task 107.0 in stage 3.0 (TID 539). 967 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 141.0 in stage 3.0 (TID 573) (163.152.180.157, executor driver, partition 141, PROCESS_LOCAL, 4431 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 Executor: INFO: Running task 141.0 in stage 3.0 (TID 573) 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 107.0 in stage 3.0 (TID 539) in 5480 ms on 163.152.180.157 (executor driver) (102/144) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 131: Executor task launch worker for task 140.0 in stage 3.0 (TID 572) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 131: Executor task launch worker for task 140.0 in stage 3.0 (TID 572) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=104, attempt=0, peakBytes=7012352, peakBytesReadable=6.69 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.7M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 126: Executor task launch worker for task 104.0 in stage 3.0 (TID 536) 2023-02-10 11:12:24 Executor: INFO: Finished task 104.0 in stage 3.0 (TID 536). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 142.0 in stage 3.0 (TID 574) (163.152.180.157, executor driver, partition 142, PROCESS_LOCAL, 4450 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 Executor: INFO: Running task 142.0 in stage 3.0 (TID 574) 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 104.0 in stage 3.0 (TID 536) in 5708 ms on 163.152.180.157 (executor driver) (103/144) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 132: Executor task launch worker for task 141.0 in stage 3.0 (TID 573) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 118: Executor task launch worker for task 125.0 in stage 3.0 (TID 557) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 143: Executor task launch worker for task 139.0 in stage 3.0 (TID 571) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 126: Executor task launch worker for task 142.0 in stage 3.0 (TID 574) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 137: Executor task launch worker for task 138.0 in stage 3.0 (TID 570) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 130: Executor task launch worker for task 137.0 in stage 3.0 (TID 569) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 132: Executor task launch worker for task 141.0 in stage 3.0 (TID 573) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 132: Executor task launch worker for task 141.0 in stage 3.0 (TID 573) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=101, attempt=0, peakBytes=7208960, peakBytesReadable=6.88 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.9M allocated (6.1M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 142: Executor task launch worker for task 101.0 in stage 3.0 (TID 533) 2023-02-10 11:12:24 Executor: INFO: Finished task 101.0 in stage 3.0 (TID 533). 966 bytes result sent to driver 2023-02-10 11:12:24 TaskSetManager: INFO: Starting task 143.0 in stage 3.0 (TID 575) (163.152.180.157, executor driver, partition 143, PROCESS_LOCAL, 4466 bytes) taskResourceAssignments Map() 2023-02-10 11:12:24 TaskSetManager: INFO: Finished task 101.0 in stage 3.0 (TID 533) in 5833 ms on 163.152.180.157 (executor driver) (104/144) 2023-02-10 11:12:24 Executor: INFO: Running task 143.0 in stage 3.0 (TID 575) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 126: Executor task launch worker for task 142.0 in stage 3.0 (TID 574) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 126: Executor task launch worker for task 142.0 in stage 3.0 (TID 574) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 141: Executor task launch worker for task 126.0 in stage 3.0 (TID 558) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 131: Executor task launch worker for task 140.0 in stage 3.0 (TID 572) 2023-02-10 11:12:24 root: INFO: RegionPool: initialized for thread 142: Executor task launch worker for task 143.0 in stage 3.0 (TID 575) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=140, attempt=0, peakBytes=1572864, peakBytesReadable=1.50 MiB, chunks requested=2, cache hits=0 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 1.5M allocated (768.0K blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 131: Executor task launch worker for task 140.0 in stage 3.0 (TID 572) 2023-02-10 11:12:24 Executor: ERROR: Exception in task 140.0 in stage 3.0 (TID 572) is.hail.utils.HailException: array index out of bounds: index=2, length=2 at __C1792collect_distributed_array.__m1941arrayref_bounds_check(Unknown Source) at __C1792collect_distributed_array.__m2072split_StreamFold2(Unknown Source) at __C1792collect_distributed_array.__m2065split_ToArray(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray_region10_17(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray(Unknown Source) at __C1792collect_distributed_array.apply_region203_209(Unknown Source) at __C1792collect_distributed_array.apply_region7_231(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at is.hail.backend.BackendUtils.$anonfun$collectDArray$2(BackendUtils.scala:31) at is.hail.utils.package$.using(package.scala:638) at is.hail.annotations.RegionPool.scopedRegion(RegionPool.scala:162) at is.hail.backend.BackendUtils.$anonfun$collectDArray$1(BackendUtils.scala:30) at is.hail.backend.spark.SparkBackendComputeRDD.compute(SparkBackend.scala:728) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:131) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:498) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:501) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 132: Executor task launch worker for task 141.0 in stage 3.0 (TID 573) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=141, attempt=0, peakBytes=1572864, peakBytesReadable=1.50 MiB, chunks requested=2, cache hits=0 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 1.5M allocated (768.0K blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 132: Executor task launch worker for task 141.0 in stage 3.0 (TID 573) 2023-02-10 11:12:24 Executor: ERROR: Exception in task 141.0 in stage 3.0 (TID 573) is.hail.utils.HailException: array index out of bounds: index=2, length=2 at __C1792collect_distributed_array.__m1941arrayref_bounds_check(Unknown Source) at __C1792collect_distributed_array.__m2072split_StreamFold2(Unknown Source) at __C1792collect_distributed_array.__m2065split_ToArray(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray_region10_17(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray(Unknown Source) at __C1792collect_distributed_array.apply_region203_209(Unknown Source) at __C1792collect_distributed_array.apply_region7_231(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at is.hail.backend.BackendUtils.$anonfun$collectDArray$2(BackendUtils.scala:31) at is.hail.utils.package$.using(package.scala:638) at is.hail.annotations.RegionPool.scopedRegion(RegionPool.scala:162) at is.hail.backend.BackendUtils.$anonfun$collectDArray$1(BackendUtils.scala:30) at is.hail.backend.spark.SparkBackendComputeRDD.compute(SparkBackend.scala:728) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:131) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:498) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:501) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 126: Executor task launch worker for task 142.0 in stage 3.0 (TID 574) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=142, attempt=0, peakBytes=1572864, peakBytesReadable=1.50 MiB, chunks requested=2, cache hits=0 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 1.5M allocated (768.0K blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 126: Executor task launch worker for task 142.0 in stage 3.0 (TID 574) 2023-02-10 11:12:24 Executor: ERROR: Exception in task 142.0 in stage 3.0 (TID 574) is.hail.utils.HailException: array index out of bounds: index=2, length=2 at __C1792collect_distributed_array.__m1941arrayref_bounds_check(Unknown Source) at __C1792collect_distributed_array.__m2072split_StreamFold2(Unknown Source) at __C1792collect_distributed_array.__m2065split_ToArray(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray_region10_17(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray(Unknown Source) at __C1792collect_distributed_array.apply_region203_209(Unknown Source) at __C1792collect_distributed_array.apply_region7_231(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at is.hail.backend.BackendUtils.$anonfun$collectDArray$2(BackendUtils.scala:31) at is.hail.utils.package$.using(package.scala:638) at is.hail.annotations.RegionPool.scopedRegion(RegionPool.scala:162) at is.hail.backend.BackendUtils.$anonfun$collectDArray$1(BackendUtils.scala:30) at is.hail.backend.spark.SparkBackendComputeRDD.compute(SparkBackend.scala:728) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:131) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:498) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:501) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 384.0K allocated (128.0K blocks / 256.0K chunks), regions.size = 2, 0 current java objects, thread 142: Executor task launch worker for task 143.0 in stage 3.0 (TID 575) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 960.0K allocated (192.0K blocks / 768.0K chunks), regions.size = 3, 0 current java objects, thread 142: Executor task launch worker for task 143.0 in stage 3.0 (TID 575) 2023-02-10 11:12:24 TaskSetManager: WARN: Lost task 142.0 in stage 3.0 (TID 574) (163.152.180.157 executor driver): is.hail.utils.HailException: array index out of bounds: index=2, length=2 at __C1792collect_distributed_array.__m1941arrayref_bounds_check(Unknown Source) at __C1792collect_distributed_array.__m2072split_StreamFold2(Unknown Source) at __C1792collect_distributed_array.__m2065split_ToArray(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray_region10_17(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray(Unknown Source) at __C1792collect_distributed_array.apply_region203_209(Unknown Source) at __C1792collect_distributed_array.apply_region7_231(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at is.hail.backend.BackendUtils.$anonfun$collectDArray$2(BackendUtils.scala:31) at is.hail.utils.package$.using(package.scala:638) at is.hail.annotations.RegionPool.scopedRegion(RegionPool.scala:162) at is.hail.backend.BackendUtils.$anonfun$collectDArray$1(BackendUtils.scala:30) at is.hail.backend.spark.SparkBackendComputeRDD.compute(SparkBackend.scala:728) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:131) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:498) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:501) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-10 11:12:24 TaskSetManager: ERROR: Task 142 in stage 3.0 failed 1 times; aborting job 2023-02-10 11:12:24 TaskSchedulerImpl: INFO: Cancelling stage 3 2023-02-10 11:12:24 TaskSchedulerImpl: INFO: Killing all running tasks in stage 3: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 128.0 in stage 3.0 (TID 560), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 129.0 in stage 3.0 (TID 561), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 108.0 in stage 3.0 (TID 540), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 130.0 in stage 3.0 (TID 562), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 122.0 in stage 3.0 (TID 554), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 131.0 in stage 3.0 (TID 563), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 123.0 in stage 3.0 (TID 555), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 124.0 in stage 3.0 (TID 556), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 103.0 in stage 3.0 (TID 535), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 125.0 in stage 3.0 (TID 557), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 126.0 in stage 3.0 (TID 558), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 118.0 in stage 3.0 (TID 550), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 119.0 in stage 3.0 (TID 551), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 90.0 in stage 3.0 (TID 522), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 120.0 in stage 3.0 (TID 552), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 121.0 in stage 3.0 (TID 553), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 113.0 in stage 3.0 (TID 545), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 143.0 in stage 3.0 (TID 575), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 114.0 in stage 3.0 (TID 546), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 136.0 in stage 3.0 (TID 568), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 115.0 in stage 3.0 (TID 547), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 137.0 in stage 3.0 (TID 569), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 116.0 in stage 3.0 (TID 548), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 87.0 in stage 3.0 (TID 519), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 138.0 in stage 3.0 (TID 570), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 117.0 in stage 3.0 (TID 549), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 109.0 in stage 3.0 (TID 541), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 139.0 in stage 3.0 (TID 571), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 110.0 in stage 3.0 (TID 542), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 132.0 in stage 3.0 (TID 564), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 111.0 in stage 3.0 (TID 543), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 133.0 in stage 3.0 (TID 565), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 112.0 in stage 3.0 (TID 544), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 134.0 in stage 3.0 (TID 566), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 105.0 in stage 3.0 (TID 537), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 135.0 in stage 3.0 (TID 567), reason: Stage cancelled 2023-02-10 11:12:24 Executor: INFO: Executor is trying to kill task 127.0 in stage 3.0 (TID 559), reason: Stage cancelled 2023-02-10 11:12:24 TaskSchedulerImpl: INFO: Stage 3 was cancelled 2023-02-10 11:12:24 DAGScheduler: INFO: ResultStage 3 (collect at SparkBackend.scala:288) failed in 18.770 s due to Job aborted due to stage failure: Task 142 in stage 3.0 failed 1 times, most recent failure: Lost task 142.0 in stage 3.0 (TID 574) (163.152.180.157 executor driver): is.hail.utils.HailException: array index out of bounds: index=2, length=2 at __C1792collect_distributed_array.__m1941arrayref_bounds_check(Unknown Source) at __C1792collect_distributed_array.__m2072split_StreamFold2(Unknown Source) at __C1792collect_distributed_array.__m2065split_ToArray(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray_region10_17(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray(Unknown Source) at __C1792collect_distributed_array.apply_region203_209(Unknown Source) at __C1792collect_distributed_array.apply_region7_231(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at is.hail.backend.BackendUtils.$anonfun$collectDArray$2(BackendUtils.scala:31) at is.hail.utils.package$.using(package.scala:638) at is.hail.annotations.RegionPool.scopedRegion(RegionPool.scala:162) at is.hail.backend.BackendUtils.$anonfun$collectDArray$1(BackendUtils.scala:30) at is.hail.backend.spark.SparkBackendComputeRDD.compute(SparkBackend.scala:728) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:131) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:498) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:501) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Driver stacktrace: 2023-02-10 11:12:24 TaskSetManager: INFO: Lost task 141.0 in stage 3.0 (TID 573) on 163.152.180.157, executor driver: is.hail.utils.HailException (array index out of bounds: index=2, length=2) [duplicate 1] 2023-02-10 11:12:24 TaskSetManager: INFO: Lost task 140.0 in stage 3.0 (TID 572) on 163.152.180.157, executor driver: is.hail.utils.HailException (array index out of bounds: index=2, length=2) [duplicate 2] 2023-02-10 11:12:24 DAGScheduler: INFO: Job 3 failed: collect at SparkBackend.scala:288, took 18.777227 s 2023-02-10 11:12:24 root: ERROR: error while applying lowering 'LowerOrInterpretNonCompilable' 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 704.0K allocated (704.0K blocks / 0 chunks), regions.size = 2, 0 current java objects, thread 28: Thread-5 2023-02-10 11:12:24 root: ERROR: HailException: array index out of bounds: index=2, length=2 From org.apache.spark.SparkException: Job aborted due to stage failure: Task 142 in stage 3.0 failed 1 times, most recent failure: Lost task 142.0 in stage 3.0 (TID 574) (163.152.180.157 executor driver): is.hail.utils.HailException: array index out of bounds: index=2, length=2 at __C1792collect_distributed_array.__m1941arrayref_bounds_check(Unknown Source) at __C1792collect_distributed_array.__m2072split_StreamFold2(Unknown Source) at __C1792collect_distributed_array.__m2065split_ToArray(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray_region10_17(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray(Unknown Source) at __C1792collect_distributed_array.apply_region203_209(Unknown Source) at __C1792collect_distributed_array.apply_region7_231(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at is.hail.backend.BackendUtils.$anonfun$collectDArray$2(BackendUtils.scala:31) at is.hail.utils.package$.using(package.scala:638) at is.hail.annotations.RegionPool.scopedRegion(RegionPool.scala:162) at is.hail.backend.BackendUtils.$anonfun$collectDArray$1(BackendUtils.scala:30) at is.hail.backend.spark.SparkBackendComputeRDD.compute(SparkBackend.scala:728) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:131) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:498) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:501) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Driver stacktrace: at org.apache.spark.scheduler.DAGScheduler.failJobAndIndependentStages(DAGScheduler.scala:2303) at org.apache.spark.scheduler.DAGScheduler.$anonfun$abortStage$2(DAGScheduler.scala:2252) at org.apache.spark.scheduler.DAGScheduler.$anonfun$abortStage$2$adapted(DAGScheduler.scala:2251) at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62) at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49) at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:2251) at org.apache.spark.scheduler.DAGScheduler.$anonfun$handleTaskSetFailed$1(DAGScheduler.scala:1124) at org.apache.spark.scheduler.DAGScheduler.$anonfun$handleTaskSetFailed$1$adapted(DAGScheduler.scala:1124) at scala.Option.foreach(Option.scala:407) at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:1124) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:2490) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2432) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:2421) at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:49) at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:902) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2196) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2217) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2236) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2261) at org.apache.spark.rdd.RDD.$anonfun$collect$1(RDD.scala:1030) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112) at org.apache.spark.rdd.RDD.withScope(RDD.scala:414) at org.apache.spark.rdd.RDD.collect(RDD.scala:1029) at is.hail.backend.spark.SparkBackend.parallelizeAndComputeWithIndex(SparkBackend.scala:288) at is.hail.backend.BackendUtils.collectDArray(BackendUtils.scala:28) at __C1697Compiled.__m1717split_CollectDistributedArray(Emit.scala) at __C1697Compiled.apply(Emit.scala) at is.hail.expr.ir.CompileAndEvaluate$.$anonfun$_apply$3(CompileAndEvaluate.scala:57) at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.CompileAndEvaluate$._apply(CompileAndEvaluate.scala:57) at is.hail.expr.ir.CompileAndEvaluate$.evalToIR(CompileAndEvaluate.scala:30) at is.hail.expr.ir.LowerOrInterpretNonCompilable$.evaluate$1(LowerOrInterpretNonCompilable.scala:30) at is.hail.expr.ir.LowerOrInterpretNonCompilable$.rewrite$1(LowerOrInterpretNonCompilable.scala:67) at is.hail.expr.ir.LowerOrInterpretNonCompilable$.apply(LowerOrInterpretNonCompilable.scala:72) at is.hail.expr.ir.lowering.LowerOrInterpretNonCompilablePass$.transform(LoweringPass.scala:69) at is.hail.expr.ir.lowering.LoweringPass.$anonfun$apply$3(LoweringPass.scala:16) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.lowering.LoweringPass.$anonfun$apply$1(LoweringPass.scala:16) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.lowering.LoweringPass.apply(LoweringPass.scala:14) at is.hail.expr.ir.lowering.LoweringPass.apply$(LoweringPass.scala:13) at is.hail.expr.ir.lowering.LowerOrInterpretNonCompilablePass$.apply(LoweringPass.scala:64) at is.hail.expr.ir.lowering.LoweringPipeline.$anonfun$apply$1(LoweringPipeline.scala:15) at is.hail.expr.ir.lowering.LoweringPipeline.$anonfun$apply$1$adapted(LoweringPipeline.scala:13) at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36) at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33) at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:38) at is.hail.expr.ir.lowering.LoweringPipeline.apply(LoweringPipeline.scala:13) at is.hail.expr.ir.CompileAndEvaluate$._apply(CompileAndEvaluate.scala:47) at is.hail.backend.spark.SparkBackend._execute(SparkBackend.scala:383) at is.hail.backend.spark.SparkBackend.$anonfun$executeEncode$2(SparkBackend.scala:419) at is.hail.backend.ExecuteContext$.$anonfun$scoped$3(ExecuteContext.scala:48) at is.hail.utils.package$.using(package.scala:638) at is.hail.backend.ExecuteContext$.$anonfun$scoped$2(ExecuteContext.scala:48) at is.hail.utils.package$.using(package.scala:638) at is.hail.annotations.RegionPool$.scoped(RegionPool.scala:17) at is.hail.backend.ExecuteContext$.scoped(ExecuteContext.scala:47) at is.hail.backend.spark.SparkBackend.withExecuteContext(SparkBackend.scala:277) at is.hail.backend.spark.SparkBackend.$anonfun$executeEncode$1(SparkBackend.scala:416) at is.hail.utils.ExecutionTimer$.time(ExecutionTimer.scala:52) at is.hail.backend.spark.SparkBackend.executeEncode(SparkBackend.scala:415) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244) at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357) at py4j.Gateway.invoke(Gateway.java:282) at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132) at py4j.commands.CallCommand.execute(CallCommand.java:79) at py4j.GatewayConnection.run(GatewayConnection.java:238) at java.lang.Thread.run(Thread.java:750) is.hail.utils.HailException: array index out of bounds: index=2, length=2 at __C1792collect_distributed_array.__m1941arrayref_bounds_check(Unknown Source) at __C1792collect_distributed_array.__m2072split_StreamFold2(Unknown Source) at __C1792collect_distributed_array.__m2065split_ToArray(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray_region10_17(Unknown Source) at __C1792collect_distributed_array.__m2057split_ToArray(Unknown Source) at __C1792collect_distributed_array.apply_region203_209(Unknown Source) at __C1792collect_distributed_array.apply_region7_231(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at __C1792collect_distributed_array.apply(Unknown Source) at is.hail.backend.BackendUtils.$anonfun$collectDArray$2(BackendUtils.scala:31) at is.hail.utils.package$.using(package.scala:638) at is.hail.annotations.RegionPool.scopedRegion(RegionPool.scala:162) at is.hail.backend.BackendUtils.$anonfun$collectDArray$1(BackendUtils.scala:30) at is.hail.backend.spark.SparkBackendComputeRDD.compute(SparkBackend.scala:728) at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:373) at org.apache.spark.rdd.RDD.iterator(RDD.scala:337) at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:90) at org.apache.spark.scheduler.Task.run(Task.scala:131) at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:498) at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439) at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:501) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 116: Executor task launch worker for task 128.0 in stage 3.0 (TID 560) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 153: Executor task launch worker for task 127.0 in stage 3.0 (TID 559) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 1.0M allocated (192.0K blocks / 832.0K chunks), regions.size = 3, 0 current java objects, thread 142: Executor task launch worker for task 143.0 in stage 3.0 (TID 575) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=87, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 138: Executor task launch worker for task 87.0 in stage 3.0 (TID 519) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 114: Executor task launch worker for task 133.0 in stage 3.0 (TID 565) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 117: Executor task launch worker for task 129.0 in stage 3.0 (TID 561) 2023-02-10 11:12:24 Executor: INFO: Executor killed task 87.0 in stage 3.0 (TID 519), reason: Stage cancelled 2023-02-10 11:12:24 TaskSetManager: WARN: Lost task 87.0 in stage 3.0 (TID 519) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 159: Executor task launch worker for task 131.0 in stage 3.0 (TID 563) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=108, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 123: Executor task launch worker for task 108.0 in stage 3.0 (TID 540) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=109, attempt=0, peakBytes=7012352, peakBytesReadable=6.69 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 Executor: INFO: Executor killed task 108.0 in stage 3.0 (TID 540), reason: Stage cancelled 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.7M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 127: Executor task launch worker for task 109.0 in stage 3.0 (TID 541) 2023-02-10 11:12:24 Executor: INFO: Executor killed task 109.0 in stage 3.0 (TID 541), reason: Stage cancelled 2023-02-10 11:12:24 TaskSetManager: WARN: Lost task 108.0 in stage 3.0 (TID 540) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:24 TaskSetManager: WARN: Lost task 109.0 in stage 3.0 (TID 541) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 152: Executor task launch worker for task 132.0 in stage 3.0 (TID 564) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=110, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 144: Executor task launch worker for task 110.0 in stage 3.0 (TID 542) 2023-02-10 11:12:24 Executor: INFO: Executor killed task 110.0 in stage 3.0 (TID 542), reason: Stage cancelled 2023-02-10 11:12:24 TaskSetManager: WARN: Lost task 110.0 in stage 3.0 (TID 542) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=90, attempt=0, peakBytes=7733248, peakBytesReadable=7.38 MiB, chunks requested=22, cache hits=20 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 7.4M allocated (6.6M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 150: Executor task launch worker for task 90.0 in stage 3.0 (TID 522) 2023-02-10 11:12:24 Executor: INFO: Executor killed task 90.0 in stage 3.0 (TID 522), reason: Stage cancelled 2023-02-10 11:12:24 TaskSetManager: WARN: Lost task 90.0 in stage 3.0 (TID 522) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 122: Executor task launch worker for task 130.0 in stage 3.0 (TID 562) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 136: Executor task launch worker for task 134.0 in stage 3.0 (TID 566) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=111, attempt=0, peakBytes=7208960, peakBytesReadable=6.88 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.9M allocated (6.1M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 115: Executor task launch worker for task 111.0 in stage 3.0 (TID 543) 2023-02-10 11:12:24 Executor: INFO: Executor killed task 111.0 in stage 3.0 (TID 543), reason: Stage cancelled 2023-02-10 11:12:24 TaskSetManager: WARN: Lost task 111.0 in stage 3.0 (TID 543) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=105, attempt=0, peakBytes=6946816, peakBytesReadable=6.63 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.6M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 145: Executor task launch worker for task 105.0 in stage 3.0 (TID 537) 2023-02-10 11:12:24 Executor: INFO: Executor killed task 105.0 in stage 3.0 (TID 537), reason: Stage cancelled 2023-02-10 11:12:24 TaskSetManager: WARN: Lost task 105.0 in stage 3.0 (TID 537) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 140: Executor task launch worker for task 135.0 in stage 3.0 (TID 567) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 151: Executor task launch worker for task 136.0 in stage 3.0 (TID 568) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 143: Executor task launch worker for task 139.0 in stage 3.0 (TID 571) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 130: Executor task launch worker for task 137.0 in stage 3.0 (TID 569) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 137: Executor task launch worker for task 138.0 in stage 3.0 (TID 570) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=112, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 148: Executor task launch worker for task 112.0 in stage 3.0 (TID 544) 2023-02-10 11:12:24 Executor: INFO: Executor killed task 112.0 in stage 3.0 (TID 544), reason: Stage cancelled 2023-02-10 11:12:24 TaskSetManager: WARN: Lost task 112.0 in stage 3.0 (TID 544) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=113, attempt=0, peakBytes=6881280, peakBytesReadable=6.56 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.6M allocated (5.8M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 128: Executor task launch worker for task 113.0 in stage 3.0 (TID 545) 2023-02-10 11:12:24 Executor: INFO: Executor killed task 113.0 in stage 3.0 (TID 545), reason: Stage cancelled 2023-02-10 11:12:24 TaskSetManager: WARN: Lost task 113.0 in stage 3.0 (TID 545) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:24 root: INFO: TaskReport: stage=3, partition=115, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:24 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 133: Executor task launch worker for task 115.0 in stage 3.0 (TID 547) 2023-02-10 11:12:24 Executor: INFO: Executor killed task 115.0 in stage 3.0 (TID 547), reason: Stage cancelled 2023-02-10 11:12:24 TaskSetManager: WARN: Lost task 115.0 in stage 3.0 (TID 547) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:24 root: INFO: RegionPool: REPORT_THRESHOLD: 2.0M allocated (1.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 142: Executor task launch worker for task 143.0 in stage 3.0 (TID 575) 2023-02-10 11:12:25 root: INFO: TaskReport: stage=3, partition=103, attempt=0, peakBytes=7012352, peakBytesReadable=6.69 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:25 root: INFO: RegionPool: FREE: 6.7M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 120: Executor task launch worker for task 103.0 in stage 3.0 (TID 535) 2023-02-10 11:12:25 Executor: INFO: Executor killed task 103.0 in stage 3.0 (TID 535), reason: Stage cancelled 2023-02-10 11:12:25 TaskSetManager: WARN: Lost task 103.0 in stage 3.0 (TID 535) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:25 root: INFO: TaskReport: stage=3, partition=119, attempt=0, peakBytes=7012352, peakBytesReadable=6.69 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:25 root: INFO: RegionPool: FREE: 6.7M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 124: Executor task launch worker for task 119.0 in stage 3.0 (TID 551) 2023-02-10 11:12:25 Executor: INFO: Executor killed task 119.0 in stage 3.0 (TID 551), reason: Stage cancelled 2023-02-10 11:12:25 TaskSetManager: WARN: Lost task 119.0 in stage 3.0 (TID 551) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:25 root: INFO: TaskReport: stage=3, partition=118, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:25 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 121: Executor task launch worker for task 118.0 in stage 3.0 (TID 550) 2023-02-10 11:12:25 Executor: INFO: Executor killed task 118.0 in stage 3.0 (TID 550), reason: Stage cancelled 2023-02-10 11:12:25 TaskSetManager: WARN: Lost task 118.0 in stage 3.0 (TID 550) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:25 root: INFO: TaskReport: stage=3, partition=114, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:25 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 158: Executor task launch worker for task 114.0 in stage 3.0 (TID 546) 2023-02-10 11:12:25 Executor: INFO: Executor killed task 114.0 in stage 3.0 (TID 546), reason: Stage cancelled 2023-02-10 11:12:25 TaskSetManager: WARN: Lost task 114.0 in stage 3.0 (TID 546) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:25 root: INFO: TaskReport: stage=3, partition=116, attempt=0, peakBytes=7012352, peakBytesReadable=6.69 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:25 root: INFO: RegionPool: FREE: 6.7M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 129: Executor task launch worker for task 116.0 in stage 3.0 (TID 548) 2023-02-10 11:12:25 Executor: INFO: Executor killed task 116.0 in stage 3.0 (TID 548), reason: Stage cancelled 2023-02-10 11:12:25 TaskSetManager: WARN: Lost task 116.0 in stage 3.0 (TID 548) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:25 root: INFO: TaskReport: stage=3, partition=117, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:25 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 125: Executor task launch worker for task 117.0 in stage 3.0 (TID 549) 2023-02-10 11:12:25 Executor: INFO: Executor killed task 117.0 in stage 3.0 (TID 549), reason: Stage cancelled 2023-02-10 11:12:25 TaskSetManager: WARN: Lost task 117.0 in stage 3.0 (TID 549) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:25 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 146: Executor task launch worker for task 120.0 in stage 3.0 (TID 552) 2023-02-10 11:12:25 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 139: Executor task launch worker for task 122.0 in stage 3.0 (TID 554) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 134: Executor task launch worker for task 121.0 in stage 3.0 (TID 553) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 141: Executor task launch worker for task 126.0 in stage 3.0 (TID 558) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 147: Executor task launch worker for task 124.0 in stage 3.0 (TID 556) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 136: Executor task launch worker for task 134.0 in stage 3.0 (TID 566) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 142: Executor task launch worker for task 143.0 in stage 3.0 (TID 575) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 152: Executor task launch worker for task 132.0 in stage 3.0 (TID 564) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 117: Executor task launch worker for task 129.0 in stage 3.0 (TID 561) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 122: Executor task launch worker for task 130.0 in stage 3.0 (TID 562) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 151: Executor task launch worker for task 136.0 in stage 3.0 (TID 568) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 130: Executor task launch worker for task 137.0 in stage 3.0 (TID 569) 2023-02-10 11:12:26 root: INFO: TaskReport: stage=3, partition=139, attempt=0, peakBytes=3932160, peakBytesReadable=3.75 MiB, chunks requested=9, cache hits=7 2023-02-10 11:12:26 root: INFO: RegionPool: FREE: 3.8M allocated (3.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 143: Executor task launch worker for task 139.0 in stage 3.0 (TID 571) 2023-02-10 11:12:26 Executor: INFO: Executor interrupted and killed task 139.0 in stage 3.0 (TID 571), reason: Stage cancelled 2023-02-10 11:12:26 TaskSetManager: WARN: Lost task 139.0 in stage 3.0 (TID 571) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 119: Executor task launch worker for task 123.0 in stage 3.0 (TID 555) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 159: Executor task launch worker for task 131.0 in stage 3.0 (TID 563) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 118: Executor task launch worker for task 125.0 in stage 3.0 (TID 557) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 137: Executor task launch worker for task 138.0 in stage 3.0 (TID 570) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 140: Executor task launch worker for task 135.0 in stage 3.0 (TID 567) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 116: Executor task launch worker for task 128.0 in stage 3.0 (TID 560) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 114: Executor task launch worker for task 133.0 in stage 3.0 (TID 565) 2023-02-10 11:12:26 root: INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (3.2M blocks / 832.0K chunks), regions.size = 12, 0 current java objects, thread 153: Executor task launch worker for task 127.0 in stage 3.0 (TID 559) 2023-02-10 11:12:27 root: INFO: TaskReport: stage=3, partition=120, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:27 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 146: Executor task launch worker for task 120.0 in stage 3.0 (TID 552) 2023-02-10 11:12:27 Executor: INFO: Executor killed task 120.0 in stage 3.0 (TID 552), reason: Stage cancelled 2023-02-10 11:12:27 TaskSetManager: WARN: Lost task 120.0 in stage 3.0 (TID 552) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:27 root: INFO: TaskReport: stage=3, partition=122, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:27 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 139: Executor task launch worker for task 122.0 in stage 3.0 (TID 554) 2023-02-10 11:12:27 Executor: INFO: Executor killed task 122.0 in stage 3.0 (TID 554), reason: Stage cancelled 2023-02-10 11:12:27 TaskSetManager: WARN: Lost task 122.0 in stage 3.0 (TID 554) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:27 root: INFO: TaskReport: stage=3, partition=124, attempt=0, peakBytes=7012352, peakBytesReadable=6.69 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:27 root: INFO: RegionPool: FREE: 6.7M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 147: Executor task launch worker for task 124.0 in stage 3.0 (TID 556) 2023-02-10 11:12:27 Executor: INFO: Executor killed task 124.0 in stage 3.0 (TID 556), reason: Stage cancelled 2023-02-10 11:12:27 TaskSetManager: WARN: Lost task 124.0 in stage 3.0 (TID 556) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:27 root: INFO: TaskReport: stage=3, partition=126, attempt=0, peakBytes=7012352, peakBytesReadable=6.69 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:27 root: INFO: RegionPool: FREE: 6.7M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 141: Executor task launch worker for task 126.0 in stage 3.0 (TID 558) 2023-02-10 11:12:27 Executor: INFO: Executor killed task 126.0 in stage 3.0 (TID 558), reason: Stage cancelled 2023-02-10 11:12:27 TaskSetManager: WARN: Lost task 126.0 in stage 3.0 (TID 558) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:27 root: INFO: TaskReport: stage=3, partition=132, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:27 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 152: Executor task launch worker for task 132.0 in stage 3.0 (TID 564) 2023-02-10 11:12:27 Executor: INFO: Executor killed task 132.0 in stage 3.0 (TID 564), reason: Stage cancelled 2023-02-10 11:12:27 TaskSetManager: WARN: Lost task 132.0 in stage 3.0 (TID 564) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:27 root: INFO: TaskReport: stage=3, partition=121, attempt=0, peakBytes=7405568, peakBytesReadable=7.06 MiB, chunks requested=21, cache hits=19 2023-02-10 11:12:27 root: INFO: RegionPool: FREE: 7.1M allocated (6.3M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 134: Executor task launch worker for task 121.0 in stage 3.0 (TID 553) 2023-02-10 11:12:27 Executor: INFO: Executor killed task 121.0 in stage 3.0 (TID 553), reason: Stage cancelled 2023-02-10 11:12:27 TaskSetManager: WARN: Lost task 121.0 in stage 3.0 (TID 553) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:27 root: INFO: TaskReport: stage=3, partition=136, attempt=0, peakBytes=7012352, peakBytesReadable=6.69 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:27 root: INFO: RegionPool: FREE: 6.7M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 151: Executor task launch worker for task 136.0 in stage 3.0 (TID 568) 2023-02-10 11:12:27 Executor: INFO: Executor killed task 136.0 in stage 3.0 (TID 568), reason: Stage cancelled 2023-02-10 11:12:27 TaskSetManager: WARN: Lost task 136.0 in stage 3.0 (TID 568) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:27 root: INFO: TaskReport: stage=3, partition=130, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:27 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 122: Executor task launch worker for task 130.0 in stage 3.0 (TID 562) 2023-02-10 11:12:27 Executor: INFO: Executor killed task 130.0 in stage 3.0 (TID 562), reason: Stage cancelled 2023-02-10 11:12:27 TaskSetManager: WARN: Lost task 130.0 in stage 3.0 (TID 562) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 root: INFO: TaskReport: stage=3, partition=143, attempt=0, peakBytes=7798784, peakBytesReadable=7.44 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:28 root: INFO: RegionPool: FREE: 7.4M allocated (6.7M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 142: Executor task launch worker for task 143.0 in stage 3.0 (TID 575) 2023-02-10 11:12:28 Executor: INFO: Executor killed task 143.0 in stage 3.0 (TID 575), reason: Stage cancelled 2023-02-10 11:12:28 root: INFO: TaskReport: stage=3, partition=134, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:28 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 136: Executor task launch worker for task 134.0 in stage 3.0 (TID 566) 2023-02-10 11:12:28 Executor: INFO: Executor killed task 134.0 in stage 3.0 (TID 566), reason: Stage cancelled 2023-02-10 11:12:28 TaskSetManager: WARN: Lost task 143.0 in stage 3.0 (TID 575) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 TaskSetManager: WARN: Lost task 134.0 in stage 3.0 (TID 566) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 root: INFO: TaskReport: stage=3, partition=137, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:28 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 130: Executor task launch worker for task 137.0 in stage 3.0 (TID 569) 2023-02-10 11:12:28 Executor: INFO: Executor killed task 137.0 in stage 3.0 (TID 569), reason: Stage cancelled 2023-02-10 11:12:28 TaskSetManager: WARN: Lost task 137.0 in stage 3.0 (TID 569) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 root: INFO: TaskReport: stage=3, partition=131, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:28 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 159: Executor task launch worker for task 131.0 in stage 3.0 (TID 563) 2023-02-10 11:12:28 Executor: INFO: Executor killed task 131.0 in stage 3.0 (TID 563), reason: Stage cancelled 2023-02-10 11:12:28 TaskSetManager: WARN: Lost task 131.0 in stage 3.0 (TID 563) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 root: INFO: TaskReport: stage=3, partition=135, attempt=0, peakBytes=6946816, peakBytesReadable=6.63 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:28 root: INFO: RegionPool: FREE: 6.6M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 140: Executor task launch worker for task 135.0 in stage 3.0 (TID 567) 2023-02-10 11:12:28 Executor: INFO: Executor killed task 135.0 in stage 3.0 (TID 567), reason: Stage cancelled 2023-02-10 11:12:28 TaskSetManager: WARN: Lost task 135.0 in stage 3.0 (TID 567) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 root: INFO: TaskReport: stage=3, partition=138, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:28 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 137: Executor task launch worker for task 138.0 in stage 3.0 (TID 570) 2023-02-10 11:12:28 Executor: INFO: Executor killed task 138.0 in stage 3.0 (TID 570), reason: Stage cancelled 2023-02-10 11:12:28 TaskSetManager: WARN: Lost task 138.0 in stage 3.0 (TID 570) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 root: INFO: TaskReport: stage=3, partition=128, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:28 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 116: Executor task launch worker for task 128.0 in stage 3.0 (TID 560) 2023-02-10 11:12:28 Executor: INFO: Executor killed task 128.0 in stage 3.0 (TID 560), reason: Stage cancelled 2023-02-10 11:12:28 TaskSetManager: WARN: Lost task 128.0 in stage 3.0 (TID 560) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 root: INFO: TaskReport: stage=3, partition=125, attempt=0, peakBytes=7340032, peakBytesReadable=7.00 MiB, chunks requested=21, cache hits=19 2023-02-10 11:12:28 root: INFO: RegionPool: FREE: 7.0M allocated (6.3M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 118: Executor task launch worker for task 125.0 in stage 3.0 (TID 557) 2023-02-10 11:12:28 Executor: INFO: Executor killed task 125.0 in stage 3.0 (TID 557), reason: Stage cancelled 2023-02-10 11:12:28 TaskSetManager: WARN: Lost task 125.0 in stage 3.0 (TID 557) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 root: INFO: TaskReport: stage=3, partition=127, attempt=0, peakBytes=7012352, peakBytesReadable=6.69 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:28 root: INFO: RegionPool: FREE: 6.7M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 153: Executor task launch worker for task 127.0 in stage 3.0 (TID 559) 2023-02-10 11:12:28 root: INFO: TaskReport: stage=3, partition=129, attempt=0, peakBytes=6946816, peakBytesReadable=6.63 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:28 root: INFO: RegionPool: FREE: 6.6M allocated (5.9M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 117: Executor task launch worker for task 129.0 in stage 3.0 (TID 561) 2023-02-10 11:12:28 Executor: INFO: Executor killed task 127.0 in stage 3.0 (TID 559), reason: Stage cancelled 2023-02-10 11:12:28 Executor: INFO: Executor killed task 129.0 in stage 3.0 (TID 561), reason: Stage cancelled 2023-02-10 11:12:28 TaskSetManager: WARN: Lost task 127.0 in stage 3.0 (TID 559) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 TaskSetManager: WARN: Lost task 129.0 in stage 3.0 (TID 561) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 root: INFO: TaskReport: stage=3, partition=123, attempt=0, peakBytes=7077888, peakBytesReadable=6.75 MiB, chunks requested=19, cache hits=17 2023-02-10 11:12:28 root: INFO: RegionPool: FREE: 6.8M allocated (6.0M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 119: Executor task launch worker for task 123.0 in stage 3.0 (TID 555) 2023-02-10 11:12:28 Executor: INFO: Executor killed task 123.0 in stage 3.0 (TID 555), reason: Stage cancelled 2023-02-10 11:12:28 TaskSetManager: WARN: Lost task 123.0 in stage 3.0 (TID 555) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 root: INFO: TaskReport: stage=3, partition=133, attempt=0, peakBytes=7143424, peakBytesReadable=6.81 MiB, chunks requested=20, cache hits=18 2023-02-10 11:12:28 root: INFO: RegionPool: FREE: 6.8M allocated (6.1M blocks / 768.0K chunks), regions.size = 12, 0 current java objects, thread 114: Executor task launch worker for task 133.0 in stage 3.0 (TID 565) 2023-02-10 11:12:28 Executor: INFO: Executor killed task 133.0 in stage 3.0 (TID 565), reason: Stage cancelled 2023-02-10 11:12:28 TaskSetManager: WARN: Lost task 133.0 in stage 3.0 (TID 565) (163.152.180.157 executor driver): TaskKilled (Stage cancelled) 2023-02-10 11:12:28 TaskSchedulerImpl: INFO: Removed TaskSet 3.0, whose tasks have all completed, from pool