2021-12-17 08:47:15 Hail: INFO: Running Hail version 0.2.79-f141af259254 2021-12-17 08:47:15 SparkContext: WARN: Using an existing SparkContext; some configuration may not take effect. 2021-12-17 08:47:19 root: INFO: RegionPool: initialized for thread 240: Thread-44 2021-12-17 08:47:19 root: INFO: globbing path /Users/jeji/ASD_pQTL/SNUBH_ASD_210210.vcf.gz returned 1 files: SNUBH_ASD_210210.vcf.gz 2021-12-17 08:47:19 root: INFO: globbing path file:/Users/jeji/ASD_pQTL/SNUBH_ASD_210210.vcf.gz returned 1 files: SNUBH_ASD_210210.vcf.gz 2021-12-17 08:47:19 MemoryStore: INFO: Block broadcast_0 stored as values in memory (estimated size 2.3 MiB, free 53.2 GiB) 2021-12-17 08:47:19 MemoryStore: INFO: Block broadcast_0_piece0 stored as bytes in memory (estimated size 123.7 KiB, free 53.2 GiB) 2021-12-17 08:47:19 BlockManagerInfo: INFO: Added broadcast_0_piece0 in memory on 192.168.0.54:59478 (size: 123.7 KiB, free: 53.2 GiB) 2021-12-17 08:47:19 SparkContext: INFO: Created broadcast 0 from broadcast at SparkBackend.scala:278 2021-12-17 08:47:19 root: INFO: RegionPool: FREE: 64.0K allocated (64.0K blocks / 0 chunks), regions.size = 1, 0 current java objects, thread 240: Thread-44 2021-12-17 08:47:19 root: INFO: timing SparkBackend.parse_matrix_ir total 36.462ms self 36.462ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: RegionPool: initialized for thread 240: Thread-44 2021-12-17 08:47:20 root: INFO: RegionPool: FREE: 64.0K allocated (64.0K blocks / 0 chunks), regions.size = 1, 0 current java objects, thread 240: Thread-44 2021-12-17 08:47:20 root: INFO: timing SparkBackend.parse_value_ir total 0.330ms self 0.330ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: RegionPool: initialized for thread 240: Thread-44 2021-12-17 08:47:20 root: INFO: starting execution of query hail_query_12 of initial size 3 2021-12-17 08:47:20 root: INFO: optimize optimize: relationalLowerer, initial IR: before: IR size 3: (TableCount (MatrixColsTable (MatrixRead None False False {\"files\":[\"/Users/jeji/ASD_pQTL/SNUBH_ASD_210210.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"minPartitions\":24,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":false,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"}))) 2021-12-17 08:47:20 root: INFO: optimize optimize: relationalLowerer, initial IR: after: IR size 1: (I64 140) 2021-12-17 08:47:20 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: before: IR size 1: (I64 140) 2021-12-17 08:47:20 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: after: IR size 1: (I64 140) 2021-12-17 08:47:20 root: INFO: optimize optimize: relationalLowerer, after InterpretNonCompilable: before: IR size 1: (I64 140) 2021-12-17 08:47:20 root: INFO: optimize optimize: relationalLowerer, after InterpretNonCompilable: after: IR size 1: (I64 140) 2021-12-17 08:47:20 root: INFO: encoder cache hit 2021-12-17 08:47:20 root: INFO: finished execution of query hail_query_12 2021-12-17 08:47:20 root: INFO: RegionPool: FREE: 128.0K allocated (128.0K blocks / 0 chunks), regions.size = 2, 0 current java objects, thread 240: Thread-44 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode total 3.661ms self 1.205ms children 2.456ms %children 67.08% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR total 1.863ms self 0.009ms children 1.854ms %children 99.51% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/Verify total 0.002ms self 0.002ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation total 1.850ms self 0.674ms children 1.176ms %children 63.57% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize total 1.176ms self 0.011ms children 1.166ms %children 99.09% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/FoldConstants total 0.092ms self 0.092ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.154ms self 0.154ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/Simplify total 0.468ms self 0.468ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardLets total 0.118ms self 0.118ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.026ms self 0.026ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/PruneDeadFields total 0.243ms self 0.243ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/FoldConstants total 0.009ms self 0.009ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.003ms self 0.003ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/Simplify total 0.005ms self 0.005ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardLets total 0.028ms self 0.028ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/ForwardRelationalLets total 0.007ms self 0.007ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/LoweringTransformation/Optimize/PruneDeadFields total 0.012ms self 0.012ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, initial IR/Verify total 0.001ms self 0.001ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/LowerMatrixToTable total 0.057ms self 0.002ms children 0.055ms %children 96.07% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/LowerMatrixToTable/Verify total 0.001ms self 0.001ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/LowerMatrixToTable/LoweringTransformation total 0.053ms self 0.053ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/LowerMatrixToTable/Verify total 0.001ms self 0.001ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after LowerMatrixToTable total 0.122ms self 0.002ms children 0.120ms %children 98.25% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after LowerMatrixToTable/Verify total 0.000ms self 0.000ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation total 0.119ms self 0.058ms children 0.061ms %children 51.52% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize total 0.061ms self 0.004ms children 0.058ms %children 93.64% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/FoldConstants total 0.006ms self 0.006ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.003ms self 0.003ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/Simplify total 0.005ms self 0.005ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ForwardLets total 0.026ms self 0.026ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/ForwardRelationalLets total 0.007ms self 0.007ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after LowerMatrixToTable/LoweringTransformation/Optimize/PruneDeadFields total 0.011ms self 0.011ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after LowerMatrixToTable/Verify total 0.001ms self 0.001ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/LiftRelationalValuesToRelationalLets total 0.028ms self 0.002ms children 0.027ms %children 94.38% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/LiftRelationalValuesToRelationalLets/Verify total 0.001ms self 0.001ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/LiftRelationalValuesToRelationalLets/LoweringTransformation total 0.026ms self 0.026ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/LiftRelationalValuesToRelationalLets/Verify total 0.000ms self 0.000ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/LowerOrInterpretNonCompilable total 0.026ms self 0.001ms children 0.025ms %children 95.17% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/LowerOrInterpretNonCompilable/Verify total 0.000ms self 0.000ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/LowerOrInterpretNonCompilable/LoweringTransformation total 0.004ms self 0.004ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/LowerOrInterpretNonCompilable/Verify total 0.021ms self 0.021ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after InterpretNonCompilable total 0.169ms self 0.002ms children 0.167ms %children 98.76% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after InterpretNonCompilable/Verify total 0.000ms self 0.000ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation total 0.166ms self 0.091ms children 0.075ms %children 45.19% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize total 0.075ms self 0.005ms children 0.070ms %children 93.66% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/FoldConstants total 0.007ms self 0.007ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ExtractIntervalFilters total 0.004ms self 0.004ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/Simplify total 0.005ms self 0.005ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ForwardLets total 0.033ms self 0.033ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/ForwardRelationalLets total 0.008ms self 0.008ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after InterpretNonCompilable/LoweringTransformation/Optimize/PruneDeadFields total 0.013ms self 0.013ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/optimize: relationalLowerer, after InterpretNonCompilable/Verify total 0.001ms self 0.001ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/Compile total 0.167ms self 0.167ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/InitializeCompiledFunction total 0.022ms self 0.022ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: timing SparkBackend.executeEncode/RunCompiledFunction total 0.001ms self 0.001ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: RegionPool: initialized for thread 240: Thread-44 2021-12-17 08:47:20 root: INFO: RegionPool: FREE: 64.0K allocated (64.0K blocks / 0 chunks), regions.size = 1, 0 current java objects, thread 240: Thread-44 2021-12-17 08:47:20 root: INFO: timing SparkBackend.parse_value_ir total 1.165ms self 1.165ms children 0.000ms %children 0.00% 2021-12-17 08:47:20 root: INFO: RegionPool: initialized for thread 240: Thread-44 2021-12-17 08:47:20 root: INFO: starting execution of query hail_query_13 of initial size 29 2021-12-17 08:47:20 root: INFO: optimize optimize: relationalLowerer, initial IR: before: IR size 29: (MakeTuple (0) (ToArray (StreamMap __uid_10 (ToStream False (GetField rows (TableCollect (TableHead 0 (TableMapRows (MatrixColsTable (MatrixMapCols () (MatrixMapGlobals (MatrixMapCols None (MatrixRead None False False {\"files\":[\"/Users/jeji/ASD_pQTL/SNUBH_ASD_210210.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"minPartitions\":24,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":false,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"}) (InsertFields (SelectFields (s) (SelectFields (s) (Ref sa))) None)) (InsertFields (SelectFields () (SelectFields () (Ref global))) None)) (SelectFields (s) (Ref sa)))) (InsertFields (SelectFields (s) (SelectFields (s) (Ref row))) None)))))) (GetField s (Ref __uid_10))))) 2021-12-17 08:47:20 root: INFO: optimize optimize: relationalLowerer, initial IR: after: IR size 13: (MakeTuple (0) (ToArray (StreamMap __iruid_1421 (ToStream False (GetField rows (TableCollect (MatrixColsTable (MatrixMapCols () (MatrixColsHead 0 (MatrixRead Matrix{global:Struct{},col_key:[s],col:Struct{s:String},row_key:[[locus,alleles]],row:Struct{locus:Locus(GRCh38),alleles:Array[String]},entry:Struct{}} False False {\"files\":[\"/Users/jeji/ASD_pQTL/SNUBH_ASD_210210.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"minPartitions\":24,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":false,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"})) (Ref sa)))))) (GetField s (Ref __iruid_1421))))) 2021-12-17 08:47:20 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: before: IR size 57: (MakeTuple (0) (ToArray (StreamMap __iruid_1421 (ToStream False (GetField rows (TableCollect (TableKeyBy () False (TableParallelize None (Let __cols_and_globals (TableGetGlobals (TableMapGlobals (TableMapRows (TableMapGlobals (TableRead Table{global:Struct{__cols:Array[Struct{s:String}]},key:[locus,alleles],row:Struct{locus:Locus(GRCh38),alleles:Array[String],`the entries! [877f12a8827e18f61222c6c8c5fb04a8]`:Array[Struct{}]}} False {\"files\":[\"/Users/jeji/ASD_pQTL/SNUBH_ASD_210210.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"minPartitions\":24,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":false,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"}) (InsertFields (Ref global) None (__cols (ArraySlice (GetField __cols (Ref global)) (I32 0) (I32 0) (I32 1))))) (InsertFields (Ref row) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (ArraySlice (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row)) (I32 0) (I32 0) (I32 1))))) (InsertFields (Ref global) None (__cols (ToArray (StreamMap __iruid_1422 (ToStream False (ToArray (StreamRange -1 False (I32 0) (ArrayLen (GetField __cols (Ref global))) (I32 1)))) (Let __cols_array (GetField __cols (Ref global)) (Let sa (ArrayRef -1 (Ref __cols_array) (Ref __iruid_1422)) (Ref sa))))))))) (MakeStruct (rows (GetField __cols (Ref __cols_and_globals))) (global (SelectFields () (Ref __cols_and_globals)))))))))) (GetField s (Ref __iruid_1421))))) 2021-12-17 08:47:20 root: INFO: Prune: MakeStruct: eliminating field 'global' 2021-12-17 08:47:20 root: INFO: optimize optimize: relationalLowerer, after LowerMatrixToTable: after: IR size 26: (MakeTuple (0) (ToArray (StreamMap __iruid_1444 (ToStream False (GetField rows (Let __iruid_1445 (ArraySlice (GetField __cols (TableGetGlobals (TableRead Table{global:Struct{__cols:Array[Struct{s:String}]},key:[locus,alleles],row:Struct{locus:Locus(GRCh38),alleles:Array[String]}} False {\"files\":[\"/Users/jeji/ASD_pQTL/SNUBH_ASD_210210.vcf.gz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"minPartitions\":24,\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":false,\"gzAsBGZ\":true,\"forceGZ\":false,\"filterAndReplace\":{},\"partitionsJSON\":null,\"name\":\"MatrixVCFReader\"}))) (I32 0) (I32 0) (I32 1)) (MakeStruct (rows (ToArray (StreamMap __iruid_1446 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_1445)) (I32 1)) (ArrayRef -1 (Ref __iruid_1445) (Ref __iruid_1446))))))))) (GetField s (Ref __iruid_1444))))) 2021-12-17 08:47:20 root: INFO: LowerOrInterpretNonCompilable: whole stage code generation is a go! 2021-12-17 08:47:20 root: INFO: lowering result: TableGetGlobals 2021-12-17 08:47:20 root: INFO: optimize optimize: compileLowerer, initial IR: before: IR size 167: (Let sortedPartData (ArraySort __iruid_1452 __iruid_1453 (Let __iruid_1448 (CollectDistributedArray context globals (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (MakeStruct) (StreamAgg x (StreamAggScan key (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref context)) (MakeStruct (key (Ref key)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (ApplyScanOp PrevNonnull () ((Ref key)))))) (Let n (ApplyAggOp Count () ()) (AggLet key False (GetField key (Ref x)) (MakeStruct (n (Ref n)) (minkey (ApplyAggOp TakeBy ((I32 1)) ((Ref key) (Ref key)))) (maxkey (ApplyAggOp TakeBy ((I32 1)) ((Ref key) (Ref key)))) (ksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref x))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref x)) (GetField key (Ref x))))))) (Ref n))) (pksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields (locus) (GetField prevkey (Ref x)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref x))) (SelectFields (locus) (GetField key (Ref x)))))))) (Ref n))) (sample (ApplyAggOp TakeBy ((I32 20)) ((GetField key (Ref x)) (GetField token (Ref x)))))))))) (StreamMap __iruid_1451 (StreamFilter __iruid_1450 (StreamMap __iruid_1449 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_1448)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_1448) (Ref __iruid_1449)) None (i (Ref __iruid_1449)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_1450))) (I32 0))) (InsertFields (Ref __iruid_1451) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_1451)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_1451)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_1452)) (SelectFields (minkey maxkey) (Ref __iruid_1453)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold acc partDataWithIndex (ToStream False (Ref sortedPartData)) (True) (ApplySpecial -1 land () Boolean (Ref acc) (GetField ksorted (Ref partDataWithIndex)))) (StreamFold acc i (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref sortedPartData)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref acc) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref sortedPartData) (Ref i))) (GetField minkey (ArrayRef -1 (Ref sortedPartData) (ApplyBinaryPrimOp Add (Ref i) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold acc partDataWithIndex (ToStream False (Ref sortedPartData)) (True) (ApplySpecial -1 land () Boolean (Ref acc) (GetField pksorted (Ref partDataWithIndex)))) (StreamFold acc i (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref sortedPartData)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref acc) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref sortedPartData) (Ref i)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref sortedPartData) (ApplyBinaryPrimOp Add (Ref i) (I32 1)))))))))) (sortedPartData (Ref sortedPartData)))) 2021-12-17 08:47:20 root: INFO: optimize optimize: compileLowerer, initial IR: after: IR size 167: (Let __iruid_1496 (ArraySort __iruid_1497 __iruid_1498 (Let __iruid_1499 (CollectDistributedArray __iruid_1500 __iruid_1501 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (StreamAgg __iruid_1502 (StreamAggScan __iruid_1503 (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_1500)) (MakeStruct (key (Ref __iruid_1503)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (ApplyScanOp PrevNonnull () ((Ref __iruid_1503)))))) (Let __iruid_1504 (ApplyAggOp Count () ()) (AggLet __iruid_1505 False (GetField key (Ref __iruid_1502)) (MakeStruct (n (Ref __iruid_1504)) (minkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_1505) (Ref __iruid_1505)))) (maxkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_1505) (Ref __iruid_1505)))) (ksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_1502))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_1502)) (GetField key (Ref __iruid_1502))))))) (Ref __iruid_1504))) (pksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_1502)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_1502))) (SelectFields (locus) (GetField key (Ref __iruid_1502)))))))) (Ref __iruid_1504))) (sample (ApplyAggOp TakeBy ((I32 20)) ((GetField key (Ref __iruid_1502)) (GetField token (Ref __iruid_1502)))))))))) (StreamMap __iruid_1506 (StreamFilter __iruid_1507 (StreamMap __iruid_1508 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_1499)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_1499) (Ref __iruid_1508)) None (i (Ref __iruid_1508)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_1507))) (I32 0))) (InsertFields (Ref __iruid_1506) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_1506)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_1506)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_1497)) (SelectFields (minkey maxkey) (Ref __iruid_1498)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_1509 __iruid_1510 (ToStream False (Ref __iruid_1496)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1509) (GetField ksorted (Ref __iruid_1510)))) (StreamFold __iruid_1511 __iruid_1512 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_1496)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1511) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_1496) (Ref __iruid_1512))) (GetField minkey (ArrayRef -1 (Ref __iruid_1496) (ApplyBinaryPrimOp Add (Ref __iruid_1512) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_1513 __iruid_1514 (ToStream False (Ref __iruid_1496)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1513) (GetField pksorted (Ref __iruid_1514)))) (StreamFold __iruid_1515 __iruid_1516 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_1496)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1515) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_1496) (Ref __iruid_1516)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_1496) (ApplyBinaryPrimOp Add (Ref __iruid_1516) (I32 1)))))))))) (sortedPartData (Ref __iruid_1496)))) 2021-12-17 08:47:20 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: before: IR size 167: (Let __iruid_1496 (ArraySort __iruid_1497 __iruid_1498 (Let __iruid_1499 (CollectDistributedArray __iruid_1500 __iruid_1501 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (StreamAgg __iruid_1502 (StreamAggScan __iruid_1503 (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_1500)) (MakeStruct (key (Ref __iruid_1503)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (ApplyScanOp PrevNonnull () ((Ref __iruid_1503)))))) (Let __iruid_1504 (ApplyAggOp Count () ()) (AggLet __iruid_1505 False (GetField key (Ref __iruid_1502)) (MakeStruct (n (Ref __iruid_1504)) (minkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_1505) (Ref __iruid_1505)))) (maxkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_1505) (Ref __iruid_1505)))) (ksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_1502))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_1502)) (GetField key (Ref __iruid_1502))))))) (Ref __iruid_1504))) (pksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_1502)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_1502))) (SelectFields (locus) (GetField key (Ref __iruid_1502)))))))) (Ref __iruid_1504))) (sample (ApplyAggOp TakeBy ((I32 20)) ((GetField key (Ref __iruid_1502)) (GetField token (Ref __iruid_1502)))))))))) (StreamMap __iruid_1506 (StreamFilter __iruid_1507 (StreamMap __iruid_1508 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_1499)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_1499) (Ref __iruid_1508)) None (i (Ref __iruid_1508)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_1507))) (I32 0))) (InsertFields (Ref __iruid_1506) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_1506)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_1506)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_1497)) (SelectFields (minkey maxkey) (Ref __iruid_1498)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_1509 __iruid_1510 (ToStream False (Ref __iruid_1496)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1509) (GetField ksorted (Ref __iruid_1510)))) (StreamFold __iruid_1511 __iruid_1512 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_1496)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1511) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_1496) (Ref __iruid_1512))) (GetField minkey (ArrayRef -1 (Ref __iruid_1496) (ApplyBinaryPrimOp Add (Ref __iruid_1512) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_1513 __iruid_1514 (ToStream False (Ref __iruid_1496)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1513) (GetField pksorted (Ref __iruid_1514)))) (StreamFold __iruid_1515 __iruid_1516 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_1496)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1515) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_1496) (Ref __iruid_1516)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_1496) (ApplyBinaryPrimOp Add (Ref __iruid_1516) (I32 1)))))))))) (sortedPartData (Ref __iruid_1496)))) 2021-12-17 08:47:20 root: INFO: optimize optimize: compileLowerer, after InlineApplyIR: after: IR size 167: (Let __iruid_1559 (ArraySort __iruid_1560 __iruid_1561 (Let __iruid_1562 (CollectDistributedArray __iruid_1563 __iruid_1564 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (StreamAgg __iruid_1565 (StreamAggScan __iruid_1566 (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_1563)) (MakeStruct (key (Ref __iruid_1566)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (ApplyScanOp PrevNonnull () ((Ref __iruid_1566)))))) (Let __iruid_1567 (ApplyAggOp Count () ()) (AggLet __iruid_1568 False (GetField key (Ref __iruid_1565)) (MakeStruct (n (Ref __iruid_1567)) (minkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_1568) (Ref __iruid_1568)))) (maxkey (ApplyAggOp TakeBy ((I32 1)) ((Ref __iruid_1568) (Ref __iruid_1568)))) (ksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_1565))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_1565)) (GetField key (Ref __iruid_1565))))))) (Ref __iruid_1567))) (pksorted (ApplyComparisonOp EQ (ApplyAggOp Sum () ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_1565)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_1565))) (SelectFields (locus) (GetField key (Ref __iruid_1565)))))))) (Ref __iruid_1567))) (sample (ApplyAggOp TakeBy ((I32 20)) ((GetField key (Ref __iruid_1565)) (GetField token (Ref __iruid_1565)))))))))) (StreamMap __iruid_1569 (StreamFilter __iruid_1570 (StreamMap __iruid_1571 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_1562)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_1562) (Ref __iruid_1571)) None (i (Ref __iruid_1571)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_1570))) (I32 0))) (InsertFields (Ref __iruid_1569) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_1569)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_1569)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_1560)) (SelectFields (minkey maxkey) (Ref __iruid_1561)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_1572 __iruid_1573 (ToStream False (Ref __iruid_1559)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1572) (GetField ksorted (Ref __iruid_1573)))) (StreamFold __iruid_1574 __iruid_1575 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_1559)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1574) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_1559) (Ref __iruid_1575))) (GetField minkey (ArrayRef -1 (Ref __iruid_1559) (ApplyBinaryPrimOp Add (Ref __iruid_1575) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_1576 __iruid_1577 (ToStream False (Ref __iruid_1559)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1576) (GetField pksorted (Ref __iruid_1577)))) (StreamFold __iruid_1578 __iruid_1579 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_1559)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1578) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_1559) (Ref __iruid_1579)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_1559) (ApplyBinaryPrimOp Add (Ref __iruid_1579) (I32 1)))))))))) (sortedPartData (Ref __iruid_1559)))) 2021-12-17 08:47:20 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: before: IR size 205: (Let __iruid_1559 (ArraySort __iruid_1560 __iruid_1561 (Let __iruid_1562 (CollectDistributedArray __iruid_1563 __iruid_1564 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (Let __iruid_1581 (RunAgg ((TypedStateSig +PInt64) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}) (TypedStateSig +PInt64) (TypedStateSig +PInt64) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) (Begin (Begin (InitOp 0 (Count (TypedStateSig +PInt64)) ()) (InitOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((I32 1))) (InitOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((I32 1))) (InitOp 3 (Sum (TypedStateSig +PInt64)) ()) (InitOp 4 (Sum (TypedStateSig +PInt64)) ()) (InitOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) ((I32 20)))) (StreamFor __iruid_1565 (RunAggScan __iruid_1566 ( (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_1563)) (Begin (InitOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ())) (Begin (SeqOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_1566)))) (Let __iruid_1580 (MakeTuple (0) (ResultOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})))) (MakeStruct (key (Ref __iruid_1566)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (GetTupleElement 0 (Ref __iruid_1580)))))) (Let __iruid_1568 (GetField key (Ref __iruid_1565)) (Begin (SeqOp 0 (Count (TypedStateSig +PInt64)) ()) (SeqOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_1568) (Ref __iruid_1568))) (SeqOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_1568) (Ref __iruid_1568))) (SeqOp 3 (Sum (TypedStateSig +PInt64)) ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_1565))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_1565)) (GetField key (Ref __iruid_1565))))))) (SeqOp 4 (Sum (TypedStateSig +PInt64)) ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_1565)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_1565))) (SelectFields (locus) (GetField key (Ref __iruid_1565)))))))) (SeqOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) ((GetField key (Ref __iruid_1565)) (GetField token (Ref __iruid_1565)))))))) (MakeTuple (0 1 2 3 4 5) (ResultOp 0 (Count (TypedStateSig +PInt64))) (ResultOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}))) (ResultOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}))) (ResultOp 3 (Sum (TypedStateSig +PInt64))) (ResultOp 4 (Sum (TypedStateSig +PInt64))) (ResultOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64))))) (Let __iruid_1567 (GetTupleElement 0 (Ref __iruid_1581)) (MakeStruct (n (Ref __iruid_1567)) (minkey (GetTupleElement 1 (Ref __iruid_1581))) (maxkey (GetTupleElement 2 (Ref __iruid_1581))) (ksorted (ApplyComparisonOp EQ (GetTupleElement 3 (Ref __iruid_1581)) (Ref __iruid_1567))) (pksorted (ApplyComparisonOp EQ (GetTupleElement 4 (Ref __iruid_1581)) (Ref __iruid_1567))) (sample (GetTupleElement 5 (Ref __iruid_1581))))))) (StreamMap __iruid_1569 (StreamFilter __iruid_1570 (StreamMap __iruid_1571 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_1562)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_1562) (Ref __iruid_1571)) None (i (Ref __iruid_1571)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_1570))) (I32 0))) (InsertFields (Ref __iruid_1569) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_1569)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_1569)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_1560)) (SelectFields (minkey maxkey) (Ref __iruid_1561)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_1572 __iruid_1573 (ToStream False (Ref __iruid_1559)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1572) (GetField ksorted (Ref __iruid_1573)))) (StreamFold __iruid_1574 __iruid_1575 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_1559)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1574) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_1559) (Ref __iruid_1575))) (GetField minkey (ArrayRef -1 (Ref __iruid_1559) (ApplyBinaryPrimOp Add (Ref __iruid_1575) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_1576 __iruid_1577 (ToStream False (Ref __iruid_1559)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1576) (GetField pksorted (Ref __iruid_1577)))) (StreamFold __iruid_1578 __iruid_1579 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_1559)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1578) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_1559) (Ref __iruid_1579)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_1559) (ApplyBinaryPrimOp Add (Ref __iruid_1579) (I32 1)))))))))) (sortedPartData (Ref __iruid_1559)))) 2021-12-17 08:47:20 root: INFO: optimize optimize: compileLowerer, after LowerArrayAggsToRunAggs: after: IR size 205: (Let __iruid_1628 (ArraySort __iruid_1629 __iruid_1630 (Let __iruid_1631 (CollectDistributedArray __iruid_1632 __iruid_1633 (ToStream False (Literal Array[Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}] )) (Literal Struct{} ) (Let __iruid_1634 (RunAgg ((TypedStateSig +PInt64) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}) (TypedStateSig +PInt64) (TypedStateSig +PInt64) (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) (Begin (Begin (InitOp 0 (Count (TypedStateSig +PInt64)) ()) (InitOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((I32 1))) (InitOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((I32 1))) (InitOp 3 (Sum (TypedStateSig +PInt64)) ()) (InitOp 4 (Sum (TypedStateSig +PInt64)) ()) (InitOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) ((I32 20)))) (StreamFor __iruid_1635 (RunAggScan __iruid_1636 ( (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) (ReadPartition Struct{locus:Locus(GRCh38),alleles:Array[String]} "{\"category\":\"PartitionIteratorLongReader\",\"fullRowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"contextType\":\"Struct{index:Int32,file:String,start:Int64,end:Int64,split:Boolean}\"}" (Ref __iruid_1632)) (Begin (InitOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ())) (Begin (SeqOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_1636)))) (Let __iruid_1637 (MakeTuple (0) (ResultOp 0 (PrevNonnull (TypedStateSig PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})))) (MakeStruct (key (Ref __iruid_1636)) (token (ApplySeeded rand_unif 1 Float64 (F64 0.0) (F64 1.0))) (prevkey (GetTupleElement 0 (Ref __iruid_1637)))))) (Let __iruid_1638 (GetField key (Ref __iruid_1635)) (Begin (SeqOp 0 (Count (TypedStateSig +PInt64)) ()) (SeqOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_1638) (Ref __iruid_1638))) (SeqOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]})) ((Ref __iruid_1638) (Ref __iruid_1638))) (SeqOp 3 (Sum (TypedStateSig +PInt64)) ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (GetField prevkey (Ref __iruid_1635))) (ApplyComparisonOp LTEQ (GetField prevkey (Ref __iruid_1635)) (GetField key (Ref __iruid_1635))))))) (SeqOp 4 (Sum (TypedStateSig +PInt64)) ((Apply -1 toInt64 () Int64 (ApplySpecial -1 lor () Boolean (IsNA (SelectFields () (GetField prevkey (Ref __iruid_1635)))) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField prevkey (Ref __iruid_1635))) (SelectFields (locus) (GetField key (Ref __iruid_1635)))))))) (SeqOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64)) ((GetField key (Ref __iruid_1635)) (GetField token (Ref __iruid_1635)))))))) (MakeTuple (0 1 2 3 4 5) (ResultOp 0 (Count (TypedStateSig +PInt64))) (ResultOp 1 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}))) (ResultOp 2 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]}))) (ResultOp 3 (Sum (TypedStateSig +PInt64))) (ResultOp 4 (Sum (TypedStateSig +PInt64))) (ResultOp 5 (TakeBy (TakeByStateSig +PCStruct{locus:+PCLocus(GRCh38),alleles:+PCArray[+PCString]} +PFloat64))))) (Let __iruid_1639 (GetTupleElement 0 (Ref __iruid_1634)) (MakeStruct (n (Ref __iruid_1639)) (minkey (GetTupleElement 1 (Ref __iruid_1634))) (maxkey (GetTupleElement 2 (Ref __iruid_1634))) (ksorted (ApplyComparisonOp EQ (GetTupleElement 3 (Ref __iruid_1634)) (Ref __iruid_1639))) (pksorted (ApplyComparisonOp EQ (GetTupleElement 4 (Ref __iruid_1634)) (Ref __iruid_1639))) (sample (GetTupleElement 5 (Ref __iruid_1634))))))) (StreamMap __iruid_1640 (StreamFilter __iruid_1641 (StreamMap __iruid_1642 (StreamRange -1 False (I32 0) (ArrayLen (Ref __iruid_1631)) (I32 1)) (InsertFields (ArrayRef -1 (Ref __iruid_1631) (Ref __iruid_1642)) None (i (Ref __iruid_1642)))) (ApplyComparisonOp GT (ArrayLen (GetField minkey (Ref __iruid_1641))) (I32 0))) (InsertFields (Ref __iruid_1640) None (minkey (ArrayRef -1 (GetField minkey (Ref __iruid_1640)) (I32 0))) (maxkey (ArrayRef -1 (GetField maxkey (Ref __iruid_1640)) (I32 0)))))) (ApplyComparisonOp LT (SelectFields (minkey maxkey) (Ref __iruid_1629)) (SelectFields (minkey maxkey) (Ref __iruid_1630)))) (MakeStruct (ksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_1643 __iruid_1644 (ToStream False (Ref __iruid_1628)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1643) (GetField ksorted (Ref __iruid_1644)))) (StreamFold __iruid_1645 __iruid_1646 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_1628)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1645) (ApplyComparisonOp LTEQ (GetField maxkey (ArrayRef -1 (Ref __iruid_1628) (Ref __iruid_1646))) (GetField minkey (ArrayRef -1 (Ref __iruid_1628) (ApplyBinaryPrimOp Add (Ref __iruid_1646) (I32 1))))))))) (pksorted (ApplySpecial -1 land () Boolean (StreamFold __iruid_1647 __iruid_1648 (ToStream False (Ref __iruid_1628)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1647) (GetField pksorted (Ref __iruid_1648)))) (StreamFold __iruid_1649 __iruid_1650 (StreamRange -1 False (I32 0) (ApplyBinaryPrimOp Subtract (ArrayLen (Ref __iruid_1628)) (I32 1)) (I32 1)) (True) (ApplySpecial -1 land () Boolean (Ref __iruid_1649) (ApplyComparisonOp LTEQ (SelectFields (locus) (GetField maxkey (ArrayRef -1 (Ref __iruid_1628) (Ref __iruid_1650)))) (SelectFields (locus) (GetField minkey (ArrayRef -1 (Ref __iruid_1628) (ApplyBinaryPrimOp Add (Ref __iruid_1650) (I32 1)))))))))) (sortedPartData (Ref __iruid_1628)))) 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2682FSContainer. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2682FSContainer. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2683collect_distributed_array. 2021-12-17 08:47:20 root: INFO: instruction count: 150: __C2683collect_distributed_array.apply 2021-12-17 08:47:20 root: INFO: instruction count: 17: __C2683collect_distributed_array.apply 2021-12-17 08:47:20 root: INFO: instruction count: 27: __C2683collect_distributed_array.__m2684DECODE_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND_TO_SBaseStructPointer 2021-12-17 08:47:20 root: INFO: instruction count: 53: __C2683collect_distributed_array.__m2685INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2021-12-17 08:47:20 root: INFO: instruction count: 10: __C2683collect_distributed_array.__m2686INPLACE_DECODE_r_int32_TO_r_int32 2021-12-17 08:47:20 root: INFO: instruction count: 31: __C2683collect_distributed_array.__m2687INPLACE_DECODE_r_binary_TO_r_string 2021-12-17 08:47:20 root: INFO: instruction count: 10: __C2683collect_distributed_array.__m2688INPLACE_DECODE_r_int64_TO_r_int64 2021-12-17 08:47:20 root: INFO: instruction count: 10: __C2683collect_distributed_array.__m2689INPLACE_DECODE_r_bool_TO_r_bool 2021-12-17 08:47:20 root: INFO: instruction count: 27: __C2683collect_distributed_array.__m2691DECODE_r_struct_of_r_struct_of_ENDEND_TO_SBaseStructPointer 2021-12-17 08:47:20 root: INFO: instruction count: 8: __C2683collect_distributed_array.__m2692INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2021-12-17 08:47:20 root: INFO: instruction count: 365: __C2683collect_distributed_array.__m2694split_Let 2021-12-17 08:47:20 root: INFO: instruction count: 17: __C2683collect_distributed_array.__m2712i_gt_j 2021-12-17 08:47:20 root: INFO: instruction count: 71: __C2683collect_distributed_array.__m2713ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2683collect_distributed_array.__m2714ord_compare 2021-12-17 08:47:20 root: INFO: instruction count: 235: __C2683collect_distributed_array.__m2715ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 15: __C2683collect_distributed_array.__m2716ord_compare 2021-12-17 08:47:20 root: INFO: instruction count: 74: __C2683collect_distributed_array.__m2717ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 9: __C2683collect_distributed_array.__m2719ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 89: __C2683collect_distributed_array.__m2720ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 15: __C2683collect_distributed_array.__m2721ord_compare 2021-12-17 08:47:20 root: INFO: instruction count: 82: __C2683collect_distributed_array.__m2722ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2683collect_distributed_array.__m2723ord_compare 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2683collect_distributed_array.__m2724ord_compare 2021-12-17 08:47:20 root: INFO: instruction count: 8: __C2683collect_distributed_array.__m2725ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 18: __C2683collect_distributed_array.__m2726swap 2021-12-17 08:47:20 root: INFO: instruction count: 74: __C2683collect_distributed_array.__m2727rebalance_up 2021-12-17 08:47:20 root: INFO: instruction count: 150: __C2683collect_distributed_array.__m2728rebalance_down 2021-12-17 08:47:20 root: INFO: instruction count: 17: __C2683collect_distributed_array.__m2741i_gt_j 2021-12-17 08:47:20 root: INFO: instruction count: 18: __C2683collect_distributed_array.__m2742swap 2021-12-17 08:47:20 root: INFO: instruction count: 74: __C2683collect_distributed_array.__m2743rebalance_up 2021-12-17 08:47:20 root: INFO: instruction count: 150: __C2683collect_distributed_array.__m2744rebalance_down 2021-12-17 08:47:20 root: INFO: instruction count: 17: __C2683collect_distributed_array.__m2759i_gt_j 2021-12-17 08:47:20 root: INFO: instruction count: 79: __C2683collect_distributed_array.__m2760ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2683collect_distributed_array.__m2761ord_compare 2021-12-17 08:47:20 root: INFO: instruction count: 8: __C2683collect_distributed_array.__m2762ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 18: __C2683collect_distributed_array.__m2763swap 2021-12-17 08:47:20 root: INFO: instruction count: 74: __C2683collect_distributed_array.__m2764rebalance_up 2021-12-17 08:47:20 root: INFO: instruction count: 150: __C2683collect_distributed_array.__m2765rebalance_down 2021-12-17 08:47:20 root: INFO: instruction count: 9: __C2683collect_distributed_array.__m2766begin_group_0 2021-12-17 08:47:20 root: INFO: instruction count: 403: __C2683collect_distributed_array.__m2767begin_group_0 2021-12-17 08:47:20 root: INFO: instruction count: 204: __C2683collect_distributed_array.__m2768split_StreamFor 2021-12-17 08:47:20 root: INFO: instruction count: 12: __C2683collect_distributed_array.__m2776setup_null 2021-12-17 08:47:20 root: INFO: instruction count: 216: __C2683collect_distributed_array.__m2788begin_group_0 2021-12-17 08:47:20 root: INFO: instruction count: 18: __C2683collect_distributed_array.__m2789begin_group_0 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2683collect_distributed_array.setObjects 2021-12-17 08:47:20 root: INFO: instruction count: 5: __C2683collect_distributed_array.__m2796split_Begin 2021-12-17 08:47:20 root: INFO: instruction count: 267: __C2683collect_distributed_array.__m2798begin_group_0 2021-12-17 08:47:20 root: INFO: instruction count: 827: __C2683collect_distributed_array.__m2799take_by_seqop 2021-12-17 08:47:20 root: INFO: instruction count: 120: __C2683collect_distributed_array.__m2801take_by_garbage_collect 2021-12-17 08:47:20 root: INFO: instruction count: 827: __C2683collect_distributed_array.__m2802take_by_seqop 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2683collect_distributed_array.__m2804ord_compare 2021-12-17 08:47:20 root: INFO: instruction count: 235: __C2683collect_distributed_array.__m2805ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 120: __C2683collect_distributed_array.__m2806take_by_garbage_collect 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2683collect_distributed_array.__m2807ord_lteq 2021-12-17 08:47:20 root: INFO: instruction count: 320: __C2683collect_distributed_array.__m2808ord_lteqNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 15: __C2683collect_distributed_array.__m2809ord_lteq 2021-12-17 08:47:20 root: INFO: instruction count: 25: __C2683collect_distributed_array.__m2810ord_lteqNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 15: __C2683collect_distributed_array.__m2811ord_equiv 2021-12-17 08:47:20 root: INFO: instruction count: 25: __C2683collect_distributed_array.__m2812ord_equivNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 15: __C2683collect_distributed_array.__m2813ord_lteq 2021-12-17 08:47:20 root: INFO: instruction count: 99: __C2683collect_distributed_array.__m2814ord_lteqNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2683collect_distributed_array.__m2815ord_lteq 2021-12-17 08:47:20 root: INFO: instruction count: 21: __C2683collect_distributed_array.__m2816ord_lteqNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2683collect_distributed_array.__m2817ord_equiv 2021-12-17 08:47:20 root: INFO: instruction count: 21: __C2683collect_distributed_array.__m2818ord_equivNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 15: __C2683collect_distributed_array.__m2819ord_equiv 2021-12-17 08:47:20 root: INFO: instruction count: 81: __C2683collect_distributed_array.__m2820ord_equivNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 5: __C2683collect_distributed_array.__m2821toInt64 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2683collect_distributed_array.__m2824ord_lteq 2021-12-17 08:47:20 root: INFO: instruction count: 180: __C2683collect_distributed_array.__m2825ord_lteqNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 370: __C2683collect_distributed_array.__m2828take_by_seqop 2021-12-17 08:47:20 root: INFO: instruction count: 390: __C2683collect_distributed_array.__m2830take_by_garbage_collect 2021-12-17 08:47:20 root: INFO: instruction count: 355: __C2683collect_distributed_array.__m2831take_by_result 2021-12-17 08:47:20 root: INFO: instruction count: 28: __C2683collect_distributed_array.__m2832result_quicksort 2021-12-17 08:47:20 root: INFO: instruction count: 19: __C2683collect_distributed_array.__m2833quicksort_swap 2021-12-17 08:47:20 root: INFO: instruction count: 193: __C2683collect_distributed_array.__m2834quicksort_partition 2021-12-17 08:47:20 root: INFO: instruction count: 355: __C2683collect_distributed_array.__m2835take_by_result 2021-12-17 08:47:20 root: INFO: instruction count: 28: __C2683collect_distributed_array.__m2836result_quicksort 2021-12-17 08:47:20 root: INFO: instruction count: 19: __C2683collect_distributed_array.__m2837quicksort_swap 2021-12-17 08:47:20 root: INFO: instruction count: 193: __C2683collect_distributed_array.__m2838quicksort_partition 2021-12-17 08:47:20 root: INFO: instruction count: 355: __C2683collect_distributed_array.__m2839take_by_result 2021-12-17 08:47:20 root: INFO: instruction count: 28: __C2683collect_distributed_array.__m2840result_quicksort 2021-12-17 08:47:20 root: INFO: instruction count: 19: __C2683collect_distributed_array.__m2841quicksort_swap 2021-12-17 08:47:20 root: INFO: instruction count: 193: __C2683collect_distributed_array.__m2842quicksort_partition 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2683collect_distributed_array.__m2868ord_equiv 2021-12-17 08:47:20 root: INFO: instruction count: 16: __C2683collect_distributed_array.__m2869ord_equivNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 9: __C2683collect_distributed_array.__m2882ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDENDEND 2021-12-17 08:47:20 root: INFO: instruction count: 109: __C2683collect_distributed_array.__m2883ENCODE_SBaseStructPointer_TO_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDEND 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2683collect_distributed_array.__m2884ENCODE_SInt64$_TO_r_int64 2021-12-17 08:47:20 root: INFO: instruction count: 35: __C2683collect_distributed_array.__m2885ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND 2021-12-17 08:47:20 root: INFO: instruction count: 51: __C2683collect_distributed_array.__m2886ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND 2021-12-17 08:47:20 root: INFO: instruction count: 25: __C2683collect_distributed_array.__m2887ENCODE_SCanonicalLocusPointer_TO_r_struct_of_r_binaryANDr_int32END 2021-12-17 08:47:20 root: INFO: instruction count: 16: __C2683collect_distributed_array.__m2888ENCODE_SStringPointer_TO_r_binary 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2683collect_distributed_array.__m2889ENCODE_SInt32$_TO_r_int32 2021-12-17 08:47:20 root: INFO: instruction count: 39: __C2683collect_distributed_array.__m2890ENCODE_SIndexablePointer_TO_r_array_of_r_binary 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2683collect_distributed_array.__m2891ENCODE_SBoolean$_TO_r_bool 2021-12-17 08:47:20 root: INFO: instruction count: 21: __C2683collect_distributed_array.setPartitionIndex 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2683collect_distributed_array.addPartitionRegion 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2683collect_distributed_array.setPool 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2683collect_distributed_array.addFS 2021-12-17 08:47:20 root: INFO: instruction count: 43: __C2683collect_distributed_array.addReferenceGenomes 2021-12-17 08:47:20 root: INFO: instruction count: 433: __C2683collect_distributed_array.__m2694split_Let_region12_17 2021-12-17 08:47:20 root: INFO: instruction count: 322: __C2683collect_distributed_array.__m2768split_StreamFor_region6_21 2021-12-17 08:47:20 root: INFO: instruction count: 273: __C2683collect_distributed_array.__m2799take_by_seqop_region15_17 2021-12-17 08:47:20 root: INFO: instruction count: 238: __C2683collect_distributed_array.__m2799take_by_seqop_region3_3 2021-12-17 08:47:20 root: INFO: instruction count: 521: __C2683collect_distributed_array.__m2801take_by_garbage_collect_region2_12 2021-12-17 08:47:20 root: INFO: instruction count: 273: __C2683collect_distributed_array.__m2802take_by_seqop_region15_17 2021-12-17 08:47:20 root: INFO: instruction count: 238: __C2683collect_distributed_array.__m2802take_by_seqop_region3_3 2021-12-17 08:47:20 root: INFO: instruction count: 521: __C2683collect_distributed_array.__m2806take_by_garbage_collect_region2_12 2021-12-17 08:47:20 root: INFO: instruction count: 261: __C2683collect_distributed_array.__m2828take_by_seqop_region9_11 2021-12-17 08:47:20 root: INFO: instruction count: 253: __C2683collect_distributed_array.__m2828take_by_seqop_region3_5 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2894__m2694split_LetSpills. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2897__m2768split_StreamForSpills. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2902__m2799take_by_seqopSpills. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2917__m2801take_by_garbage_collectSpills. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2923__m2802take_by_seqopSpills. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2938__m2806take_by_garbage_collectSpills. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2944__m2828take_by_seqopSpills. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2718RGContainer_GRCh38. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2718RGContainer_GRCh38. 2021-12-17 08:47:20 root: INFO: encoder cache hit 2021-12-17 08:47:20 MemoryStore: INFO: Block broadcast_1 stored as values in memory (estimated size 12.8 KiB, free 53.2 GiB) 2021-12-17 08:47:20 MemoryStore: INFO: Block broadcast_1_piece0 stored as bytes in memory (estimated size 3.2 KiB, free 53.2 GiB) 2021-12-17 08:47:20 BlockManagerInfo: INFO: Added broadcast_1_piece0 in memory on 192.168.0.54:59478 (size: 3.2 KiB, free: 53.2 GiB) 2021-12-17 08:47:20 SparkContext: INFO: Created broadcast 1 from broadcast at SparkBackend.scala:278 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2671FSContainer. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2671FSContainer. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2672Compiled. 2021-12-17 08:47:20 root: INFO: instruction count: 540: __C2672Compiled.apply 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2672Compiled.setBackend 2021-12-17 08:47:20 root: INFO: instruction count: 9: __C2672Compiled.__m2962ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND 2021-12-17 08:47:20 root: INFO: instruction count: 61: __C2672Compiled.__m2963ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2672Compiled.__m2964ENCODE_SInt32$_TO_r_int32 2021-12-17 08:47:20 root: INFO: instruction count: 16: __C2672Compiled.__m2965ENCODE_SStringPointer_TO_r_binary 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2672Compiled.__m2966ENCODE_SInt64$_TO_r_int64 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2672Compiled.__m2967ENCODE_SBoolean$_TO_r_bool 2021-12-17 08:47:20 root: INFO: instruction count: 9: __C2672Compiled.__m2968ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_ENDEND 2021-12-17 08:47:20 root: INFO: instruction count: 1: __C2672Compiled.__m2969ENCODE_SBaseStructPointer_TO_r_struct_of_END 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2672Compiled.setObjects 2021-12-17 08:47:20 root: INFO: instruction count: 27: __C2672Compiled.__m2971DECODE_r_struct_of_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDENDEND_TO_SBaseStructPointer 2021-12-17 08:47:20 root: INFO: instruction count: 62: __C2672Compiled.__m2972INPLACE_DECODE_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryENDEND_TO_r_struct_of_r_int64ANDr_array_of_r_struct_of_r_locusANDr_array_of_r_stringENDANDr_array_of_r_struct_of_r_locusANDr_array_of_r_stringENDANDr_boolANDr_boolANDr_array_of_r_struct_of_r_locusANDr_array_of_r_stringENDEND 2021-12-17 08:47:20 root: INFO: instruction count: 10: __C2672Compiled.__m2973INPLACE_DECODE_r_int64_TO_r_int64 2021-12-17 08:47:20 root: INFO: instruction count: 58: __C2672Compiled.__m2974INPLACE_DECODE_r_array_of_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND_TO_r_array_of_r_struct_of_r_locusANDr_array_of_r_stringEND 2021-12-17 08:47:20 root: INFO: instruction count: 26: __C2672Compiled.__m2975INPLACE_DECODE_r_struct_of_r_struct_of_r_binaryANDr_int32ENDANDr_array_of_r_binaryEND_TO_r_struct_of_r_locusANDr_array_of_r_stringEND 2021-12-17 08:47:20 root: INFO: instruction count: 26: __C2672Compiled.__m2976INPLACE_DECODE_r_struct_of_r_binaryANDr_int32END_TO_r_locus 2021-12-17 08:47:20 root: INFO: instruction count: 31: __C2672Compiled.__m2977INPLACE_DECODE_r_binary_TO_r_string 2021-12-17 08:47:20 root: INFO: instruction count: 10: __C2672Compiled.__m2978INPLACE_DECODE_r_int32_TO_r_int32 2021-12-17 08:47:20 root: INFO: instruction count: 58: __C2672Compiled.__m2979INPLACE_DECODE_r_array_of_r_binary_TO_r_array_of_r_string 2021-12-17 08:47:20 root: INFO: instruction count: 10: __C2672Compiled.__m2980INPLACE_DECODE_r_bool_TO_r_bool 2021-12-17 08:47:20 root: INFO: instruction count: 35: __C2672Compiled.__m2989arrayref_bounds_check 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2672Compiled.__m2993ord_gt 2021-12-17 08:47:20 root: INFO: instruction count: 14: __C2672Compiled.__m2994ord_gtNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 12: __C2672Compiled.__m2999setup_jab 2021-12-17 08:47:20 root: INFO: instruction count: 27: __C2672Compiled.__m3002dependent_sorting_func 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2672Compiled.__m3005ord_lt 2021-12-17 08:47:20 root: INFO: instruction count: 91: __C2672Compiled.__m3006ord_ltNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2672Compiled.__m3007ord_lt 2021-12-17 08:47:20 root: INFO: instruction count: 323: __C2672Compiled.__m3008ord_ltNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 15: __C2672Compiled.__m3009ord_lt 2021-12-17 08:47:20 root: INFO: instruction count: 25: __C2672Compiled.__m3010ord_ltNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 74: __C2672Compiled.__m3011ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 9: __C2672Compiled.__m3013ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 89: __C2672Compiled.__m3014ord_compareNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 15: __C2672Compiled.__m3015ord_equiv 2021-12-17 08:47:20 root: INFO: instruction count: 25: __C2672Compiled.__m3016ord_equivNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 15: __C2672Compiled.__m3017ord_lt 2021-12-17 08:47:20 root: INFO: instruction count: 102: __C2672Compiled.__m3018ord_ltNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2672Compiled.__m3019ord_lt 2021-12-17 08:47:20 root: INFO: instruction count: 21: __C2672Compiled.__m3020ord_ltNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2672Compiled.__m3021ord_equiv 2021-12-17 08:47:20 root: INFO: instruction count: 21: __C2672Compiled.__m3022ord_equivNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 15: __C2672Compiled.__m3023ord_equiv 2021-12-17 08:47:20 root: INFO: instruction count: 81: __C2672Compiled.__m3024ord_equivNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2672Compiled.__m3025ord_equiv 2021-12-17 08:47:20 root: INFO: instruction count: 234: __C2672Compiled.__m3026ord_equivNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 202: __C2672Compiled.__m3027arraySorter_outer 2021-12-17 08:47:20 root: INFO: instruction count: 66: __C2672Compiled.__m3028arraySorter_merge 2021-12-17 08:47:20 root: INFO: instruction count: 36: __C2672Compiled.__m3029arraySorter_splitMerge 2021-12-17 08:47:20 root: INFO: instruction count: 85: __C2672Compiled.__m3034split_StreamFold 2021-12-17 08:47:20 root: INFO: instruction count: 146: __C2672Compiled.__m3044split_StreamFold 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2672Compiled.__m3052ord_lteq 2021-12-17 08:47:20 root: INFO: instruction count: 320: __C2672Compiled.__m3053ord_lteqNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 15: __C2672Compiled.__m3054ord_lteq 2021-12-17 08:47:20 root: INFO: instruction count: 25: __C2672Compiled.__m3055ord_lteqNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 15: __C2672Compiled.__m3056ord_lteq 2021-12-17 08:47:20 root: INFO: instruction count: 99: __C2672Compiled.__m3057ord_lteqNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2672Compiled.__m3058ord_lteq 2021-12-17 08:47:20 root: INFO: instruction count: 21: __C2672Compiled.__m3059ord_lteqNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 85: __C2672Compiled.__m3061split_StreamFold 2021-12-17 08:47:20 root: INFO: instruction count: 146: __C2672Compiled.__m3071split_StreamFold 2021-12-17 08:47:20 root: INFO: instruction count: 11: __C2672Compiled.__m3079ord_lteq 2021-12-17 08:47:20 root: INFO: instruction count: 180: __C2672Compiled.__m3080ord_lteqNonnull 2021-12-17 08:47:20 root: INFO: instruction count: 9: __C2672Compiled.setPartitionIndex 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2672Compiled.addPartitionRegion 2021-12-17 08:47:20 root: INFO: instruction count: 4: __C2672Compiled.setPool 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C2672Compiled.addFS 2021-12-17 08:47:20 root: INFO: instruction count: 43: __C2672Compiled.addReferenceGenomes 2021-12-17 08:47:20 root: INFO: instruction count: 70: __C2672Compiled.addLiterals 2021-12-17 08:47:20 root: INFO: instruction count: 36: __C2672Compiled.__m3085DECODE_r_struct_of_r_struct_of_ENDANDr_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolENDEND_TO_SBaseStructPointer 2021-12-17 08:47:20 root: INFO: instruction count: 8: __C2672Compiled.__m3086INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2021-12-17 08:47:20 root: INFO: instruction count: 58: __C2672Compiled.__m3087INPLACE_DECODE_r_array_of_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_array_of_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2021-12-17 08:47:20 root: INFO: instruction count: 53: __C2672Compiled.__m3088INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryANDr_int64ANDr_int64ANDr_boolEND_TO_r_struct_of_r_int32ANDr_stringANDr_int64ANDr_int64ANDr_boolEND 2021-12-17 08:47:20 root: INFO: instruction count: 331: __C2672Compiled.apply_region14_22 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C3089applySpills. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C3012RGContainer_GRCh38. 2021-12-17 08:47:20 root: INFO: instruction count: 3: __C3012RGContainer_GRCh38. 2021-12-17 08:47:20 MemoryStore: INFO: Block broadcast_2 stored as values in memory (estimated size 64.0 B, free 53.2 GiB) 2021-12-17 08:47:20 MemoryStore: INFO: Block broadcast_2_piece0 stored as bytes in memory (estimated size 49.0 B, free 53.2 GiB) 2021-12-17 08:47:20 BlockManagerInfo: INFO: Added broadcast_2_piece0 in memory on 192.168.0.54:59478 (size: 49.0 B, free: 53.2 GiB) 2021-12-17 08:47:20 SparkContext: INFO: Created broadcast 2 from broadcast at SparkBackend.scala:278 2021-12-17 08:47:20 MemoryStore: INFO: Block broadcast_3 stored as values in memory (estimated size 370.8 KiB, free 53.2 GiB) 2021-12-17 08:47:20 MemoryStore: INFO: Block broadcast_3_piece0 stored as bytes in memory (estimated size 27.1 KiB, free 53.2 GiB) 2021-12-17 08:47:20 BlockManagerInfo: INFO: Added broadcast_3_piece0 in memory on 192.168.0.54:59478 (size: 27.1 KiB, free: 53.2 GiB) 2021-12-17 08:47:20 SparkContext: INFO: Created broadcast 3 from broadcast at SparkBackend.scala:278 2021-12-17 08:47:20 SparkContext: INFO: Starting job: collect at SparkBackend.scala:286 2021-12-17 08:47:20 DAGScheduler: INFO: Got job 0 (collect at SparkBackend.scala:286) with 175 output partitions 2021-12-17 08:47:20 DAGScheduler: INFO: Final stage: ResultStage 0 (collect at SparkBackend.scala:286) 2021-12-17 08:47:20 DAGScheduler: INFO: Parents of final stage: List() 2021-12-17 08:47:20 DAGScheduler: INFO: Missing parents: List() 2021-12-17 08:47:20 DAGScheduler: INFO: Submitting ResultStage 0 (SparkBackendComputeRDD[0] at RDD at SparkBackend.scala:722), which has no missing parents 2021-12-17 08:47:20 MemoryStore: INFO: Block broadcast_4 stored as values in memory (estimated size 414.7 KiB, free 53.2 GiB) 2021-12-17 08:47:20 MemoryStore: INFO: Block broadcast_4_piece0 stored as bytes in memory (estimated size 201.0 KiB, free 53.2 GiB) 2021-12-17 08:47:20 BlockManagerInfo: INFO: Added broadcast_4_piece0 in memory on 192.168.0.54:59478 (size: 201.0 KiB, free: 53.2 GiB) 2021-12-17 08:47:20 SparkContext: INFO: Created broadcast 4 from broadcast at DAGScheduler.scala:1388 2021-12-17 08:47:20 DAGScheduler: INFO: Submitting 175 missing tasks from ResultStage 0 (SparkBackendComputeRDD[0] at RDD at SparkBackend.scala:722) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)) 2021-12-17 08:47:20 TaskSchedulerImpl: INFO: Adding task set 0.0 with 175 tasks resource profile 0 2021-12-17 08:47:20 TaskSetManager: INFO: Starting task 0.0 in stage 0.0 (TID 0) (192.168.0.54, executor driver, partition 0, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:20 TaskSetManager: INFO: Starting task 1.0 in stage 0.0 (TID 1) (192.168.0.54, executor driver, partition 1, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:20 TaskSetManager: INFO: Starting task 2.0 in stage 0.0 (TID 2) (192.168.0.54, executor driver, partition 2, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:20 TaskSetManager: INFO: Starting task 3.0 in stage 0.0 (TID 3) (192.168.0.54, executor driver, partition 3, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:20 TaskSetManager: INFO: Starting task 4.0 in stage 0.0 (TID 4) (192.168.0.54, executor driver, partition 4, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:20 TaskSetManager: INFO: Starting task 5.0 in stage 0.0 (TID 5) (192.168.0.54, executor driver, partition 5, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:20 Executor: INFO: Running task 0.0 in stage 0.0 (TID 0) 2021-12-17 08:47:20 Executor: INFO: Running task 1.0 in stage 0.0 (TID 1) 2021-12-17 08:47:20 Executor: INFO: Running task 3.0 in stage 0.0 (TID 3) 2021-12-17 08:47:20 Executor: INFO: Running task 4.0 in stage 0.0 (TID 4) 2021-12-17 08:47:20 Executor: INFO: Running task 2.0 in stage 0.0 (TID 2) 2021-12-17 08:47:20 Executor: INFO: Running task 5.0 in stage 0.0 (TID 5) 2021-12-17 08:47:20 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 2.0 in stage 0.0 (TID 2) 2021-12-17 08:47:20 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 5.0 in stage 0.0 (TID 5) 2021-12-17 08:47:20 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 1.0 in stage 0.0 (TID 1) 2021-12-17 08:47:20 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 0.0 in stage 0.0 (TID 0) 2021-12-17 08:47:20 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 4.0 in stage 0.0 (TID 4) 2021-12-17 08:47:20 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 3.0 in stage 0.0 (TID 3) 2021-12-17 08:47:20 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 5.0 in stage 0.0 (TID 5) 2021-12-17 08:47:20 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 2.0 in stage 0.0 (TID 2) 2021-12-17 08:47:20 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 0.0 in stage 0.0 (TID 0) 2021-12-17 08:47:20 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 1.0 in stage 0.0 (TID 1) 2021-12-17 08:47:20 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 4.0 in stage 0.0 (TID 4) 2021-12-17 08:47:20 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 3.0 in stage 0.0 (TID 3) 2021-12-17 08:47:24 root: INFO: TaskReport: stage=0, partition=1, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=8, cache hits=3 2021-12-17 08:47:24 root: INFO: RegionPool: FREE: 302.0K allocated (299.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 1.0 in stage 0.0 (TID 1) 2021-12-17 08:47:24 Executor: INFO: Finished task 1.0 in stage 0.0 (TID 1). 1466 bytes result sent to driver 2021-12-17 08:47:24 TaskSetManager: INFO: Starting task 6.0 in stage 0.0 (TID 6) (192.168.0.54, executor driver, partition 6, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:24 Executor: INFO: Running task 6.0 in stage 0.0 (TID 6) 2021-12-17 08:47:24 TaskSetManager: INFO: Finished task 1.0 in stage 0.0 (TID 1) in 3684 ms on 192.168.0.54 (executor driver) (1/175) 2021-12-17 08:47:24 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 6.0 in stage 0.0 (TID 6) 2021-12-17 08:47:24 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 6.0 in stage 0.0 (TID 6) 2021-12-17 08:47:24 root: INFO: TaskReport: stage=0, partition=5, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:24 root: INFO: RegionPool: FREE: 301.3K allocated (299.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 5.0 in stage 0.0 (TID 5) 2021-12-17 08:47:24 Executor: INFO: Finished task 5.0 in stage 0.0 (TID 5). 1478 bytes result sent to driver 2021-12-17 08:47:24 TaskSetManager: INFO: Starting task 7.0 in stage 0.0 (TID 7) (192.168.0.54, executor driver, partition 7, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:24 TaskSetManager: INFO: Finished task 5.0 in stage 0.0 (TID 5) in 3726 ms on 192.168.0.54 (executor driver) (2/175) 2021-12-17 08:47:24 Executor: INFO: Running task 7.0 in stage 0.0 (TID 7) 2021-12-17 08:47:24 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 7.0 in stage 0.0 (TID 7) 2021-12-17 08:47:24 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 7.0 in stage 0.0 (TID 7) 2021-12-17 08:47:24 root: INFO: TaskReport: stage=0, partition=4, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:24 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 4.0 in stage 0.0 (TID 4) 2021-12-17 08:47:24 Executor: INFO: Finished task 4.0 in stage 0.0 (TID 4). 1506 bytes result sent to driver 2021-12-17 08:47:24 TaskSetManager: INFO: Starting task 8.0 in stage 0.0 (TID 8) (192.168.0.54, executor driver, partition 8, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:24 TaskSetManager: INFO: Finished task 4.0 in stage 0.0 (TID 4) in 3795 ms on 192.168.0.54 (executor driver) (3/175) 2021-12-17 08:47:24 Executor: INFO: Running task 8.0 in stage 0.0 (TID 8) 2021-12-17 08:47:24 root: INFO: TaskReport: stage=0, partition=2, attempt=0, peakBytes=308224, peakBytesReadable=301.00 KiB, chunks requested=2, cache hits=0 2021-12-17 08:47:24 root: INFO: RegionPool: FREE: 301.0K allocated (298.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 2.0 in stage 0.0 (TID 2) 2021-12-17 08:47:24 Executor: INFO: Finished task 2.0 in stage 0.0 (TID 2). 1464 bytes result sent to driver 2021-12-17 08:47:24 TaskSetManager: INFO: Starting task 9.0 in stage 0.0 (TID 9) (192.168.0.54, executor driver, partition 9, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:24 TaskSetManager: INFO: Finished task 2.0 in stage 0.0 (TID 2) in 3798 ms on 192.168.0.54 (executor driver) (4/175) 2021-12-17 08:47:24 Executor: INFO: Running task 9.0 in stage 0.0 (TID 9) 2021-12-17 08:47:24 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 8.0 in stage 0.0 (TID 8) 2021-12-17 08:47:24 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 8.0 in stage 0.0 (TID 8) 2021-12-17 08:47:24 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 9.0 in stage 0.0 (TID 9) 2021-12-17 08:47:24 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 9.0 in stage 0.0 (TID 9) 2021-12-17 08:47:24 root: INFO: TaskReport: stage=0, partition=0, attempt=0, peakBytes=375296, peakBytesReadable=366.50 KiB, chunks requested=16, cache hits=14 2021-12-17 08:47:24 root: INFO: RegionPool: FREE: 366.5K allocated (364.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 0.0 in stage 0.0 (TID 0) 2021-12-17 08:47:24 Executor: INFO: Finished task 0.0 in stage 0.0 (TID 0). 1800 bytes result sent to driver 2021-12-17 08:47:24 TaskSetManager: INFO: Starting task 10.0 in stage 0.0 (TID 10) (192.168.0.54, executor driver, partition 10, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:24 TaskSetManager: INFO: Finished task 0.0 in stage 0.0 (TID 0) in 3809 ms on 192.168.0.54 (executor driver) (5/175) 2021-12-17 08:47:24 Executor: INFO: Running task 10.0 in stage 0.0 (TID 10) 2021-12-17 08:47:24 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 10.0 in stage 0.0 (TID 10) 2021-12-17 08:47:24 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 10.0 in stage 0.0 (TID 10) 2021-12-17 08:47:24 root: INFO: TaskReport: stage=0, partition=3, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=10, cache hits=3 2021-12-17 08:47:24 root: INFO: RegionPool: FREE: 302.0K allocated (299.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 3.0 in stage 0.0 (TID 3) 2021-12-17 08:47:24 Executor: INFO: Finished task 3.0 in stage 0.0 (TID 3). 1454 bytes result sent to driver 2021-12-17 08:47:24 TaskSetManager: INFO: Starting task 11.0 in stage 0.0 (TID 11) (192.168.0.54, executor driver, partition 11, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:24 Executor: INFO: Running task 11.0 in stage 0.0 (TID 11) 2021-12-17 08:47:24 TaskSetManager: INFO: Finished task 3.0 in stage 0.0 (TID 3) in 3836 ms on 192.168.0.54 (executor driver) (6/175) 2021-12-17 08:47:24 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 11.0 in stage 0.0 (TID 11) 2021-12-17 08:47:24 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 11.0 in stage 0.0 (TID 11) 2021-12-17 08:47:27 root: INFO: TaskReport: stage=0, partition=6, attempt=0, peakBytes=313856, peakBytesReadable=306.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:27 root: INFO: RegionPool: FREE: 306.5K allocated (304.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 6.0 in stage 0.0 (TID 6) 2021-12-17 08:47:27 Executor: INFO: Finished task 6.0 in stage 0.0 (TID 6). 1459 bytes result sent to driver 2021-12-17 08:47:27 TaskSetManager: INFO: Starting task 12.0 in stage 0.0 (TID 12) (192.168.0.54, executor driver, partition 12, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:27 TaskSetManager: INFO: Finished task 6.0 in stage 0.0 (TID 6) in 3295 ms on 192.168.0.54 (executor driver) (7/175) 2021-12-17 08:47:27 Executor: INFO: Running task 12.0 in stage 0.0 (TID 12) 2021-12-17 08:47:27 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 12.0 in stage 0.0 (TID 12) 2021-12-17 08:47:27 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 12.0 in stage 0.0 (TID 12) 2021-12-17 08:47:27 root: INFO: TaskReport: stage=0, partition=7, attempt=0, peakBytes=305408, peakBytesReadable=298.25 KiB, chunks requested=4, cache hits=2 2021-12-17 08:47:27 root: INFO: RegionPool: FREE: 298.3K allocated (296.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 7.0 in stage 0.0 (TID 7) 2021-12-17 08:47:27 Executor: INFO: Finished task 7.0 in stage 0.0 (TID 7). 1418 bytes result sent to driver 2021-12-17 08:47:27 TaskSetManager: INFO: Starting task 13.0 in stage 0.0 (TID 13) (192.168.0.54, executor driver, partition 13, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:27 TaskSetManager: INFO: Finished task 7.0 in stage 0.0 (TID 7) in 3291 ms on 192.168.0.54 (executor driver) (8/175) 2021-12-17 08:47:27 Executor: INFO: Running task 13.0 in stage 0.0 (TID 13) 2021-12-17 08:47:27 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 13.0 in stage 0.0 (TID 13) 2021-12-17 08:47:27 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 13.0 in stage 0.0 (TID 13) 2021-12-17 08:47:27 root: INFO: TaskReport: stage=0, partition=11, attempt=0, peakBytes=307200, peakBytesReadable=300.00 KiB, chunks requested=4, cache hits=1 2021-12-17 08:47:27 root: INFO: RegionPool: FREE: 300.0K allocated (297.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 11.0 in stage 0.0 (TID 11) 2021-12-17 08:47:27 Executor: INFO: Finished task 11.0 in stage 0.0 (TID 11). 1440 bytes result sent to driver 2021-12-17 08:47:27 TaskSetManager: INFO: Starting task 14.0 in stage 0.0 (TID 14) (192.168.0.54, executor driver, partition 14, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:27 TaskSetManager: INFO: Finished task 11.0 in stage 0.0 (TID 11) in 3199 ms on 192.168.0.54 (executor driver) (9/175) 2021-12-17 08:47:27 Executor: INFO: Running task 14.0 in stage 0.0 (TID 14) 2021-12-17 08:47:27 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 14.0 in stage 0.0 (TID 14) 2021-12-17 08:47:27 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 14.0 in stage 0.0 (TID 14) 2021-12-17 08:47:27 root: INFO: TaskReport: stage=0, partition=8, attempt=0, peakBytes=308992, peakBytesReadable=301.75 KiB, chunks requested=2, cache hits=0 2021-12-17 08:47:27 root: INFO: RegionPool: FREE: 301.8K allocated (299.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 8.0 in stage 0.0 (TID 8) 2021-12-17 08:47:27 Executor: INFO: Finished task 8.0 in stage 0.0 (TID 8). 1413 bytes result sent to driver 2021-12-17 08:47:27 TaskSetManager: INFO: Starting task 15.0 in stage 0.0 (TID 15) (192.168.0.54, executor driver, partition 15, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:27 TaskSetManager: INFO: Finished task 8.0 in stage 0.0 (TID 8) in 3269 ms on 192.168.0.54 (executor driver) (10/175) 2021-12-17 08:47:27 Executor: INFO: Running task 15.0 in stage 0.0 (TID 15) 2021-12-17 08:47:27 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 15.0 in stage 0.0 (TID 15) 2021-12-17 08:47:27 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 15.0 in stage 0.0 (TID 15) 2021-12-17 08:47:27 root: INFO: TaskReport: stage=0, partition=10, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=3, cache hits=0 2021-12-17 08:47:27 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 10.0 in stage 0.0 (TID 10) 2021-12-17 08:47:27 Executor: INFO: Finished task 10.0 in stage 0.0 (TID 10). 1425 bytes result sent to driver 2021-12-17 08:47:27 TaskSetManager: INFO: Starting task 16.0 in stage 0.0 (TID 16) (192.168.0.54, executor driver, partition 16, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:27 TaskSetManager: INFO: Finished task 10.0 in stage 0.0 (TID 10) in 3308 ms on 192.168.0.54 (executor driver) (11/175) 2021-12-17 08:47:27 Executor: INFO: Running task 16.0 in stage 0.0 (TID 16) 2021-12-17 08:47:27 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 16.0 in stage 0.0 (TID 16) 2021-12-17 08:47:27 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 16.0 in stage 0.0 (TID 16) 2021-12-17 08:47:27 root: INFO: TaskReport: stage=0, partition=9, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:27 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 9.0 in stage 0.0 (TID 9) 2021-12-17 08:47:27 Executor: INFO: Finished task 9.0 in stage 0.0 (TID 9). 1496 bytes result sent to driver 2021-12-17 08:47:27 TaskSetManager: INFO: Starting task 17.0 in stage 0.0 (TID 17) (192.168.0.54, executor driver, partition 17, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:27 TaskSetManager: INFO: Finished task 9.0 in stage 0.0 (TID 9) in 3350 ms on 192.168.0.54 (executor driver) (12/175) 2021-12-17 08:47:27 Executor: INFO: Running task 17.0 in stage 0.0 (TID 17) 2021-12-17 08:47:27 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 17.0 in stage 0.0 (TID 17) 2021-12-17 08:47:27 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 17.0 in stage 0.0 (TID 17) 2021-12-17 08:47:30 root: INFO: TaskReport: stage=0, partition=15, attempt=0, peakBytes=311040, peakBytesReadable=303.75 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:30 root: INFO: RegionPool: FREE: 303.8K allocated (301.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 15.0 in stage 0.0 (TID 15) 2021-12-17 08:47:30 Executor: INFO: Finished task 15.0 in stage 0.0 (TID 15). 1439 bytes result sent to driver 2021-12-17 08:47:30 TaskSetManager: INFO: Starting task 18.0 in stage 0.0 (TID 18) (192.168.0.54, executor driver, partition 18, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:30 TaskSetManager: INFO: Finished task 15.0 in stage 0.0 (TID 15) in 2956 ms on 192.168.0.54 (executor driver) (13/175) 2021-12-17 08:47:30 Executor: INFO: Running task 18.0 in stage 0.0 (TID 18) 2021-12-17 08:47:30 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 18.0 in stage 0.0 (TID 18) 2021-12-17 08:47:30 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 18.0 in stage 0.0 (TID 18) 2021-12-17 08:47:30 root: INFO: TaskReport: stage=0, partition=12, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:30 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 12.0 in stage 0.0 (TID 12) 2021-12-17 08:47:30 Executor: INFO: Finished task 12.0 in stage 0.0 (TID 12). 1464 bytes result sent to driver 2021-12-17 08:47:30 TaskSetManager: INFO: Starting task 19.0 in stage 0.0 (TID 19) (192.168.0.54, executor driver, partition 19, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:30 TaskSetManager: INFO: Finished task 12.0 in stage 0.0 (TID 12) in 3058 ms on 192.168.0.54 (executor driver) (14/175) 2021-12-17 08:47:30 Executor: INFO: Running task 19.0 in stage 0.0 (TID 19) 2021-12-17 08:47:30 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 19.0 in stage 0.0 (TID 19) 2021-12-17 08:47:30 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 19.0 in stage 0.0 (TID 19) 2021-12-17 08:47:30 root: INFO: TaskReport: stage=0, partition=13, attempt=0, peakBytes=311296, peakBytesReadable=304.00 KiB, chunks requested=2, cache hits=0 2021-12-17 08:47:30 root: INFO: RegionPool: FREE: 304.0K allocated (301.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 13.0 in stage 0.0 (TID 13) 2021-12-17 08:47:30 Executor: INFO: Finished task 13.0 in stage 0.0 (TID 13). 1477 bytes result sent to driver 2021-12-17 08:47:30 TaskSetManager: INFO: Starting task 20.0 in stage 0.0 (TID 20) (192.168.0.54, executor driver, partition 20, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:30 TaskSetManager: INFO: Finished task 13.0 in stage 0.0 (TID 13) in 3051 ms on 192.168.0.54 (executor driver) (15/175) 2021-12-17 08:47:30 Executor: INFO: Running task 20.0 in stage 0.0 (TID 20) 2021-12-17 08:47:30 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 20.0 in stage 0.0 (TID 20) 2021-12-17 08:47:30 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 20.0 in stage 0.0 (TID 20) 2021-12-17 08:47:30 root: INFO: TaskReport: stage=0, partition=14, attempt=0, peakBytes=312576, peakBytesReadable=305.25 KiB, chunks requested=9, cache hits=6 2021-12-17 08:47:30 root: INFO: RegionPool: FREE: 305.3K allocated (302.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 14.0 in stage 0.0 (TID 14) 2021-12-17 08:47:30 Executor: INFO: Finished task 14.0 in stage 0.0 (TID 14). 1542 bytes result sent to driver 2021-12-17 08:47:30 TaskSetManager: INFO: Starting task 21.0 in stage 0.0 (TID 21) (192.168.0.54, executor driver, partition 21, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:30 TaskSetManager: INFO: Finished task 14.0 in stage 0.0 (TID 14) in 3063 ms on 192.168.0.54 (executor driver) (16/175) 2021-12-17 08:47:30 Executor: INFO: Running task 21.0 in stage 0.0 (TID 21) 2021-12-17 08:47:30 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 21.0 in stage 0.0 (TID 21) 2021-12-17 08:47:30 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 21.0 in stage 0.0 (TID 21) 2021-12-17 08:47:30 root: INFO: TaskReport: stage=0, partition=16, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:30 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 16.0 in stage 0.0 (TID 16) 2021-12-17 08:47:30 Executor: INFO: Finished task 16.0 in stage 0.0 (TID 16). 1441 bytes result sent to driver 2021-12-17 08:47:30 TaskSetManager: INFO: Starting task 22.0 in stage 0.0 (TID 22) (192.168.0.54, executor driver, partition 22, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:30 TaskSetManager: INFO: Finished task 16.0 in stage 0.0 (TID 16) in 3046 ms on 192.168.0.54 (executor driver) (17/175) 2021-12-17 08:47:30 Executor: INFO: Running task 22.0 in stage 0.0 (TID 22) 2021-12-17 08:47:30 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 22.0 in stage 0.0 (TID 22) 2021-12-17 08:47:30 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 22.0 in stage 0.0 (TID 22) 2021-12-17 08:47:30 root: INFO: TaskReport: stage=0, partition=17, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:30 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 17.0 in stage 0.0 (TID 17) 2021-12-17 08:47:30 Executor: INFO: Finished task 17.0 in stage 0.0 (TID 17). 1430 bytes result sent to driver 2021-12-17 08:47:30 TaskSetManager: INFO: Starting task 23.0 in stage 0.0 (TID 23) (192.168.0.54, executor driver, partition 23, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:30 TaskSetManager: INFO: Finished task 17.0 in stage 0.0 (TID 17) in 3086 ms on 192.168.0.54 (executor driver) (18/175) 2021-12-17 08:47:30 Executor: INFO: Running task 23.0 in stage 0.0 (TID 23) 2021-12-17 08:47:30 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 23.0 in stage 0.0 (TID 23) 2021-12-17 08:47:30 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 23.0 in stage 0.0 (TID 23) 2021-12-17 08:47:33 root: INFO: TaskReport: stage=0, partition=19, attempt=0, peakBytes=310528, peakBytesReadable=303.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:33 root: INFO: RegionPool: FREE: 303.3K allocated (301.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 19.0 in stage 0.0 (TID 19) 2021-12-17 08:47:33 Executor: INFO: Finished task 19.0 in stage 0.0 (TID 19). 1465 bytes result sent to driver 2021-12-17 08:47:33 TaskSetManager: INFO: Starting task 24.0 in stage 0.0 (TID 24) (192.168.0.54, executor driver, partition 24, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:33 TaskSetManager: INFO: Finished task 19.0 in stage 0.0 (TID 19) in 3064 ms on 192.168.0.54 (executor driver) (19/175) 2021-12-17 08:47:33 Executor: INFO: Running task 24.0 in stage 0.0 (TID 24) 2021-12-17 08:47:33 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 24.0 in stage 0.0 (TID 24) 2021-12-17 08:47:33 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 24.0 in stage 0.0 (TID 24) 2021-12-17 08:47:33 root: INFO: TaskReport: stage=0, partition=22, attempt=0, peakBytes=310784, peakBytesReadable=303.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:47:33 root: INFO: RegionPool: FREE: 303.5K allocated (301.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 22.0 in stage 0.0 (TID 22) 2021-12-17 08:47:33 Executor: INFO: Finished task 22.0 in stage 0.0 (TID 22). 1466 bytes result sent to driver 2021-12-17 08:47:33 TaskSetManager: INFO: Starting task 25.0 in stage 0.0 (TID 25) (192.168.0.54, executor driver, partition 25, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:33 TaskSetManager: INFO: Finished task 22.0 in stage 0.0 (TID 22) in 2983 ms on 192.168.0.54 (executor driver) (20/175) 2021-12-17 08:47:33 Executor: INFO: Running task 25.0 in stage 0.0 (TID 25) 2021-12-17 08:47:33 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 25.0 in stage 0.0 (TID 25) 2021-12-17 08:47:33 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 25.0 in stage 0.0 (TID 25) 2021-12-17 08:47:33 root: INFO: TaskReport: stage=0, partition=20, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:33 root: INFO: RegionPool: FREE: 301.3K allocated (299.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 20.0 in stage 0.0 (TID 20) 2021-12-17 08:47:33 Executor: INFO: Finished task 20.0 in stage 0.0 (TID 20). 1470 bytes result sent to driver 2021-12-17 08:47:33 TaskSetManager: INFO: Starting task 26.0 in stage 0.0 (TID 26) (192.168.0.54, executor driver, partition 26, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:33 TaskSetManager: INFO: Finished task 20.0 in stage 0.0 (TID 20) in 3111 ms on 192.168.0.54 (executor driver) (21/175) 2021-12-17 08:47:33 Executor: INFO: Running task 26.0 in stage 0.0 (TID 26) 2021-12-17 08:47:33 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 26.0 in stage 0.0 (TID 26) 2021-12-17 08:47:33 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 26.0 in stage 0.0 (TID 26) 2021-12-17 08:47:33 root: INFO: TaskReport: stage=0, partition=18, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:33 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 18.0 in stage 0.0 (TID 18) 2021-12-17 08:47:33 Executor: INFO: Finished task 18.0 in stage 0.0 (TID 18). 1493 bytes result sent to driver 2021-12-17 08:47:33 TaskSetManager: INFO: Starting task 27.0 in stage 0.0 (TID 27) (192.168.0.54, executor driver, partition 27, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:33 TaskSetManager: INFO: Finished task 18.0 in stage 0.0 (TID 18) in 3215 ms on 192.168.0.54 (executor driver) (22/175) 2021-12-17 08:47:33 Executor: INFO: Running task 27.0 in stage 0.0 (TID 27) 2021-12-17 08:47:34 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 27.0 in stage 0.0 (TID 27) 2021-12-17 08:47:34 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 27.0 in stage 0.0 (TID 27) 2021-12-17 08:47:34 root: INFO: TaskReport: stage=0, partition=21, attempt=0, peakBytes=308992, peakBytesReadable=301.75 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:34 root: INFO: RegionPool: FREE: 301.8K allocated (299.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 21.0 in stage 0.0 (TID 21) 2021-12-17 08:47:34 Executor: INFO: Finished task 21.0 in stage 0.0 (TID 21). 1480 bytes result sent to driver 2021-12-17 08:47:34 TaskSetManager: INFO: Starting task 28.0 in stage 0.0 (TID 28) (192.168.0.54, executor driver, partition 28, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:34 TaskSetManager: INFO: Finished task 21.0 in stage 0.0 (TID 21) in 3179 ms on 192.168.0.54 (executor driver) (23/175) 2021-12-17 08:47:34 Executor: INFO: Running task 28.0 in stage 0.0 (TID 28) 2021-12-17 08:47:34 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 28.0 in stage 0.0 (TID 28) 2021-12-17 08:47:34 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 28.0 in stage 0.0 (TID 28) 2021-12-17 08:47:34 root: INFO: TaskReport: stage=0, partition=23, attempt=0, peakBytes=306432, peakBytesReadable=299.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:34 root: INFO: RegionPool: FREE: 299.3K allocated (297.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 23.0 in stage 0.0 (TID 23) 2021-12-17 08:47:34 Executor: INFO: Finished task 23.0 in stage 0.0 (TID 23). 1498 bytes result sent to driver 2021-12-17 08:47:34 TaskSetManager: INFO: Starting task 29.0 in stage 0.0 (TID 29) (192.168.0.54, executor driver, partition 29, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:34 TaskSetManager: INFO: Finished task 23.0 in stage 0.0 (TID 23) in 3303 ms on 192.168.0.54 (executor driver) (24/175) 2021-12-17 08:47:34 Executor: INFO: Running task 29.0 in stage 0.0 (TID 29) 2021-12-17 08:47:34 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 29.0 in stage 0.0 (TID 29) 2021-12-17 08:47:34 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 29.0 in stage 0.0 (TID 29) 2021-12-17 08:47:36 root: INFO: TaskReport: stage=0, partition=25, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:36 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 25.0 in stage 0.0 (TID 25) 2021-12-17 08:47:36 Executor: INFO: Finished task 25.0 in stage 0.0 (TID 25). 1498 bytes result sent to driver 2021-12-17 08:47:36 TaskSetManager: INFO: Starting task 30.0 in stage 0.0 (TID 30) (192.168.0.54, executor driver, partition 30, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:36 TaskSetManager: INFO: Finished task 25.0 in stage 0.0 (TID 25) in 3020 ms on 192.168.0.54 (executor driver) (25/175) 2021-12-17 08:47:36 Executor: INFO: Running task 30.0 in stage 0.0 (TID 30) 2021-12-17 08:47:36 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 30.0 in stage 0.0 (TID 30) 2021-12-17 08:47:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 30.0 in stage 0.0 (TID 30) 2021-12-17 08:47:36 root: INFO: TaskReport: stage=0, partition=24, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:36 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 24.0 in stage 0.0 (TID 24) 2021-12-17 08:47:36 Executor: INFO: Finished task 24.0 in stage 0.0 (TID 24). 1425 bytes result sent to driver 2021-12-17 08:47:36 TaskSetManager: INFO: Starting task 31.0 in stage 0.0 (TID 31) (192.168.0.54, executor driver, partition 31, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:36 TaskSetManager: INFO: Finished task 24.0 in stage 0.0 (TID 24) in 3119 ms on 192.168.0.54 (executor driver) (26/175) 2021-12-17 08:47:36 Executor: INFO: Running task 31.0 in stage 0.0 (TID 31) 2021-12-17 08:47:36 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 31.0 in stage 0.0 (TID 31) 2021-12-17 08:47:36 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 31.0 in stage 0.0 (TID 31) 2021-12-17 08:47:37 root: INFO: TaskReport: stage=0, partition=27, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=14, cache hits=7 2021-12-17 08:47:37 root: INFO: RegionPool: FREE: 302.5K allocated (299.5K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 27.0 in stage 0.0 (TID 27) 2021-12-17 08:47:37 Executor: INFO: Finished task 27.0 in stage 0.0 (TID 27). 1485 bytes result sent to driver 2021-12-17 08:47:37 TaskSetManager: INFO: Starting task 32.0 in stage 0.0 (TID 32) (192.168.0.54, executor driver, partition 32, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:37 TaskSetManager: INFO: Finished task 27.0 in stage 0.0 (TID 27) in 3018 ms on 192.168.0.54 (executor driver) (27/175) 2021-12-17 08:47:37 Executor: INFO: Running task 32.0 in stage 0.0 (TID 32) 2021-12-17 08:47:37 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 32.0 in stage 0.0 (TID 32) 2021-12-17 08:47:37 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 32.0 in stage 0.0 (TID 32) 2021-12-17 08:47:37 root: INFO: TaskReport: stage=0, partition=26, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:37 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 26.0 in stage 0.0 (TID 26) 2021-12-17 08:47:37 Executor: INFO: Finished task 26.0 in stage 0.0 (TID 26). 1466 bytes result sent to driver 2021-12-17 08:47:37 TaskSetManager: INFO: Starting task 33.0 in stage 0.0 (TID 33) (192.168.0.54, executor driver, partition 33, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:37 TaskSetManager: INFO: Finished task 26.0 in stage 0.0 (TID 26) in 3093 ms on 192.168.0.54 (executor driver) (28/175) 2021-12-17 08:47:37 Executor: INFO: Running task 33.0 in stage 0.0 (TID 33) 2021-12-17 08:47:37 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 33.0 in stage 0.0 (TID 33) 2021-12-17 08:47:37 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 33.0 in stage 0.0 (TID 33) 2021-12-17 08:47:37 root: INFO: TaskReport: stage=0, partition=28, attempt=0, peakBytes=309504, peakBytesReadable=302.25 KiB, chunks requested=3, cache hits=0 2021-12-17 08:47:37 root: INFO: RegionPool: FREE: 302.3K allocated (299.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 28.0 in stage 0.0 (TID 28) 2021-12-17 08:47:37 Executor: INFO: Finished task 28.0 in stage 0.0 (TID 28). 1431 bytes result sent to driver 2021-12-17 08:47:37 TaskSetManager: INFO: Starting task 34.0 in stage 0.0 (TID 34) (192.168.0.54, executor driver, partition 34, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:37 Executor: INFO: Running task 34.0 in stage 0.0 (TID 34) 2021-12-17 08:47:37 TaskSetManager: INFO: Finished task 28.0 in stage 0.0 (TID 28) in 3137 ms on 192.168.0.54 (executor driver) (29/175) 2021-12-17 08:47:37 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 34.0 in stage 0.0 (TID 34) 2021-12-17 08:47:37 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 34.0 in stage 0.0 (TID 34) 2021-12-17 08:47:37 root: INFO: TaskReport: stage=0, partition=29, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:37 root: INFO: RegionPool: FREE: 302.5K allocated (300.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 29.0 in stage 0.0 (TID 29) 2021-12-17 08:47:37 Executor: INFO: Finished task 29.0 in stage 0.0 (TID 29). 1420 bytes result sent to driver 2021-12-17 08:47:37 TaskSetManager: INFO: Starting task 35.0 in stage 0.0 (TID 35) (192.168.0.54, executor driver, partition 35, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:37 TaskSetManager: INFO: Finished task 29.0 in stage 0.0 (TID 29) in 3227 ms on 192.168.0.54 (executor driver) (30/175) 2021-12-17 08:47:37 Executor: INFO: Running task 35.0 in stage 0.0 (TID 35) 2021-12-17 08:47:37 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 35.0 in stage 0.0 (TID 35) 2021-12-17 08:47:37 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 35.0 in stage 0.0 (TID 35) 2021-12-17 08:47:40 root: INFO: TaskReport: stage=0, partition=33, attempt=0, peakBytes=310784, peakBytesReadable=303.50 KiB, chunks requested=5, cache hits=1 2021-12-17 08:47:40 root: INFO: RegionPool: FREE: 303.5K allocated (301.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 33.0 in stage 0.0 (TID 33) 2021-12-17 08:47:40 Executor: INFO: Finished task 33.0 in stage 0.0 (TID 33). 1615 bytes result sent to driver 2021-12-17 08:47:40 TaskSetManager: INFO: Starting task 36.0 in stage 0.0 (TID 36) (192.168.0.54, executor driver, partition 36, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:40 TaskSetManager: INFO: Finished task 33.0 in stage 0.0 (TID 33) in 2994 ms on 192.168.0.54 (executor driver) (31/175) 2021-12-17 08:47:40 Executor: INFO: Running task 36.0 in stage 0.0 (TID 36) 2021-12-17 08:47:40 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 36.0 in stage 0.0 (TID 36) 2021-12-17 08:47:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 36.0 in stage 0.0 (TID 36) 2021-12-17 08:47:40 root: INFO: TaskReport: stage=0, partition=30, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:40 root: INFO: RegionPool: FREE: 301.3K allocated (299.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 30.0 in stage 0.0 (TID 30) 2021-12-17 08:47:40 Executor: INFO: Finished task 30.0 in stage 0.0 (TID 30). 1427 bytes result sent to driver 2021-12-17 08:47:40 TaskSetManager: INFO: Starting task 37.0 in stage 0.0 (TID 37) (192.168.0.54, executor driver, partition 37, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:40 TaskSetManager: INFO: Finished task 30.0 in stage 0.0 (TID 30) in 3139 ms on 192.168.0.54 (executor driver) (32/175) 2021-12-17 08:47:40 Executor: INFO: Running task 37.0 in stage 0.0 (TID 37) 2021-12-17 08:47:40 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 37.0 in stage 0.0 (TID 37) 2021-12-17 08:47:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 37.0 in stage 0.0 (TID 37) 2021-12-17 08:47:40 root: INFO: TaskReport: stage=0, partition=32, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:40 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 32.0 in stage 0.0 (TID 32) 2021-12-17 08:47:40 Executor: INFO: Finished task 32.0 in stage 0.0 (TID 32). 1421 bytes result sent to driver 2021-12-17 08:47:40 TaskSetManager: INFO: Starting task 38.0 in stage 0.0 (TID 38) (192.168.0.54, executor driver, partition 38, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:40 Executor: INFO: Running task 38.0 in stage 0.0 (TID 38) 2021-12-17 08:47:40 TaskSetManager: INFO: Finished task 32.0 in stage 0.0 (TID 32) in 3176 ms on 192.168.0.54 (executor driver) (33/175) 2021-12-17 08:47:40 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 38.0 in stage 0.0 (TID 38) 2021-12-17 08:47:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 38.0 in stage 0.0 (TID 38) 2021-12-17 08:47:40 root: INFO: TaskReport: stage=0, partition=34, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:47:40 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 34.0 in stage 0.0 (TID 34) 2021-12-17 08:47:40 Executor: INFO: Finished task 34.0 in stage 0.0 (TID 34). 1425 bytes result sent to driver 2021-12-17 08:47:40 TaskSetManager: INFO: Starting task 39.0 in stage 0.0 (TID 39) (192.168.0.54, executor driver, partition 39, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:40 TaskSetManager: INFO: Finished task 34.0 in stage 0.0 (TID 34) in 3039 ms on 192.168.0.54 (executor driver) (34/175) 2021-12-17 08:47:40 Executor: INFO: Running task 39.0 in stage 0.0 (TID 39) 2021-12-17 08:47:40 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 39.0 in stage 0.0 (TID 39) 2021-12-17 08:47:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 39.0 in stage 0.0 (TID 39) 2021-12-17 08:47:40 root: INFO: TaskReport: stage=0, partition=31, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=3, cache hits=0 2021-12-17 08:47:40 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 31.0 in stage 0.0 (TID 31) 2021-12-17 08:47:40 Executor: INFO: Finished task 31.0 in stage 0.0 (TID 31). 1423 bytes result sent to driver 2021-12-17 08:47:40 TaskSetManager: INFO: Starting task 40.0 in stage 0.0 (TID 40) (192.168.0.54, executor driver, partition 40, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:40 TaskSetManager: INFO: Finished task 31.0 in stage 0.0 (TID 31) in 3243 ms on 192.168.0.54 (executor driver) (35/175) 2021-12-17 08:47:40 Executor: INFO: Running task 40.0 in stage 0.0 (TID 40) 2021-12-17 08:47:40 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 40.0 in stage 0.0 (TID 40) 2021-12-17 08:47:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 40.0 in stage 0.0 (TID 40) 2021-12-17 08:47:40 root: INFO: TaskReport: stage=0, partition=35, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:40 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 35.0 in stage 0.0 (TID 35) 2021-12-17 08:47:40 Executor: INFO: Finished task 35.0 in stage 0.0 (TID 35). 1413 bytes result sent to driver 2021-12-17 08:47:40 TaskSetManager: INFO: Starting task 41.0 in stage 0.0 (TID 41) (192.168.0.54, executor driver, partition 41, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:40 TaskSetManager: INFO: Finished task 35.0 in stage 0.0 (TID 35) in 3191 ms on 192.168.0.54 (executor driver) (36/175) 2021-12-17 08:47:40 Executor: INFO: Running task 41.0 in stage 0.0 (TID 41) 2021-12-17 08:47:40 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 41.0 in stage 0.0 (TID 41) 2021-12-17 08:47:40 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 41.0 in stage 0.0 (TID 41) 2021-12-17 08:47:43 root: INFO: TaskReport: stage=0, partition=36, attempt=0, peakBytes=315136, peakBytesReadable=307.75 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:43 root: INFO: RegionPool: FREE: 307.8K allocated (305.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 36.0 in stage 0.0 (TID 36) 2021-12-17 08:47:43 Executor: INFO: Finished task 36.0 in stage 0.0 (TID 36). 1493 bytes result sent to driver 2021-12-17 08:47:43 TaskSetManager: INFO: Starting task 42.0 in stage 0.0 (TID 42) (192.168.0.54, executor driver, partition 42, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:43 TaskSetManager: INFO: Finished task 36.0 in stage 0.0 (TID 36) in 3271 ms on 192.168.0.54 (executor driver) (37/175) 2021-12-17 08:47:43 Executor: INFO: Running task 42.0 in stage 0.0 (TID 42) 2021-12-17 08:47:43 root: INFO: TaskReport: stage=0, partition=37, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:47:43 root: INFO: RegionPool: FREE: 302.5K allocated (300.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 37.0 in stage 0.0 (TID 37) 2021-12-17 08:47:43 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 42.0 in stage 0.0 (TID 42) 2021-12-17 08:47:43 Executor: INFO: Finished task 37.0 in stage 0.0 (TID 37). 1462 bytes result sent to driver 2021-12-17 08:47:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 42.0 in stage 0.0 (TID 42) 2021-12-17 08:47:43 TaskSetManager: INFO: Starting task 43.0 in stage 0.0 (TID 43) (192.168.0.54, executor driver, partition 43, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:43 TaskSetManager: INFO: Finished task 37.0 in stage 0.0 (TID 37) in 3238 ms on 192.168.0.54 (executor driver) (38/175) 2021-12-17 08:47:43 Executor: INFO: Running task 43.0 in stage 0.0 (TID 43) 2021-12-17 08:47:43 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 43.0 in stage 0.0 (TID 43) 2021-12-17 08:47:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 43.0 in stage 0.0 (TID 43) 2021-12-17 08:47:43 root: INFO: TaskReport: stage=0, partition=38, attempt=0, peakBytes=313856, peakBytesReadable=306.50 KiB, chunks requested=4, cache hits=1 2021-12-17 08:47:43 root: INFO: RegionPool: FREE: 306.5K allocated (304.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 38.0 in stage 0.0 (TID 38) 2021-12-17 08:47:43 Executor: INFO: Finished task 38.0 in stage 0.0 (TID 38). 1464 bytes result sent to driver 2021-12-17 08:47:43 TaskSetManager: INFO: Starting task 44.0 in stage 0.0 (TID 44) (192.168.0.54, executor driver, partition 44, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:43 TaskSetManager: INFO: Finished task 38.0 in stage 0.0 (TID 38) in 3239 ms on 192.168.0.54 (executor driver) (39/175) 2021-12-17 08:47:43 Executor: INFO: Running task 44.0 in stage 0.0 (TID 44) 2021-12-17 08:47:43 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 44.0 in stage 0.0 (TID 44) 2021-12-17 08:47:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 44.0 in stage 0.0 (TID 44) 2021-12-17 08:47:43 root: INFO: TaskReport: stage=0, partition=40, attempt=0, peakBytes=310528, peakBytesReadable=303.25 KiB, chunks requested=10, cache hits=7 2021-12-17 08:47:43 root: INFO: RegionPool: FREE: 303.3K allocated (300.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 40.0 in stage 0.0 (TID 40) 2021-12-17 08:47:43 Executor: INFO: Finished task 40.0 in stage 0.0 (TID 40). 1484 bytes result sent to driver 2021-12-17 08:47:43 TaskSetManager: INFO: Starting task 45.0 in stage 0.0 (TID 45) (192.168.0.54, executor driver, partition 45, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:43 TaskSetManager: INFO: Finished task 40.0 in stage 0.0 (TID 40) in 3364 ms on 192.168.0.54 (executor driver) (40/175) 2021-12-17 08:47:43 Executor: INFO: Running task 45.0 in stage 0.0 (TID 45) 2021-12-17 08:47:43 root: INFO: TaskReport: stage=0, partition=39, attempt=0, peakBytes=311296, peakBytesReadable=304.00 KiB, chunks requested=2, cache hits=0 2021-12-17 08:47:43 root: INFO: RegionPool: FREE: 304.0K allocated (301.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 39.0 in stage 0.0 (TID 39) 2021-12-17 08:47:43 Executor: INFO: Finished task 39.0 in stage 0.0 (TID 39). 1473 bytes result sent to driver 2021-12-17 08:47:43 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 45.0 in stage 0.0 (TID 45) 2021-12-17 08:47:43 TaskSetManager: INFO: Starting task 46.0 in stage 0.0 (TID 46) (192.168.0.54, executor driver, partition 46, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:43 TaskSetManager: INFO: Finished task 39.0 in stage 0.0 (TID 39) in 3379 ms on 192.168.0.54 (executor driver) (41/175) 2021-12-17 08:47:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 45.0 in stage 0.0 (TID 45) 2021-12-17 08:47:43 Executor: INFO: Running task 46.0 in stage 0.0 (TID 46) 2021-12-17 08:47:43 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 46.0 in stage 0.0 (TID 46) 2021-12-17 08:47:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 46.0 in stage 0.0 (TID 46) 2021-12-17 08:47:43 root: INFO: TaskReport: stage=0, partition=41, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=3, cache hits=1 2021-12-17 08:47:43 root: INFO: RegionPool: FREE: 302.5K allocated (300.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 41.0 in stage 0.0 (TID 41) 2021-12-17 08:47:43 Executor: INFO: Finished task 41.0 in stage 0.0 (TID 41). 1457 bytes result sent to driver 2021-12-17 08:47:43 TaskSetManager: INFO: Starting task 47.0 in stage 0.0 (TID 47) (192.168.0.54, executor driver, partition 47, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:43 TaskSetManager: INFO: Finished task 41.0 in stage 0.0 (TID 41) in 3165 ms on 192.168.0.54 (executor driver) (42/175) 2021-12-17 08:47:43 Executor: INFO: Running task 47.0 in stage 0.0 (TID 47) 2021-12-17 08:47:43 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 47.0 in stage 0.0 (TID 47) 2021-12-17 08:47:43 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 47.0 in stage 0.0 (TID 47) 2021-12-17 08:47:46 root: INFO: TaskReport: stage=0, partition=42, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=8, cache hits=4 2021-12-17 08:47:46 root: INFO: RegionPool: FREE: 302.5K allocated (299.5K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 42.0 in stage 0.0 (TID 42) 2021-12-17 08:47:46 Executor: INFO: Finished task 42.0 in stage 0.0 (TID 42). 1433 bytes result sent to driver 2021-12-17 08:47:46 TaskSetManager: INFO: Starting task 48.0 in stage 0.0 (TID 48) (192.168.0.54, executor driver, partition 48, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:46 TaskSetManager: INFO: Finished task 42.0 in stage 0.0 (TID 42) in 2989 ms on 192.168.0.54 (executor driver) (43/175) 2021-12-17 08:47:46 Executor: INFO: Running task 48.0 in stage 0.0 (TID 48) 2021-12-17 08:47:46 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 48.0 in stage 0.0 (TID 48) 2021-12-17 08:47:46 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 48.0 in stage 0.0 (TID 48) 2021-12-17 08:47:46 root: INFO: TaskReport: stage=0, partition=43, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:47:46 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 43.0 in stage 0.0 (TID 43) 2021-12-17 08:47:46 Executor: INFO: Finished task 43.0 in stage 0.0 (TID 43). 1438 bytes result sent to driver 2021-12-17 08:47:46 TaskSetManager: INFO: Starting task 49.0 in stage 0.0 (TID 49) (192.168.0.54, executor driver, partition 49, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:46 TaskSetManager: INFO: Finished task 43.0 in stage 0.0 (TID 43) in 3010 ms on 192.168.0.54 (executor driver) (44/175) 2021-12-17 08:47:46 Executor: INFO: Running task 49.0 in stage 0.0 (TID 49) 2021-12-17 08:47:46 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 49.0 in stage 0.0 (TID 49) 2021-12-17 08:47:46 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 49.0 in stage 0.0 (TID 49) 2021-12-17 08:47:46 root: INFO: TaskReport: stage=0, partition=44, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=5, cache hits=2 2021-12-17 08:47:46 root: INFO: RegionPool: FREE: 302.5K allocated (300.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 44.0 in stage 0.0 (TID 44) 2021-12-17 08:47:46 Executor: INFO: Finished task 44.0 in stage 0.0 (TID 44). 1465 bytes result sent to driver 2021-12-17 08:47:46 TaskSetManager: INFO: Starting task 50.0 in stage 0.0 (TID 50) (192.168.0.54, executor driver, partition 50, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:46 TaskSetManager: INFO: Finished task 44.0 in stage 0.0 (TID 44) in 2984 ms on 192.168.0.54 (executor driver) (45/175) 2021-12-17 08:47:46 Executor: INFO: Running task 50.0 in stage 0.0 (TID 50) 2021-12-17 08:47:46 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 50.0 in stage 0.0 (TID 50) 2021-12-17 08:47:46 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 50.0 in stage 0.0 (TID 50) 2021-12-17 08:47:46 root: INFO: TaskReport: stage=0, partition=46, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:46 root: INFO: RegionPool: FREE: 301.3K allocated (299.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 46.0 in stage 0.0 (TID 46) 2021-12-17 08:47:46 Executor: INFO: Finished task 46.0 in stage 0.0 (TID 46). 1512 bytes result sent to driver 2021-12-17 08:47:46 TaskSetManager: INFO: Starting task 51.0 in stage 0.0 (TID 51) (192.168.0.54, executor driver, partition 51, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:46 TaskSetManager: INFO: Finished task 46.0 in stage 0.0 (TID 46) in 3138 ms on 192.168.0.54 (executor driver) (46/175) 2021-12-17 08:47:46 Executor: INFO: Running task 51.0 in stage 0.0 (TID 51) 2021-12-17 08:47:46 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 51.0 in stage 0.0 (TID 51) 2021-12-17 08:47:46 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 51.0 in stage 0.0 (TID 51) 2021-12-17 08:47:46 root: INFO: TaskReport: stage=0, partition=45, attempt=0, peakBytes=307456, peakBytesReadable=300.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:46 root: INFO: RegionPool: FREE: 300.3K allocated (298.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 45.0 in stage 0.0 (TID 45) 2021-12-17 08:47:46 Executor: INFO: Finished task 45.0 in stage 0.0 (TID 45). 1423 bytes result sent to driver 2021-12-17 08:47:46 TaskSetManager: INFO: Starting task 52.0 in stage 0.0 (TID 52) (192.168.0.54, executor driver, partition 52, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:46 TaskSetManager: INFO: Finished task 45.0 in stage 0.0 (TID 45) in 3301 ms on 192.168.0.54 (executor driver) (47/175) 2021-12-17 08:47:46 Executor: INFO: Running task 52.0 in stage 0.0 (TID 52) 2021-12-17 08:47:46 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 52.0 in stage 0.0 (TID 52) 2021-12-17 08:47:46 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 52.0 in stage 0.0 (TID 52) 2021-12-17 08:47:46 root: INFO: TaskReport: stage=0, partition=47, attempt=0, peakBytes=309504, peakBytesReadable=302.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:46 root: INFO: RegionPool: FREE: 302.3K allocated (300.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 47.0 in stage 0.0 (TID 47) 2021-12-17 08:47:46 Executor: INFO: Finished task 47.0 in stage 0.0 (TID 47). 1460 bytes result sent to driver 2021-12-17 08:47:46 TaskSetManager: INFO: Starting task 53.0 in stage 0.0 (TID 53) (192.168.0.54, executor driver, partition 53, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:46 TaskSetManager: INFO: Finished task 47.0 in stage 0.0 (TID 47) in 3073 ms on 192.168.0.54 (executor driver) (48/175) 2021-12-17 08:47:46 Executor: INFO: Running task 53.0 in stage 0.0 (TID 53) 2021-12-17 08:47:46 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 53.0 in stage 0.0 (TID 53) 2021-12-17 08:47:46 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 53.0 in stage 0.0 (TID 53) 2021-12-17 08:47:49 root: INFO: TaskReport: stage=0, partition=48, attempt=0, peakBytes=311552, peakBytesReadable=304.25 KiB, chunks requested=10, cache hits=6 2021-12-17 08:47:49 root: INFO: RegionPool: FREE: 304.0K allocated (301.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 48.0 in stage 0.0 (TID 48) 2021-12-17 08:47:49 Executor: INFO: Finished task 48.0 in stage 0.0 (TID 48). 1413 bytes result sent to driver 2021-12-17 08:47:49 TaskSetManager: INFO: Starting task 54.0 in stage 0.0 (TID 54) (192.168.0.54, executor driver, partition 54, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:49 TaskSetManager: INFO: Finished task 48.0 in stage 0.0 (TID 48) in 3104 ms on 192.168.0.54 (executor driver) (49/175) 2021-12-17 08:47:49 Executor: INFO: Running task 54.0 in stage 0.0 (TID 54) 2021-12-17 08:47:49 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 54.0 in stage 0.0 (TID 54) 2021-12-17 08:47:49 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 54.0 in stage 0.0 (TID 54) 2021-12-17 08:47:49 root: INFO: TaskReport: stage=0, partition=50, attempt=0, peakBytes=310016, peakBytesReadable=302.75 KiB, chunks requested=3, cache hits=1 2021-12-17 08:47:49 root: INFO: RegionPool: FREE: 302.8K allocated (300.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 50.0 in stage 0.0 (TID 50) 2021-12-17 08:47:49 Executor: INFO: Finished task 50.0 in stage 0.0 (TID 50). 1425 bytes result sent to driver 2021-12-17 08:47:49 TaskSetManager: INFO: Starting task 55.0 in stage 0.0 (TID 55) (192.168.0.54, executor driver, partition 55, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:49 TaskSetManager: INFO: Finished task 50.0 in stage 0.0 (TID 50) in 3013 ms on 192.168.0.54 (executor driver) (50/175) 2021-12-17 08:47:49 Executor: INFO: Running task 55.0 in stage 0.0 (TID 55) 2021-12-17 08:47:49 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 55.0 in stage 0.0 (TID 55) 2021-12-17 08:47:49 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 55.0 in stage 0.0 (TID 55) 2021-12-17 08:47:49 root: INFO: TaskReport: stage=0, partition=49, attempt=0, peakBytes=310528, peakBytesReadable=303.25 KiB, chunks requested=3, cache hits=1 2021-12-17 08:47:49 root: INFO: RegionPool: FREE: 302.8K allocated (300.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 49.0 in stage 0.0 (TID 49) 2021-12-17 08:47:49 Executor: INFO: Finished task 49.0 in stage 0.0 (TID 49). 1422 bytes result sent to driver 2021-12-17 08:47:49 TaskSetManager: INFO: Starting task 56.0 in stage 0.0 (TID 56) (192.168.0.54, executor driver, partition 56, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:49 TaskSetManager: INFO: Finished task 49.0 in stage 0.0 (TID 49) in 3142 ms on 192.168.0.54 (executor driver) (51/175) 2021-12-17 08:47:49 Executor: INFO: Running task 56.0 in stage 0.0 (TID 56) 2021-12-17 08:47:49 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 56.0 in stage 0.0 (TID 56) 2021-12-17 08:47:49 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 56.0 in stage 0.0 (TID 56) 2021-12-17 08:47:49 root: INFO: TaskReport: stage=0, partition=51, attempt=0, peakBytes=311552, peakBytesReadable=304.25 KiB, chunks requested=9, cache hits=6 2021-12-17 08:47:49 root: INFO: RegionPool: FREE: 304.3K allocated (301.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 51.0 in stage 0.0 (TID 51) 2021-12-17 08:47:49 Executor: INFO: Finished task 51.0 in stage 0.0 (TID 51). 1508 bytes result sent to driver 2021-12-17 08:47:49 TaskSetManager: INFO: Starting task 57.0 in stage 0.0 (TID 57) (192.168.0.54, executor driver, partition 57, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:49 TaskSetManager: INFO: Finished task 51.0 in stage 0.0 (TID 51) in 3085 ms on 192.168.0.54 (executor driver) (52/175) 2021-12-17 08:47:49 Executor: INFO: Running task 57.0 in stage 0.0 (TID 57) 2021-12-17 08:47:49 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 57.0 in stage 0.0 (TID 57) 2021-12-17 08:47:49 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 57.0 in stage 0.0 (TID 57) 2021-12-17 08:47:49 root: INFO: TaskReport: stage=0, partition=52, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=11, cache hits=9 2021-12-17 08:47:49 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 52.0 in stage 0.0 (TID 52) 2021-12-17 08:47:49 Executor: INFO: Finished task 52.0 in stage 0.0 (TID 52). 1433 bytes result sent to driver 2021-12-17 08:47:49 TaskSetManager: INFO: Starting task 58.0 in stage 0.0 (TID 58) (192.168.0.54, executor driver, partition 58, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:49 TaskSetManager: INFO: Finished task 52.0 in stage 0.0 (TID 52) in 3107 ms on 192.168.0.54 (executor driver) (53/175) 2021-12-17 08:47:49 Executor: INFO: Running task 58.0 in stage 0.0 (TID 58) 2021-12-17 08:47:49 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 58.0 in stage 0.0 (TID 58) 2021-12-17 08:47:49 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 58.0 in stage 0.0 (TID 58) 2021-12-17 08:47:50 root: INFO: TaskReport: stage=0, partition=53, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=2, cache hits=0 2021-12-17 08:47:50 root: INFO: RegionPool: FREE: 305.8K allocated (303.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 53.0 in stage 0.0 (TID 53) 2021-12-17 08:47:50 Executor: INFO: Finished task 53.0 in stage 0.0 (TID 53). 1449 bytes result sent to driver 2021-12-17 08:47:50 TaskSetManager: INFO: Starting task 59.0 in stage 0.0 (TID 59) (192.168.0.54, executor driver, partition 59, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:50 TaskSetManager: INFO: Finished task 53.0 in stage 0.0 (TID 53) in 3073 ms on 192.168.0.54 (executor driver) (54/175) 2021-12-17 08:47:50 Executor: INFO: Running task 59.0 in stage 0.0 (TID 59) 2021-12-17 08:47:50 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 59.0 in stage 0.0 (TID 59) 2021-12-17 08:47:50 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 59.0 in stage 0.0 (TID 59) 2021-12-17 08:47:52 root: INFO: TaskReport: stage=0, partition=54, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=3, cache hits=1 2021-12-17 08:47:52 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 54.0 in stage 0.0 (TID 54) 2021-12-17 08:47:52 Executor: INFO: Finished task 54.0 in stage 0.0 (TID 54). 1457 bytes result sent to driver 2021-12-17 08:47:52 TaskSetManager: INFO: Starting task 60.0 in stage 0.0 (TID 60) (192.168.0.54, executor driver, partition 60, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:52 TaskSetManager: INFO: Finished task 54.0 in stage 0.0 (TID 54) in 3180 ms on 192.168.0.54 (executor driver) (55/175) 2021-12-17 08:47:52 Executor: INFO: Running task 60.0 in stage 0.0 (TID 60) 2021-12-17 08:47:52 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 60.0 in stage 0.0 (TID 60) 2021-12-17 08:47:52 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 60.0 in stage 0.0 (TID 60) 2021-12-17 08:47:52 root: INFO: TaskReport: stage=0, partition=55, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:52 root: INFO: RegionPool: FREE: 302.5K allocated (300.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 55.0 in stage 0.0 (TID 55) 2021-12-17 08:47:52 Executor: INFO: Finished task 55.0 in stage 0.0 (TID 55). 1490 bytes result sent to driver 2021-12-17 08:47:52 TaskSetManager: INFO: Starting task 61.0 in stage 0.0 (TID 61) (192.168.0.54, executor driver, partition 61, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:52 TaskSetManager: INFO: Finished task 55.0 in stage 0.0 (TID 55) in 3192 ms on 192.168.0.54 (executor driver) (56/175) 2021-12-17 08:47:52 Executor: INFO: Running task 61.0 in stage 0.0 (TID 61) 2021-12-17 08:47:52 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 61.0 in stage 0.0 (TID 61) 2021-12-17 08:47:52 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 61.0 in stage 0.0 (TID 61) 2021-12-17 08:47:52 root: INFO: TaskReport: stage=0, partition=56, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=11, cache hits=9 2021-12-17 08:47:52 root: INFO: RegionPool: FREE: 300.8K allocated (298.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 56.0 in stage 0.0 (TID 56) 2021-12-17 08:47:52 Executor: INFO: Finished task 56.0 in stage 0.0 (TID 56). 1467 bytes result sent to driver 2021-12-17 08:47:52 TaskSetManager: INFO: Starting task 62.0 in stage 0.0 (TID 62) (192.168.0.54, executor driver, partition 62, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:52 TaskSetManager: INFO: Finished task 56.0 in stage 0.0 (TID 56) in 3210 ms on 192.168.0.54 (executor driver) (57/175) 2021-12-17 08:47:52 Executor: INFO: Running task 62.0 in stage 0.0 (TID 62) 2021-12-17 08:47:52 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 62.0 in stage 0.0 (TID 62) 2021-12-17 08:47:52 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 62.0 in stage 0.0 (TID 62) 2021-12-17 08:47:52 root: INFO: TaskReport: stage=0, partition=57, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:47:52 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 57.0 in stage 0.0 (TID 57) 2021-12-17 08:47:52 Executor: INFO: Finished task 57.0 in stage 0.0 (TID 57). 1469 bytes result sent to driver 2021-12-17 08:47:52 TaskSetManager: INFO: Starting task 63.0 in stage 0.0 (TID 63) (192.168.0.54, executor driver, partition 63, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:52 TaskSetManager: INFO: Finished task 57.0 in stage 0.0 (TID 57) in 3133 ms on 192.168.0.54 (executor driver) (58/175) 2021-12-17 08:47:52 Executor: INFO: Running task 63.0 in stage 0.0 (TID 63) 2021-12-17 08:47:52 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 63.0 in stage 0.0 (TID 63) 2021-12-17 08:47:52 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 63.0 in stage 0.0 (TID 63) 2021-12-17 08:47:53 root: INFO: TaskReport: stage=0, partition=58, attempt=0, peakBytes=307968, peakBytesReadable=300.75 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:53 root: INFO: RegionPool: FREE: 300.8K allocated (298.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 58.0 in stage 0.0 (TID 58) 2021-12-17 08:47:53 Executor: INFO: Finished task 58.0 in stage 0.0 (TID 58). 1477 bytes result sent to driver 2021-12-17 08:47:53 TaskSetManager: INFO: Starting task 64.0 in stage 0.0 (TID 64) (192.168.0.54, executor driver, partition 64, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:53 TaskSetManager: INFO: Finished task 58.0 in stage 0.0 (TID 58) in 3233 ms on 192.168.0.54 (executor driver) (59/175) 2021-12-17 08:47:53 Executor: INFO: Running task 64.0 in stage 0.0 (TID 64) 2021-12-17 08:47:53 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 64.0 in stage 0.0 (TID 64) 2021-12-17 08:47:53 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 64.0 in stage 0.0 (TID 64) 2021-12-17 08:47:53 root: INFO: TaskReport: stage=0, partition=59, attempt=0, peakBytes=309504, peakBytesReadable=302.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:53 root: INFO: RegionPool: FREE: 302.3K allocated (300.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 59.0 in stage 0.0 (TID 59) 2021-12-17 08:47:53 Executor: INFO: Finished task 59.0 in stage 0.0 (TID 59). 1499 bytes result sent to driver 2021-12-17 08:47:53 TaskSetManager: INFO: Starting task 65.0 in stage 0.0 (TID 65) (192.168.0.54, executor driver, partition 65, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:53 TaskSetManager: INFO: Finished task 59.0 in stage 0.0 (TID 59) in 3256 ms on 192.168.0.54 (executor driver) (60/175) 2021-12-17 08:47:53 Executor: INFO: Running task 65.0 in stage 0.0 (TID 65) 2021-12-17 08:47:53 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 65.0 in stage 0.0 (TID 65) 2021-12-17 08:47:53 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 65.0 in stage 0.0 (TID 65) 2021-12-17 08:47:55 root: INFO: TaskReport: stage=0, partition=60, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:47:55 root: INFO: RegionPool: FREE: 302.5K allocated (300.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 60.0 in stage 0.0 (TID 60) 2021-12-17 08:47:55 Executor: INFO: Finished task 60.0 in stage 0.0 (TID 60). 1425 bytes result sent to driver 2021-12-17 08:47:55 TaskSetManager: INFO: Starting task 66.0 in stage 0.0 (TID 66) (192.168.0.54, executor driver, partition 66, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:55 TaskSetManager: INFO: Finished task 60.0 in stage 0.0 (TID 60) in 3087 ms on 192.168.0.54 (executor driver) (61/175) 2021-12-17 08:47:55 Executor: INFO: Running task 66.0 in stage 0.0 (TID 66) 2021-12-17 08:47:55 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 66.0 in stage 0.0 (TID 66) 2021-12-17 08:47:55 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 66.0 in stage 0.0 (TID 66) 2021-12-17 08:47:55 root: INFO: TaskReport: stage=0, partition=61, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=9, cache hits=5 2021-12-17 08:47:55 root: INFO: RegionPool: FREE: 304.0K allocated (301.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 61.0 in stage 0.0 (TID 61) 2021-12-17 08:47:55 Executor: INFO: Finished task 61.0 in stage 0.0 (TID 61). 1440 bytes result sent to driver 2021-12-17 08:47:55 TaskSetManager: INFO: Starting task 67.0 in stage 0.0 (TID 67) (192.168.0.54, executor driver, partition 67, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:55 TaskSetManager: INFO: Finished task 61.0 in stage 0.0 (TID 61) in 3288 ms on 192.168.0.54 (executor driver) (62/175) 2021-12-17 08:47:55 Executor: INFO: Running task 67.0 in stage 0.0 (TID 67) 2021-12-17 08:47:55 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 67.0 in stage 0.0 (TID 67) 2021-12-17 08:47:55 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 67.0 in stage 0.0 (TID 67) 2021-12-17 08:47:55 root: INFO: TaskReport: stage=0, partition=62, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=6, cache hits=4 2021-12-17 08:47:55 root: INFO: RegionPool: FREE: 299.8K allocated (297.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 62.0 in stage 0.0 (TID 62) 2021-12-17 08:47:55 Executor: INFO: Finished task 62.0 in stage 0.0 (TID 62). 1428 bytes result sent to driver 2021-12-17 08:47:55 TaskSetManager: INFO: Starting task 68.0 in stage 0.0 (TID 68) (192.168.0.54, executor driver, partition 68, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:55 TaskSetManager: INFO: Finished task 62.0 in stage 0.0 (TID 62) in 3274 ms on 192.168.0.54 (executor driver) (63/175) 2021-12-17 08:47:55 Executor: INFO: Running task 68.0 in stage 0.0 (TID 68) 2021-12-17 08:47:55 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 68.0 in stage 0.0 (TID 68) 2021-12-17 08:47:55 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 68.0 in stage 0.0 (TID 68) 2021-12-17 08:47:56 root: INFO: TaskReport: stage=0, partition=63, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=11, cache hits=8 2021-12-17 08:47:56 root: INFO: RegionPool: FREE: 302.0K allocated (299.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 63.0 in stage 0.0 (TID 63) 2021-12-17 08:47:56 Executor: INFO: Finished task 63.0 in stage 0.0 (TID 63). 1427 bytes result sent to driver 2021-12-17 08:47:56 TaskSetManager: INFO: Starting task 69.0 in stage 0.0 (TID 69) (192.168.0.54, executor driver, partition 69, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:56 TaskSetManager: INFO: Finished task 63.0 in stage 0.0 (TID 63) in 3157 ms on 192.168.0.54 (executor driver) (64/175) 2021-12-17 08:47:56 Executor: INFO: Running task 69.0 in stage 0.0 (TID 69) 2021-12-17 08:47:56 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 69.0 in stage 0.0 (TID 69) 2021-12-17 08:47:56 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 69.0 in stage 0.0 (TID 69) 2021-12-17 08:47:56 root: INFO: TaskReport: stage=0, partition=64, attempt=0, peakBytes=309504, peakBytesReadable=302.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:56 root: INFO: RegionPool: FREE: 302.3K allocated (300.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 64.0 in stage 0.0 (TID 64) 2021-12-17 08:47:56 Executor: INFO: Finished task 64.0 in stage 0.0 (TID 64). 1414 bytes result sent to driver 2021-12-17 08:47:56 TaskSetManager: INFO: Starting task 70.0 in stage 0.0 (TID 70) (192.168.0.54, executor driver, partition 70, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:56 TaskSetManager: INFO: Finished task 64.0 in stage 0.0 (TID 64) in 3056 ms on 192.168.0.54 (executor driver) (65/175) 2021-12-17 08:47:56 Executor: INFO: Running task 70.0 in stage 0.0 (TID 70) 2021-12-17 08:47:56 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 70.0 in stage 0.0 (TID 70) 2021-12-17 08:47:56 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 70.0 in stage 0.0 (TID 70) 2021-12-17 08:47:56 root: INFO: TaskReport: stage=0, partition=65, attempt=0, peakBytes=306688, peakBytesReadable=299.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:56 root: INFO: RegionPool: FREE: 299.5K allocated (297.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 65.0 in stage 0.0 (TID 65) 2021-12-17 08:47:56 Executor: INFO: Finished task 65.0 in stage 0.0 (TID 65). 1424 bytes result sent to driver 2021-12-17 08:47:56 TaskSetManager: INFO: Starting task 71.0 in stage 0.0 (TID 71) (192.168.0.54, executor driver, partition 71, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:56 TaskSetManager: INFO: Finished task 65.0 in stage 0.0 (TID 65) in 3055 ms on 192.168.0.54 (executor driver) (66/175) 2021-12-17 08:47:56 Executor: INFO: Running task 71.0 in stage 0.0 (TID 71) 2021-12-17 08:47:56 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 71.0 in stage 0.0 (TID 71) 2021-12-17 08:47:56 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 71.0 in stage 0.0 (TID 71) 2021-12-17 08:47:58 root: INFO: TaskReport: stage=0, partition=66, attempt=0, peakBytes=307200, peakBytesReadable=300.00 KiB, chunks requested=3, cache hits=1 2021-12-17 08:47:58 root: INFO: RegionPool: FREE: 300.0K allocated (297.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 66.0 in stage 0.0 (TID 66) 2021-12-17 08:47:58 Executor: INFO: Finished task 66.0 in stage 0.0 (TID 66). 1419 bytes result sent to driver 2021-12-17 08:47:58 TaskSetManager: INFO: Starting task 72.0 in stage 0.0 (TID 72) (192.168.0.54, executor driver, partition 72, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:58 TaskSetManager: INFO: Finished task 66.0 in stage 0.0 (TID 66) in 3099 ms on 192.168.0.54 (executor driver) (67/175) 2021-12-17 08:47:58 Executor: INFO: Running task 72.0 in stage 0.0 (TID 72) 2021-12-17 08:47:58 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 72.0 in stage 0.0 (TID 72) 2021-12-17 08:47:58 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 72.0 in stage 0.0 (TID 72) 2021-12-17 08:47:58 root: INFO: TaskReport: stage=0, partition=67, attempt=0, peakBytes=309760, peakBytesReadable=302.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:47:58 root: INFO: RegionPool: FREE: 302.5K allocated (300.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 67.0 in stage 0.0 (TID 67) 2021-12-17 08:47:58 Executor: INFO: Finished task 67.0 in stage 0.0 (TID 67). 1443 bytes result sent to driver 2021-12-17 08:47:58 TaskSetManager: INFO: Starting task 73.0 in stage 0.0 (TID 73) (192.168.0.54, executor driver, partition 73, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:58 TaskSetManager: INFO: Finished task 67.0 in stage 0.0 (TID 67) in 3066 ms on 192.168.0.54 (executor driver) (68/175) 2021-12-17 08:47:58 Executor: INFO: Running task 73.0 in stage 0.0 (TID 73) 2021-12-17 08:47:58 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 73.0 in stage 0.0 (TID 73) 2021-12-17 08:47:58 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 73.0 in stage 0.0 (TID 73) 2021-12-17 08:47:59 root: INFO: TaskReport: stage=0, partition=68, attempt=0, peakBytes=305408, peakBytesReadable=298.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:47:59 root: INFO: RegionPool: FREE: 298.3K allocated (296.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 68.0 in stage 0.0 (TID 68) 2021-12-17 08:47:59 Executor: INFO: Finished task 68.0 in stage 0.0 (TID 68). 1457 bytes result sent to driver 2021-12-17 08:47:59 TaskSetManager: INFO: Starting task 74.0 in stage 0.0 (TID 74) (192.168.0.54, executor driver, partition 74, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:59 TaskSetManager: INFO: Finished task 68.0 in stage 0.0 (TID 68) in 3116 ms on 192.168.0.54 (executor driver) (69/175) 2021-12-17 08:47:59 Executor: INFO: Running task 74.0 in stage 0.0 (TID 74) 2021-12-17 08:47:59 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 74.0 in stage 0.0 (TID 74) 2021-12-17 08:47:59 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 74.0 in stage 0.0 (TID 74) 2021-12-17 08:47:59 root: INFO: TaskReport: stage=0, partition=69, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=4, cache hits=2 2021-12-17 08:47:59 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 69.0 in stage 0.0 (TID 69) 2021-12-17 08:47:59 Executor: INFO: Finished task 69.0 in stage 0.0 (TID 69). 1417 bytes result sent to driver 2021-12-17 08:47:59 TaskSetManager: INFO: Starting task 75.0 in stage 0.0 (TID 75) (192.168.0.54, executor driver, partition 75, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:59 TaskSetManager: INFO: Finished task 69.0 in stage 0.0 (TID 69) in 3133 ms on 192.168.0.54 (executor driver) (70/175) 2021-12-17 08:47:59 Executor: INFO: Running task 75.0 in stage 0.0 (TID 75) 2021-12-17 08:47:59 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 75.0 in stage 0.0 (TID 75) 2021-12-17 08:47:59 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 75.0 in stage 0.0 (TID 75) 2021-12-17 08:47:59 root: INFO: TaskReport: stage=0, partition=71, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=5, cache hits=2 2021-12-17 08:47:59 root: INFO: RegionPool: FREE: 301.8K allocated (299.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 71.0 in stage 0.0 (TID 71) 2021-12-17 08:47:59 Executor: INFO: Finished task 71.0 in stage 0.0 (TID 71). 1432 bytes result sent to driver 2021-12-17 08:47:59 TaskSetManager: INFO: Starting task 76.0 in stage 0.0 (TID 76) (192.168.0.54, executor driver, partition 76, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:59 TaskSetManager: INFO: Finished task 71.0 in stage 0.0 (TID 71) in 3095 ms on 192.168.0.54 (executor driver) (71/175) 2021-12-17 08:47:59 Executor: INFO: Running task 76.0 in stage 0.0 (TID 76) 2021-12-17 08:47:59 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 76.0 in stage 0.0 (TID 76) 2021-12-17 08:47:59 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 76.0 in stage 0.0 (TID 76) 2021-12-17 08:47:59 root: INFO: TaskReport: stage=0, partition=70, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=25, cache hits=18 2021-12-17 08:47:59 root: INFO: RegionPool: FREE: 304.3K allocated (301.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 70.0 in stage 0.0 (TID 70) 2021-12-17 08:47:59 Executor: INFO: Finished task 70.0 in stage 0.0 (TID 70). 1486 bytes result sent to driver 2021-12-17 08:47:59 TaskSetManager: INFO: Starting task 77.0 in stage 0.0 (TID 77) (192.168.0.54, executor driver, partition 77, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:47:59 Executor: INFO: Running task 77.0 in stage 0.0 (TID 77) 2021-12-17 08:47:59 TaskSetManager: INFO: Finished task 70.0 in stage 0.0 (TID 70) in 3197 ms on 192.168.0.54 (executor driver) (72/175) 2021-12-17 08:47:59 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 77.0 in stage 0.0 (TID 77) 2021-12-17 08:47:59 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 77.0 in stage 0.0 (TID 77) 2021-12-17 08:48:01 root: INFO: TaskReport: stage=0, partition=72, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=3, cache hits=1 2021-12-17 08:48:01 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 72.0 in stage 0.0 (TID 72) 2021-12-17 08:48:01 Executor: INFO: Finished task 72.0 in stage 0.0 (TID 72). 1425 bytes result sent to driver 2021-12-17 08:48:01 TaskSetManager: INFO: Starting task 78.0 in stage 0.0 (TID 78) (192.168.0.54, executor driver, partition 78, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:01 TaskSetManager: INFO: Finished task 72.0 in stage 0.0 (TID 72) in 3151 ms on 192.168.0.54 (executor driver) (73/175) 2021-12-17 08:48:01 Executor: INFO: Running task 78.0 in stage 0.0 (TID 78) 2021-12-17 08:48:01 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 78.0 in stage 0.0 (TID 78) 2021-12-17 08:48:01 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 78.0 in stage 0.0 (TID 78) 2021-12-17 08:48:02 root: INFO: TaskReport: stage=0, partition=74, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=5, cache hits=0 2021-12-17 08:48:02 root: INFO: RegionPool: FREE: 299.5K allocated (297.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 74.0 in stage 0.0 (TID 74) 2021-12-17 08:48:02 Executor: INFO: Finished task 74.0 in stage 0.0 (TID 74). 1428 bytes result sent to driver 2021-12-17 08:48:02 TaskSetManager: INFO: Starting task 79.0 in stage 0.0 (TID 79) (192.168.0.54, executor driver, partition 79, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:02 TaskSetManager: INFO: Finished task 74.0 in stage 0.0 (TID 74) in 3089 ms on 192.168.0.54 (executor driver) (74/175) 2021-12-17 08:48:02 Executor: INFO: Running task 79.0 in stage 0.0 (TID 79) 2021-12-17 08:48:02 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 79.0 in stage 0.0 (TID 79) 2021-12-17 08:48:02 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 79.0 in stage 0.0 (TID 79) 2021-12-17 08:48:02 root: INFO: TaskReport: stage=0, partition=73, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=9, cache hits=6 2021-12-17 08:48:02 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 73.0 in stage 0.0 (TID 73) 2021-12-17 08:48:02 Executor: INFO: Finished task 73.0 in stage 0.0 (TID 73). 1512 bytes result sent to driver 2021-12-17 08:48:02 TaskSetManager: INFO: Starting task 80.0 in stage 0.0 (TID 80) (192.168.0.54, executor driver, partition 80, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:02 TaskSetManager: INFO: Finished task 73.0 in stage 0.0 (TID 73) in 3229 ms on 192.168.0.54 (executor driver) (75/175) 2021-12-17 08:48:02 Executor: INFO: Running task 80.0 in stage 0.0 (TID 80) 2021-12-17 08:48:02 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 80.0 in stage 0.0 (TID 80) 2021-12-17 08:48:02 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 80.0 in stage 0.0 (TID 80) 2021-12-17 08:48:02 root: INFO: TaskReport: stage=0, partition=75, attempt=0, peakBytes=310784, peakBytesReadable=303.50 KiB, chunks requested=4, cache hits=2 2021-12-17 08:48:02 root: INFO: RegionPool: FREE: 303.5K allocated (301.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 75.0 in stage 0.0 (TID 75) 2021-12-17 08:48:02 Executor: INFO: Finished task 75.0 in stage 0.0 (TID 75). 1441 bytes result sent to driver 2021-12-17 08:48:02 TaskSetManager: INFO: Starting task 81.0 in stage 0.0 (TID 81) (192.168.0.54, executor driver, partition 81, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:02 TaskSetManager: INFO: Finished task 75.0 in stage 0.0 (TID 75) in 3019 ms on 192.168.0.54 (executor driver) (76/175) 2021-12-17 08:48:02 Executor: INFO: Running task 81.0 in stage 0.0 (TID 81) 2021-12-17 08:48:02 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 81.0 in stage 0.0 (TID 81) 2021-12-17 08:48:02 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 81.0 in stage 0.0 (TID 81) 2021-12-17 08:48:02 root: INFO: TaskReport: stage=0, partition=76, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:02 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 76.0 in stage 0.0 (TID 76) 2021-12-17 08:48:02 Executor: INFO: Finished task 76.0 in stage 0.0 (TID 76). 1439 bytes result sent to driver 2021-12-17 08:48:02 TaskSetManager: INFO: Starting task 82.0 in stage 0.0 (TID 82) (192.168.0.54, executor driver, partition 82, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:02 TaskSetManager: INFO: Finished task 76.0 in stage 0.0 (TID 76) in 3141 ms on 192.168.0.54 (executor driver) (77/175) 2021-12-17 08:48:02 Executor: INFO: Running task 82.0 in stage 0.0 (TID 82) 2021-12-17 08:48:02 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 82.0 in stage 0.0 (TID 82) 2021-12-17 08:48:02 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 82.0 in stage 0.0 (TID 82) 2021-12-17 08:48:02 root: INFO: TaskReport: stage=0, partition=77, attempt=0, peakBytes=312064, peakBytesReadable=304.75 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:02 root: INFO: RegionPool: FREE: 304.8K allocated (302.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 77.0 in stage 0.0 (TID 77) 2021-12-17 08:48:02 Executor: INFO: Finished task 77.0 in stage 0.0 (TID 77). 1457 bytes result sent to driver 2021-12-17 08:48:02 TaskSetManager: INFO: Starting task 83.0 in stage 0.0 (TID 83) (192.168.0.54, executor driver, partition 83, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:02 TaskSetManager: INFO: Finished task 77.0 in stage 0.0 (TID 77) in 3232 ms on 192.168.0.54 (executor driver) (78/175) 2021-12-17 08:48:02 Executor: INFO: Running task 83.0 in stage 0.0 (TID 83) 2021-12-17 08:48:02 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 83.0 in stage 0.0 (TID 83) 2021-12-17 08:48:02 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 83.0 in stage 0.0 (TID 83) 2021-12-17 08:48:05 root: INFO: TaskReport: stage=0, partition=78, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:05 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 78.0 in stage 0.0 (TID 78) 2021-12-17 08:48:05 Executor: INFO: Finished task 78.0 in stage 0.0 (TID 78). 1467 bytes result sent to driver 2021-12-17 08:48:05 TaskSetManager: INFO: Starting task 84.0 in stage 0.0 (TID 84) (192.168.0.54, executor driver, partition 84, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:05 TaskSetManager: INFO: Finished task 78.0 in stage 0.0 (TID 78) in 3305 ms on 192.168.0.54 (executor driver) (79/175) 2021-12-17 08:48:05 Executor: INFO: Running task 84.0 in stage 0.0 (TID 84) 2021-12-17 08:48:05 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 84.0 in stage 0.0 (TID 84) 2021-12-17 08:48:05 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 84.0 in stage 0.0 (TID 84) 2021-12-17 08:48:05 root: INFO: TaskReport: stage=0, partition=79, attempt=0, peakBytes=311296, peakBytesReadable=304.00 KiB, chunks requested=5, cache hits=1 2021-12-17 08:48:05 root: INFO: RegionPool: FREE: 304.0K allocated (301.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 79.0 in stage 0.0 (TID 79) 2021-12-17 08:48:05 Executor: INFO: Finished task 79.0 in stage 0.0 (TID 79). 1462 bytes result sent to driver 2021-12-17 08:48:05 TaskSetManager: INFO: Starting task 85.0 in stage 0.0 (TID 85) (192.168.0.54, executor driver, partition 85, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:05 TaskSetManager: INFO: Finished task 79.0 in stage 0.0 (TID 79) in 3289 ms on 192.168.0.54 (executor driver) (80/175) 2021-12-17 08:48:05 Executor: INFO: Running task 85.0 in stage 0.0 (TID 85) 2021-12-17 08:48:05 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 85.0 in stage 0.0 (TID 85) 2021-12-17 08:48:05 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 85.0 in stage 0.0 (TID 85) 2021-12-17 08:48:05 root: INFO: TaskReport: stage=0, partition=80, attempt=0, peakBytes=311040, peakBytesReadable=303.75 KiB, chunks requested=13, cache hits=9 2021-12-17 08:48:05 root: INFO: RegionPool: FREE: 303.8K allocated (301.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 80.0 in stage 0.0 (TID 80) 2021-12-17 08:48:05 Executor: INFO: Finished task 80.0 in stage 0.0 (TID 80). 1475 bytes result sent to driver 2021-12-17 08:48:05 TaskSetManager: INFO: Starting task 86.0 in stage 0.0 (TID 86) (192.168.0.54, executor driver, partition 86, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:05 TaskSetManager: INFO: Finished task 80.0 in stage 0.0 (TID 80) in 3278 ms on 192.168.0.54 (executor driver) (81/175) 2021-12-17 08:48:05 Executor: INFO: Running task 86.0 in stage 0.0 (TID 86) 2021-12-17 08:48:05 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 86.0 in stage 0.0 (TID 86) 2021-12-17 08:48:05 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 86.0 in stage 0.0 (TID 86) 2021-12-17 08:48:05 root: INFO: TaskReport: stage=0, partition=81, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:05 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 81.0 in stage 0.0 (TID 81) 2021-12-17 08:48:05 Executor: INFO: Finished task 81.0 in stage 0.0 (TID 81). 1476 bytes result sent to driver 2021-12-17 08:48:05 TaskSetManager: INFO: Starting task 87.0 in stage 0.0 (TID 87) (192.168.0.54, executor driver, partition 87, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:05 TaskSetManager: INFO: Finished task 81.0 in stage 0.0 (TID 81) in 3242 ms on 192.168.0.54 (executor driver) (82/175) 2021-12-17 08:48:05 Executor: INFO: Running task 87.0 in stage 0.0 (TID 87) 2021-12-17 08:48:05 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 87.0 in stage 0.0 (TID 87) 2021-12-17 08:48:05 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 87.0 in stage 0.0 (TID 87) 2021-12-17 08:48:05 root: INFO: TaskReport: stage=0, partition=82, attempt=0, peakBytes=310016, peakBytesReadable=302.75 KiB, chunks requested=6, cache hits=4 2021-12-17 08:48:05 root: INFO: RegionPool: FREE: 302.8K allocated (300.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 82.0 in stage 0.0 (TID 82) 2021-12-17 08:48:05 Executor: INFO: Finished task 82.0 in stage 0.0 (TID 82). 1479 bytes result sent to driver 2021-12-17 08:48:05 TaskSetManager: INFO: Starting task 88.0 in stage 0.0 (TID 88) (192.168.0.54, executor driver, partition 88, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:05 TaskSetManager: INFO: Finished task 82.0 in stage 0.0 (TID 82) in 3195 ms on 192.168.0.54 (executor driver) (83/175) 2021-12-17 08:48:05 Executor: INFO: Running task 88.0 in stage 0.0 (TID 88) 2021-12-17 08:48:05 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 88.0 in stage 0.0 (TID 88) 2021-12-17 08:48:05 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 88.0 in stage 0.0 (TID 88) 2021-12-17 08:48:05 root: INFO: TaskReport: stage=0, partition=83, attempt=0, peakBytes=312064, peakBytesReadable=304.75 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:05 root: INFO: RegionPool: FREE: 304.8K allocated (302.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 83.0 in stage 0.0 (TID 83) 2021-12-17 08:48:05 Executor: INFO: Finished task 83.0 in stage 0.0 (TID 83). 1464 bytes result sent to driver 2021-12-17 08:48:05 TaskSetManager: INFO: Starting task 89.0 in stage 0.0 (TID 89) (192.168.0.54, executor driver, partition 89, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:05 TaskSetManager: INFO: Finished task 83.0 in stage 0.0 (TID 83) in 3278 ms on 192.168.0.54 (executor driver) (84/175) 2021-12-17 08:48:05 Executor: INFO: Running task 89.0 in stage 0.0 (TID 89) 2021-12-17 08:48:05 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 89.0 in stage 0.0 (TID 89) 2021-12-17 08:48:05 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 89.0 in stage 0.0 (TID 89) 2021-12-17 08:48:08 root: INFO: TaskReport: stage=0, partition=84, attempt=0, peakBytes=307712, peakBytesReadable=300.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:08 root: INFO: RegionPool: FREE: 300.5K allocated (298.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 84.0 in stage 0.0 (TID 84) 2021-12-17 08:48:08 Executor: INFO: Finished task 84.0 in stage 0.0 (TID 84). 1442 bytes result sent to driver 2021-12-17 08:48:08 TaskSetManager: INFO: Starting task 90.0 in stage 0.0 (TID 90) (192.168.0.54, executor driver, partition 90, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:08 TaskSetManager: INFO: Finished task 84.0 in stage 0.0 (TID 84) in 3161 ms on 192.168.0.54 (executor driver) (85/175) 2021-12-17 08:48:08 Executor: INFO: Running task 90.0 in stage 0.0 (TID 90) 2021-12-17 08:48:08 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 90.0 in stage 0.0 (TID 90) 2021-12-17 08:48:08 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 90.0 in stage 0.0 (TID 90) 2021-12-17 08:48:08 root: INFO: TaskReport: stage=0, partition=85, attempt=0, peakBytes=308480, peakBytesReadable=301.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:08 root: INFO: RegionPool: FREE: 301.3K allocated (299.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 85.0 in stage 0.0 (TID 85) 2021-12-17 08:48:08 Executor: INFO: Finished task 85.0 in stage 0.0 (TID 85). 1489 bytes result sent to driver 2021-12-17 08:48:08 TaskSetManager: INFO: Starting task 91.0 in stage 0.0 (TID 91) (192.168.0.54, executor driver, partition 91, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:08 TaskSetManager: INFO: Finished task 85.0 in stage 0.0 (TID 85) in 3124 ms on 192.168.0.54 (executor driver) (86/175) 2021-12-17 08:48:08 Executor: INFO: Running task 91.0 in stage 0.0 (TID 91) 2021-12-17 08:48:08 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 91.0 in stage 0.0 (TID 91) 2021-12-17 08:48:08 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 91.0 in stage 0.0 (TID 91) 2021-12-17 08:48:08 root: INFO: TaskReport: stage=0, partition=87, attempt=0, peakBytes=307456, peakBytesReadable=300.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:08 root: INFO: RegionPool: FREE: 300.3K allocated (298.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 87.0 in stage 0.0 (TID 87) 2021-12-17 08:48:08 Executor: INFO: Finished task 87.0 in stage 0.0 (TID 87). 1454 bytes result sent to driver 2021-12-17 08:48:08 TaskSetManager: INFO: Starting task 92.0 in stage 0.0 (TID 92) (192.168.0.54, executor driver, partition 92, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:08 TaskSetManager: INFO: Finished task 87.0 in stage 0.0 (TID 87) in 3082 ms on 192.168.0.54 (executor driver) (87/175) 2021-12-17 08:48:08 Executor: INFO: Running task 92.0 in stage 0.0 (TID 92) 2021-12-17 08:48:08 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 92.0 in stage 0.0 (TID 92) 2021-12-17 08:48:08 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 92.0 in stage 0.0 (TID 92) 2021-12-17 08:48:08 root: INFO: TaskReport: stage=0, partition=86, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:08 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 86.0 in stage 0.0 (TID 86) 2021-12-17 08:48:08 Executor: INFO: Finished task 86.0 in stage 0.0 (TID 86). 1510 bytes result sent to driver 2021-12-17 08:48:08 TaskSetManager: INFO: Starting task 93.0 in stage 0.0 (TID 93) (192.168.0.54, executor driver, partition 93, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:08 TaskSetManager: INFO: Finished task 86.0 in stage 0.0 (TID 86) in 3187 ms on 192.168.0.54 (executor driver) (88/175) 2021-12-17 08:48:08 Executor: INFO: Running task 93.0 in stage 0.0 (TID 93) 2021-12-17 08:48:08 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 93.0 in stage 0.0 (TID 93) 2021-12-17 08:48:08 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 93.0 in stage 0.0 (TID 93) 2021-12-17 08:48:09 root: INFO: TaskReport: stage=0, partition=89, attempt=0, peakBytes=310016, peakBytesReadable=302.75 KiB, chunks requested=5, cache hits=1 2021-12-17 08:48:09 root: INFO: RegionPool: FREE: 302.8K allocated (300.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 89.0 in stage 0.0 (TID 89) 2021-12-17 08:48:09 Executor: INFO: Finished task 89.0 in stage 0.0 (TID 89). 1533 bytes result sent to driver 2021-12-17 08:48:09 TaskSetManager: INFO: Starting task 94.0 in stage 0.0 (TID 94) (192.168.0.54, executor driver, partition 94, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:09 TaskSetManager: INFO: Finished task 89.0 in stage 0.0 (TID 89) in 3131 ms on 192.168.0.54 (executor driver) (89/175) 2021-12-17 08:48:09 Executor: INFO: Running task 94.0 in stage 0.0 (TID 94) 2021-12-17 08:48:09 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 94.0 in stage 0.0 (TID 94) 2021-12-17 08:48:09 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 94.0 in stage 0.0 (TID 94) 2021-12-17 08:48:09 root: INFO: TaskReport: stage=0, partition=88, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=12, cache hits=10 2021-12-17 08:48:09 root: INFO: RegionPool: FREE: 305.0K allocated (302.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 88.0 in stage 0.0 (TID 88) 2021-12-17 08:48:09 Executor: INFO: Finished task 88.0 in stage 0.0 (TID 88). 1435 bytes result sent to driver 2021-12-17 08:48:09 TaskSetManager: INFO: Starting task 95.0 in stage 0.0 (TID 95) (192.168.0.54, executor driver, partition 95, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:09 TaskSetManager: INFO: Finished task 88.0 in stage 0.0 (TID 88) in 3453 ms on 192.168.0.54 (executor driver) (90/175) 2021-12-17 08:48:09 Executor: INFO: Running task 95.0 in stage 0.0 (TID 95) 2021-12-17 08:48:09 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 95.0 in stage 0.0 (TID 95) 2021-12-17 08:48:09 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 95.0 in stage 0.0 (TID 95) 2021-12-17 08:48:11 root: INFO: TaskReport: stage=0, partition=90, attempt=0, peakBytes=307456, peakBytesReadable=300.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:11 root: INFO: RegionPool: FREE: 300.3K allocated (298.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 90.0 in stage 0.0 (TID 90) 2021-12-17 08:48:11 Executor: INFO: Finished task 90.0 in stage 0.0 (TID 90). 1425 bytes result sent to driver 2021-12-17 08:48:11 TaskSetManager: INFO: Starting task 96.0 in stage 0.0 (TID 96) (192.168.0.54, executor driver, partition 96, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:11 TaskSetManager: INFO: Finished task 90.0 in stage 0.0 (TID 90) in 3029 ms on 192.168.0.54 (executor driver) (91/175) 2021-12-17 08:48:11 Executor: INFO: Running task 96.0 in stage 0.0 (TID 96) 2021-12-17 08:48:11 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 96.0 in stage 0.0 (TID 96) 2021-12-17 08:48:11 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 96.0 in stage 0.0 (TID 96) 2021-12-17 08:48:11 root: INFO: TaskReport: stage=0, partition=91, attempt=0, peakBytes=306688, peakBytesReadable=299.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:11 root: INFO: RegionPool: FREE: 299.5K allocated (297.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 91.0 in stage 0.0 (TID 91) 2021-12-17 08:48:11 Executor: INFO: Finished task 91.0 in stage 0.0 (TID 91). 1419 bytes result sent to driver 2021-12-17 08:48:11 TaskSetManager: INFO: Starting task 97.0 in stage 0.0 (TID 97) (192.168.0.54, executor driver, partition 97, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:11 TaskSetManager: INFO: Finished task 91.0 in stage 0.0 (TID 91) in 3001 ms on 192.168.0.54 (executor driver) (92/175) 2021-12-17 08:48:11 Executor: INFO: Running task 97.0 in stage 0.0 (TID 97) 2021-12-17 08:48:11 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 97.0 in stage 0.0 (TID 97) 2021-12-17 08:48:11 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 97.0 in stage 0.0 (TID 97) 2021-12-17 08:48:11 root: INFO: TaskReport: stage=0, partition=93, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=7, cache hits=4 2021-12-17 08:48:11 root: INFO: RegionPool: FREE: 305.0K allocated (302.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 93.0 in stage 0.0 (TID 93) 2021-12-17 08:48:11 Executor: INFO: Finished task 93.0 in stage 0.0 (TID 93). 1516 bytes result sent to driver 2021-12-17 08:48:11 TaskSetManager: INFO: Starting task 98.0 in stage 0.0 (TID 98) (192.168.0.54, executor driver, partition 98, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:11 TaskSetManager: INFO: Finished task 93.0 in stage 0.0 (TID 93) in 3026 ms on 192.168.0.54 (executor driver) (93/175) 2021-12-17 08:48:11 Executor: INFO: Running task 98.0 in stage 0.0 (TID 98) 2021-12-17 08:48:11 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 98.0 in stage 0.0 (TID 98) 2021-12-17 08:48:11 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 98.0 in stage 0.0 (TID 98) 2021-12-17 08:48:11 root: INFO: TaskReport: stage=0, partition=92, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=3, cache hits=1 2021-12-17 08:48:11 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 92.0 in stage 0.0 (TID 92) 2021-12-17 08:48:11 Executor: INFO: Finished task 92.0 in stage 0.0 (TID 92). 1421 bytes result sent to driver 2021-12-17 08:48:11 TaskSetManager: INFO: Starting task 99.0 in stage 0.0 (TID 99) (192.168.0.54, executor driver, partition 99, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:11 TaskSetManager: INFO: Finished task 92.0 in stage 0.0 (TID 92) in 3143 ms on 192.168.0.54 (executor driver) (94/175) 2021-12-17 08:48:11 Executor: INFO: Running task 99.0 in stage 0.0 (TID 99) 2021-12-17 08:48:11 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 99.0 in stage 0.0 (TID 99) 2021-12-17 08:48:11 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 99.0 in stage 0.0 (TID 99) 2021-12-17 08:48:12 root: INFO: TaskReport: stage=0, partition=94, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=6, cache hits=3 2021-12-17 08:48:12 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 94.0 in stage 0.0 (TID 94) 2021-12-17 08:48:12 Executor: INFO: Finished task 94.0 in stage 0.0 (TID 94). 1467 bytes result sent to driver 2021-12-17 08:48:12 TaskSetManager: INFO: Starting task 100.0 in stage 0.0 (TID 100) (192.168.0.54, executor driver, partition 100, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:12 TaskSetManager: INFO: Finished task 94.0 in stage 0.0 (TID 94) in 3050 ms on 192.168.0.54 (executor driver) (95/175) 2021-12-17 08:48:12 Executor: INFO: Running task 100.0 in stage 0.0 (TID 100) 2021-12-17 08:48:12 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 100.0 in stage 0.0 (TID 100) 2021-12-17 08:48:12 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 100.0 in stage 0.0 (TID 100) 2021-12-17 08:48:12 root: INFO: TaskReport: stage=0, partition=95, attempt=0, peakBytes=310016, peakBytesReadable=302.75 KiB, chunks requested=3, cache hits=1 2021-12-17 08:48:12 root: INFO: RegionPool: FREE: 302.8K allocated (300.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 95.0 in stage 0.0 (TID 95) 2021-12-17 08:48:12 Executor: INFO: Finished task 95.0 in stage 0.0 (TID 95). 1440 bytes result sent to driver 2021-12-17 08:48:12 TaskSetManager: INFO: Starting task 101.0 in stage 0.0 (TID 101) (192.168.0.54, executor driver, partition 101, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:12 TaskSetManager: INFO: Finished task 95.0 in stage 0.0 (TID 95) in 3092 ms on 192.168.0.54 (executor driver) (96/175) 2021-12-17 08:48:12 Executor: INFO: Running task 101.0 in stage 0.0 (TID 101) 2021-12-17 08:48:12 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 101.0 in stage 0.0 (TID 101) 2021-12-17 08:48:12 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 101.0 in stage 0.0 (TID 101) 2021-12-17 08:48:14 root: INFO: TaskReport: stage=0, partition=97, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=19, cache hits=14 2021-12-17 08:48:14 root: INFO: RegionPool: FREE: 307.5K allocated (304.5K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 97.0 in stage 0.0 (TID 97) 2021-12-17 08:48:14 Executor: INFO: Finished task 97.0 in stage 0.0 (TID 97). 1483 bytes result sent to driver 2021-12-17 08:48:14 TaskSetManager: INFO: Starting task 102.0 in stage 0.0 (TID 102) (192.168.0.54, executor driver, partition 102, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:14 TaskSetManager: INFO: Finished task 97.0 in stage 0.0 (TID 97) in 3187 ms on 192.168.0.54 (executor driver) (97/175) 2021-12-17 08:48:14 Executor: INFO: Running task 102.0 in stage 0.0 (TID 102) 2021-12-17 08:48:14 root: INFO: TaskReport: stage=0, partition=96, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=25, cache hits=20 2021-12-17 08:48:14 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 96.0 in stage 0.0 (TID 96) 2021-12-17 08:48:14 Executor: INFO: Finished task 96.0 in stage 0.0 (TID 96). 1478 bytes result sent to driver 2021-12-17 08:48:14 TaskSetManager: INFO: Starting task 103.0 in stage 0.0 (TID 103) (192.168.0.54, executor driver, partition 103, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:14 TaskSetManager: INFO: Finished task 96.0 in stage 0.0 (TID 96) in 3344 ms on 192.168.0.54 (executor driver) (98/175) 2021-12-17 08:48:14 Executor: INFO: Running task 103.0 in stage 0.0 (TID 103) 2021-12-17 08:48:14 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 102.0 in stage 0.0 (TID 102) 2021-12-17 08:48:14 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 102.0 in stage 0.0 (TID 102) 2021-12-17 08:48:14 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 103.0 in stage 0.0 (TID 103) 2021-12-17 08:48:14 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 103.0 in stage 0.0 (TID 103) 2021-12-17 08:48:14 root: INFO: TaskReport: stage=0, partition=98, attempt=0, peakBytes=314368, peakBytesReadable=307.00 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:14 root: INFO: RegionPool: FREE: 307.0K allocated (304.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 98.0 in stage 0.0 (TID 98) 2021-12-17 08:48:14 Executor: INFO: Finished task 98.0 in stage 0.0 (TID 98). 1528 bytes result sent to driver 2021-12-17 08:48:14 TaskSetManager: INFO: Starting task 104.0 in stage 0.0 (TID 104) (192.168.0.54, executor driver, partition 104, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:14 TaskSetManager: INFO: Finished task 98.0 in stage 0.0 (TID 98) in 3243 ms on 192.168.0.54 (executor driver) (99/175) 2021-12-17 08:48:14 Executor: INFO: Running task 104.0 in stage 0.0 (TID 104) 2021-12-17 08:48:14 root: INFO: TaskReport: stage=0, partition=99, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:14 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 99.0 in stage 0.0 (TID 99) 2021-12-17 08:48:14 Executor: INFO: Finished task 99.0 in stage 0.0 (TID 99). 1483 bytes result sent to driver 2021-12-17 08:48:14 TaskSetManager: INFO: Starting task 105.0 in stage 0.0 (TID 105) (192.168.0.54, executor driver, partition 105, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:14 TaskSetManager: INFO: Finished task 99.0 in stage 0.0 (TID 99) in 3211 ms on 192.168.0.54 (executor driver) (100/175) 2021-12-17 08:48:14 Executor: INFO: Running task 105.0 in stage 0.0 (TID 105) 2021-12-17 08:48:14 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 104.0 in stage 0.0 (TID 104) 2021-12-17 08:48:14 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 104.0 in stage 0.0 (TID 104) 2021-12-17 08:48:14 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 105.0 in stage 0.0 (TID 105) 2021-12-17 08:48:14 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 105.0 in stage 0.0 (TID 105) 2021-12-17 08:48:15 root: INFO: TaskReport: stage=0, partition=100, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=13, cache hits=9 2021-12-17 08:48:15 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 100.0 in stage 0.0 (TID 100) 2021-12-17 08:48:15 Executor: INFO: Finished task 100.0 in stage 0.0 (TID 100). 1491 bytes result sent to driver 2021-12-17 08:48:15 TaskSetManager: INFO: Starting task 106.0 in stage 0.0 (TID 106) (192.168.0.54, executor driver, partition 106, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:15 TaskSetManager: INFO: Finished task 100.0 in stage 0.0 (TID 100) in 3267 ms on 192.168.0.54 (executor driver) (101/175) 2021-12-17 08:48:15 Executor: INFO: Running task 106.0 in stage 0.0 (TID 106) 2021-12-17 08:48:15 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 106.0 in stage 0.0 (TID 106) 2021-12-17 08:48:15 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 106.0 in stage 0.0 (TID 106) 2021-12-17 08:48:15 root: INFO: TaskReport: stage=0, partition=101, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:15 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 101.0 in stage 0.0 (TID 101) 2021-12-17 08:48:15 Executor: INFO: Finished task 101.0 in stage 0.0 (TID 101). 1493 bytes result sent to driver 2021-12-17 08:48:15 TaskSetManager: INFO: Starting task 107.0 in stage 0.0 (TID 107) (192.168.0.54, executor driver, partition 107, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:15 TaskSetManager: INFO: Finished task 101.0 in stage 0.0 (TID 101) in 3182 ms on 192.168.0.54 (executor driver) (102/175) 2021-12-17 08:48:15 Executor: INFO: Running task 107.0 in stage 0.0 (TID 107) 2021-12-17 08:48:15 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 107.0 in stage 0.0 (TID 107) 2021-12-17 08:48:15 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 107.0 in stage 0.0 (TID 107) 2021-12-17 08:48:17 root: INFO: TaskReport: stage=0, partition=103, attempt=0, peakBytes=315904, peakBytesReadable=308.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:17 root: INFO: RegionPool: FREE: 308.5K allocated (306.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 103.0 in stage 0.0 (TID 103) 2021-12-17 08:48:17 Executor: INFO: Finished task 103.0 in stage 0.0 (TID 103). 1454 bytes result sent to driver 2021-12-17 08:48:17 TaskSetManager: INFO: Starting task 108.0 in stage 0.0 (TID 108) (192.168.0.54, executor driver, partition 108, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:17 TaskSetManager: INFO: Finished task 103.0 in stage 0.0 (TID 103) in 3131 ms on 192.168.0.54 (executor driver) (103/175) 2021-12-17 08:48:17 Executor: INFO: Running task 108.0 in stage 0.0 (TID 108) 2021-12-17 08:48:17 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 108.0 in stage 0.0 (TID 108) 2021-12-17 08:48:17 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 108.0 in stage 0.0 (TID 108) 2021-12-17 08:48:18 root: INFO: TaskReport: stage=0, partition=104, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:18 root: INFO: RegionPool: FREE: 307.5K allocated (305.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 104.0 in stage 0.0 (TID 104) 2021-12-17 08:48:18 Executor: INFO: Finished task 104.0 in stage 0.0 (TID 104). 1446 bytes result sent to driver 2021-12-17 08:48:18 TaskSetManager: INFO: Starting task 109.0 in stage 0.0 (TID 109) (192.168.0.54, executor driver, partition 109, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:18 TaskSetManager: INFO: Finished task 104.0 in stage 0.0 (TID 104) in 3101 ms on 192.168.0.54 (executor driver) (104/175) 2021-12-17 08:48:18 Executor: INFO: Running task 109.0 in stage 0.0 (TID 109) 2021-12-17 08:48:18 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 109.0 in stage 0.0 (TID 109) 2021-12-17 08:48:18 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 109.0 in stage 0.0 (TID 109) 2021-12-17 08:48:18 root: INFO: TaskReport: stage=0, partition=102, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=3, cache hits=1 2021-12-17 08:48:18 root: INFO: RegionPool: FREE: 305.0K allocated (302.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 102.0 in stage 0.0 (TID 102) 2021-12-17 08:48:18 Executor: INFO: Finished task 102.0 in stage 0.0 (TID 102). 1478 bytes result sent to driver 2021-12-17 08:48:18 TaskSetManager: INFO: Starting task 110.0 in stage 0.0 (TID 110) (192.168.0.54, executor driver, partition 110, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:18 TaskSetManager: INFO: Finished task 102.0 in stage 0.0 (TID 102) in 3336 ms on 192.168.0.54 (executor driver) (105/175) 2021-12-17 08:48:18 Executor: INFO: Running task 110.0 in stage 0.0 (TID 110) 2021-12-17 08:48:18 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 110.0 in stage 0.0 (TID 110) 2021-12-17 08:48:18 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 110.0 in stage 0.0 (TID 110) 2021-12-17 08:48:18 root: INFO: TaskReport: stage=0, partition=105, attempt=0, peakBytes=316416, peakBytesReadable=309.00 KiB, chunks requested=22, cache hits=18 2021-12-17 08:48:18 root: INFO: RegionPool: FREE: 309.0K allocated (306.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 105.0 in stage 0.0 (TID 105) 2021-12-17 08:48:18 Executor: INFO: Finished task 105.0 in stage 0.0 (TID 105). 1435 bytes result sent to driver 2021-12-17 08:48:18 TaskSetManager: INFO: Starting task 111.0 in stage 0.0 (TID 111) (192.168.0.54, executor driver, partition 111, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:18 TaskSetManager: INFO: Finished task 105.0 in stage 0.0 (TID 105) in 3162 ms on 192.168.0.54 (executor driver) (106/175) 2021-12-17 08:48:18 Executor: INFO: Running task 111.0 in stage 0.0 (TID 111) 2021-12-17 08:48:18 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 111.0 in stage 0.0 (TID 111) 2021-12-17 08:48:18 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 111.0 in stage 0.0 (TID 111) 2021-12-17 08:48:18 root: INFO: TaskReport: stage=0, partition=106, attempt=0, peakBytes=313856, peakBytesReadable=306.50 KiB, chunks requested=4, cache hits=2 2021-12-17 08:48:18 root: INFO: RegionPool: FREE: 306.5K allocated (304.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 106.0 in stage 0.0 (TID 106) 2021-12-17 08:48:18 Executor: INFO: Finished task 106.0 in stage 0.0 (TID 106). 1445 bytes result sent to driver 2021-12-17 08:48:18 TaskSetManager: INFO: Starting task 112.0 in stage 0.0 (TID 112) (192.168.0.54, executor driver, partition 112, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:18 TaskSetManager: INFO: Finished task 106.0 in stage 0.0 (TID 106) in 3199 ms on 192.168.0.54 (executor driver) (107/175) 2021-12-17 08:48:18 Executor: INFO: Running task 112.0 in stage 0.0 (TID 112) 2021-12-17 08:48:18 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 112.0 in stage 0.0 (TID 112) 2021-12-17 08:48:18 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 112.0 in stage 0.0 (TID 112) 2021-12-17 08:48:18 root: INFO: TaskReport: stage=0, partition=107, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=12, cache hits=8 2021-12-17 08:48:18 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 107.0 in stage 0.0 (TID 107) 2021-12-17 08:48:18 Executor: INFO: Finished task 107.0 in stage 0.0 (TID 107). 1519 bytes result sent to driver 2021-12-17 08:48:18 TaskSetManager: INFO: Starting task 113.0 in stage 0.0 (TID 113) (192.168.0.54, executor driver, partition 113, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:18 TaskSetManager: INFO: Finished task 107.0 in stage 0.0 (TID 107) in 3153 ms on 192.168.0.54 (executor driver) (108/175) 2021-12-17 08:48:18 Executor: INFO: Running task 113.0 in stage 0.0 (TID 113) 2021-12-17 08:48:18 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 113.0 in stage 0.0 (TID 113) 2021-12-17 08:48:18 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 113.0 in stage 0.0 (TID 113) 2021-12-17 08:48:21 root: INFO: TaskReport: stage=0, partition=108, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:21 root: INFO: RegionPool: FREE: 305.8K allocated (303.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 108.0 in stage 0.0 (TID 108) 2021-12-17 08:48:21 Executor: INFO: Finished task 108.0 in stage 0.0 (TID 108). 1558 bytes result sent to driver 2021-12-17 08:48:21 TaskSetManager: INFO: Starting task 114.0 in stage 0.0 (TID 114) (192.168.0.54, executor driver, partition 114, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:21 TaskSetManager: INFO: Finished task 108.0 in stage 0.0 (TID 108) in 3243 ms on 192.168.0.54 (executor driver) (109/175) 2021-12-17 08:48:21 Executor: INFO: Running task 114.0 in stage 0.0 (TID 114) 2021-12-17 08:48:21 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 114.0 in stage 0.0 (TID 114) 2021-12-17 08:48:21 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 114.0 in stage 0.0 (TID 114) 2021-12-17 08:48:21 root: INFO: TaskReport: stage=0, partition=111, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:21 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 111.0 in stage 0.0 (TID 111) 2021-12-17 08:48:21 Executor: INFO: Finished task 111.0 in stage 0.0 (TID 111). 1472 bytes result sent to driver 2021-12-17 08:48:21 TaskSetManager: INFO: Starting task 115.0 in stage 0.0 (TID 115) (192.168.0.54, executor driver, partition 115, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:21 TaskSetManager: INFO: Finished task 111.0 in stage 0.0 (TID 111) in 3050 ms on 192.168.0.54 (executor driver) (110/175) 2021-12-17 08:48:21 Executor: INFO: Running task 115.0 in stage 0.0 (TID 115) 2021-12-17 08:48:21 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 115.0 in stage 0.0 (TID 115) 2021-12-17 08:48:21 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 115.0 in stage 0.0 (TID 115) 2021-12-17 08:48:21 root: INFO: TaskReport: stage=0, partition=109, attempt=0, peakBytes=315136, peakBytesReadable=307.75 KiB, chunks requested=8, cache hits=5 2021-12-17 08:48:21 root: INFO: RegionPool: FREE: 307.8K allocated (305.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 109.0 in stage 0.0 (TID 109) 2021-12-17 08:48:21 Executor: INFO: Finished task 109.0 in stage 0.0 (TID 109). 1453 bytes result sent to driver 2021-12-17 08:48:21 TaskSetManager: INFO: Starting task 116.0 in stage 0.0 (TID 116) (192.168.0.54, executor driver, partition 116, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:21 TaskSetManager: INFO: Finished task 109.0 in stage 0.0 (TID 109) in 3165 ms on 192.168.0.54 (executor driver) (111/175) 2021-12-17 08:48:21 Executor: INFO: Running task 116.0 in stage 0.0 (TID 116) 2021-12-17 08:48:21 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 116.0 in stage 0.0 (TID 116) 2021-12-17 08:48:21 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 116.0 in stage 0.0 (TID 116) 2021-12-17 08:48:21 root: INFO: TaskReport: stage=0, partition=110, attempt=0, peakBytes=313856, peakBytesReadable=306.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:21 root: INFO: RegionPool: FREE: 306.5K allocated (304.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 110.0 in stage 0.0 (TID 110) 2021-12-17 08:48:21 Executor: INFO: Finished task 110.0 in stage 0.0 (TID 110). 1467 bytes result sent to driver 2021-12-17 08:48:21 TaskSetManager: INFO: Starting task 117.0 in stage 0.0 (TID 117) (192.168.0.54, executor driver, partition 117, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:21 TaskSetManager: INFO: Finished task 110.0 in stage 0.0 (TID 110) in 3202 ms on 192.168.0.54 (executor driver) (112/175) 2021-12-17 08:48:21 Executor: INFO: Running task 117.0 in stage 0.0 (TID 117) 2021-12-17 08:48:21 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 117.0 in stage 0.0 (TID 117) 2021-12-17 08:48:21 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 117.0 in stage 0.0 (TID 117) 2021-12-17 08:48:21 root: INFO: TaskReport: stage=0, partition=112, attempt=0, peakBytes=313856, peakBytesReadable=306.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:21 root: INFO: RegionPool: FREE: 306.5K allocated (304.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 112.0 in stage 0.0 (TID 112) 2021-12-17 08:48:21 Executor: INFO: Finished task 112.0 in stage 0.0 (TID 112). 1438 bytes result sent to driver 2021-12-17 08:48:21 TaskSetManager: INFO: Starting task 118.0 in stage 0.0 (TID 118) (192.168.0.54, executor driver, partition 118, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:21 TaskSetManager: INFO: Finished task 112.0 in stage 0.0 (TID 112) in 3175 ms on 192.168.0.54 (executor driver) (113/175) 2021-12-17 08:48:21 Executor: INFO: Running task 118.0 in stage 0.0 (TID 118) 2021-12-17 08:48:21 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 118.0 in stage 0.0 (TID 118) 2021-12-17 08:48:21 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 118.0 in stage 0.0 (TID 118) 2021-12-17 08:48:21 root: INFO: TaskReport: stage=0, partition=113, attempt=0, peakBytes=313344, peakBytesReadable=306.00 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:21 root: INFO: RegionPool: FREE: 306.0K allocated (303.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 113.0 in stage 0.0 (TID 113) 2021-12-17 08:48:21 Executor: INFO: Finished task 113.0 in stage 0.0 (TID 113). 1461 bytes result sent to driver 2021-12-17 08:48:21 TaskSetManager: INFO: Starting task 119.0 in stage 0.0 (TID 119) (192.168.0.54, executor driver, partition 119, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:21 TaskSetManager: INFO: Finished task 113.0 in stage 0.0 (TID 113) in 3283 ms on 192.168.0.54 (executor driver) (114/175) 2021-12-17 08:48:21 Executor: INFO: Running task 119.0 in stage 0.0 (TID 119) 2021-12-17 08:48:21 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 119.0 in stage 0.0 (TID 119) 2021-12-17 08:48:21 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 119.0 in stage 0.0 (TID 119) 2021-12-17 08:48:24 root: INFO: TaskReport: stage=0, partition=114, attempt=0, peakBytes=313600, peakBytesReadable=306.25 KiB, chunks requested=4, cache hits=1 2021-12-17 08:48:24 root: INFO: RegionPool: FREE: 306.3K allocated (303.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 114.0 in stage 0.0 (TID 114) 2021-12-17 08:48:24 Executor: INFO: Finished task 114.0 in stage 0.0 (TID 114). 1439 bytes result sent to driver 2021-12-17 08:48:24 TaskSetManager: INFO: Starting task 120.0 in stage 0.0 (TID 120) (192.168.0.54, executor driver, partition 120, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:24 TaskSetManager: INFO: Finished task 114.0 in stage 0.0 (TID 114) in 3164 ms on 192.168.0.54 (executor driver) (115/175) 2021-12-17 08:48:24 Executor: INFO: Running task 120.0 in stage 0.0 (TID 120) 2021-12-17 08:48:24 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 120.0 in stage 0.0 (TID 120) 2021-12-17 08:48:24 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 120.0 in stage 0.0 (TID 120) 2021-12-17 08:48:24 root: INFO: TaskReport: stage=0, partition=115, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:24 root: INFO: RegionPool: FREE: 307.5K allocated (305.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 115.0 in stage 0.0 (TID 115) 2021-12-17 08:48:24 Executor: INFO: Finished task 115.0 in stage 0.0 (TID 115). 1443 bytes result sent to driver 2021-12-17 08:48:24 TaskSetManager: INFO: Starting task 121.0 in stage 0.0 (TID 121) (192.168.0.54, executor driver, partition 121, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:24 TaskSetManager: INFO: Finished task 115.0 in stage 0.0 (TID 115) in 3175 ms on 192.168.0.54 (executor driver) (116/175) 2021-12-17 08:48:24 Executor: INFO: Running task 121.0 in stage 0.0 (TID 121) 2021-12-17 08:48:24 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 121.0 in stage 0.0 (TID 121) 2021-12-17 08:48:24 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 121.0 in stage 0.0 (TID 121) 2021-12-17 08:48:24 root: INFO: TaskReport: stage=0, partition=116, attempt=0, peakBytes=313600, peakBytesReadable=306.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:24 root: INFO: RegionPool: FREE: 306.3K allocated (304.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 116.0 in stage 0.0 (TID 116) 2021-12-17 08:48:24 Executor: INFO: Finished task 116.0 in stage 0.0 (TID 116). 1449 bytes result sent to driver 2021-12-17 08:48:24 TaskSetManager: INFO: Starting task 122.0 in stage 0.0 (TID 122) (192.168.0.54, executor driver, partition 122, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:24 TaskSetManager: INFO: Finished task 116.0 in stage 0.0 (TID 116) in 3210 ms on 192.168.0.54 (executor driver) (117/175) 2021-12-17 08:48:24 Executor: INFO: Running task 122.0 in stage 0.0 (TID 122) 2021-12-17 08:48:24 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 122.0 in stage 0.0 (TID 122) 2021-12-17 08:48:24 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 122.0 in stage 0.0 (TID 122) 2021-12-17 08:48:24 root: INFO: TaskReport: stage=0, partition=117, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=5, cache hits=3 2021-12-17 08:48:24 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 117.0 in stage 0.0 (TID 117) 2021-12-17 08:48:24 Executor: INFO: Finished task 117.0 in stage 0.0 (TID 117). 1451 bytes result sent to driver 2021-12-17 08:48:24 TaskSetManager: INFO: Starting task 123.0 in stage 0.0 (TID 123) (192.168.0.54, executor driver, partition 123, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:24 TaskSetManager: INFO: Finished task 117.0 in stage 0.0 (TID 117) in 3182 ms on 192.168.0.54 (executor driver) (118/175) 2021-12-17 08:48:24 Executor: INFO: Running task 123.0 in stage 0.0 (TID 123) 2021-12-17 08:48:24 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 123.0 in stage 0.0 (TID 123) 2021-12-17 08:48:24 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 123.0 in stage 0.0 (TID 123) 2021-12-17 08:48:25 root: INFO: TaskReport: stage=0, partition=118, attempt=0, peakBytes=314624, peakBytesReadable=307.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:25 root: INFO: RegionPool: FREE: 307.3K allocated (305.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 118.0 in stage 0.0 (TID 118) 2021-12-17 08:48:25 Executor: INFO: Finished task 118.0 in stage 0.0 (TID 118). 1501 bytes result sent to driver 2021-12-17 08:48:25 TaskSetManager: INFO: Starting task 124.0 in stage 0.0 (TID 124) (192.168.0.54, executor driver, partition 124, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:25 TaskSetManager: INFO: Finished task 118.0 in stage 0.0 (TID 118) in 3264 ms on 192.168.0.54 (executor driver) (119/175) 2021-12-17 08:48:25 Executor: INFO: Running task 124.0 in stage 0.0 (TID 124) 2021-12-17 08:48:25 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 124.0 in stage 0.0 (TID 124) 2021-12-17 08:48:25 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 124.0 in stage 0.0 (TID 124) 2021-12-17 08:48:25 root: INFO: TaskReport: stage=0, partition=119, attempt=0, peakBytes=312576, peakBytesReadable=305.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:25 root: INFO: RegionPool: FREE: 305.3K allocated (303.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 119.0 in stage 0.0 (TID 119) 2021-12-17 08:48:25 Executor: INFO: Finished task 119.0 in stage 0.0 (TID 119). 1500 bytes result sent to driver 2021-12-17 08:48:25 TaskSetManager: INFO: Starting task 125.0 in stage 0.0 (TID 125) (192.168.0.54, executor driver, partition 125, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:25 TaskSetManager: INFO: Finished task 119.0 in stage 0.0 (TID 119) in 3275 ms on 192.168.0.54 (executor driver) (120/175) 2021-12-17 08:48:25 Executor: INFO: Running task 125.0 in stage 0.0 (TID 125) 2021-12-17 08:48:25 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 125.0 in stage 0.0 (TID 125) 2021-12-17 08:48:25 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 125.0 in stage 0.0 (TID 125) 2021-12-17 08:48:27 root: INFO: TaskReport: stage=0, partition=120, attempt=0, peakBytes=313856, peakBytesReadable=306.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:27 root: INFO: RegionPool: FREE: 306.5K allocated (304.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 120.0 in stage 0.0 (TID 120) 2021-12-17 08:48:27 Executor: INFO: Finished task 120.0 in stage 0.0 (TID 120). 1543 bytes result sent to driver 2021-12-17 08:48:27 TaskSetManager: INFO: Starting task 126.0 in stage 0.0 (TID 126) (192.168.0.54, executor driver, partition 126, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:27 Executor: INFO: Running task 126.0 in stage 0.0 (TID 126) 2021-12-17 08:48:27 TaskSetManager: INFO: Finished task 120.0 in stage 0.0 (TID 120) in 3225 ms on 192.168.0.54 (executor driver) (121/175) 2021-12-17 08:48:27 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 126.0 in stage 0.0 (TID 126) 2021-12-17 08:48:27 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 126.0 in stage 0.0 (TID 126) 2021-12-17 08:48:27 root: INFO: TaskReport: stage=0, partition=121, attempt=0, peakBytes=321024, peakBytesReadable=313.50 KiB, chunks requested=12, cache hits=7 2021-12-17 08:48:27 root: INFO: RegionPool: FREE: 313.5K allocated (310.5K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 121.0 in stage 0.0 (TID 121) 2021-12-17 08:48:27 Executor: INFO: Finished task 121.0 in stage 0.0 (TID 121). 1505 bytes result sent to driver 2021-12-17 08:48:27 TaskSetManager: INFO: Starting task 127.0 in stage 0.0 (TID 127) (192.168.0.54, executor driver, partition 127, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:27 Executor: INFO: Running task 127.0 in stage 0.0 (TID 127) 2021-12-17 08:48:27 TaskSetManager: INFO: Finished task 121.0 in stage 0.0 (TID 121) in 3202 ms on 192.168.0.54 (executor driver) (122/175) 2021-12-17 08:48:27 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 127.0 in stage 0.0 (TID 127) 2021-12-17 08:48:27 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 127.0 in stage 0.0 (TID 127) 2021-12-17 08:48:27 root: INFO: TaskReport: stage=0, partition=123, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=4, cache hits=2 2021-12-17 08:48:27 root: INFO: RegionPool: FREE: 307.5K allocated (305.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 123.0 in stage 0.0 (TID 123) 2021-12-17 08:48:27 Executor: INFO: Finished task 123.0 in stage 0.0 (TID 123). 1500 bytes result sent to driver 2021-12-17 08:48:27 TaskSetManager: INFO: Starting task 128.0 in stage 0.0 (TID 128) (192.168.0.54, executor driver, partition 128, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:27 TaskSetManager: INFO: Finished task 123.0 in stage 0.0 (TID 123) in 3096 ms on 192.168.0.54 (executor driver) (123/175) 2021-12-17 08:48:27 Executor: INFO: Running task 128.0 in stage 0.0 (TID 128) 2021-12-17 08:48:27 root: INFO: TaskReport: stage=0, partition=122, attempt=0, peakBytes=313088, peakBytesReadable=305.75 KiB, chunks requested=4, cache hits=2 2021-12-17 08:48:27 root: INFO: RegionPool: FREE: 305.8K allocated (303.3K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 122.0 in stage 0.0 (TID 122) 2021-12-17 08:48:27 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 128.0 in stage 0.0 (TID 128) 2021-12-17 08:48:27 Executor: INFO: Finished task 122.0 in stage 0.0 (TID 122). 1498 bytes result sent to driver 2021-12-17 08:48:27 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 128.0 in stage 0.0 (TID 128) 2021-12-17 08:48:27 TaskSetManager: INFO: Starting task 129.0 in stage 0.0 (TID 129) (192.168.0.54, executor driver, partition 129, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:27 TaskSetManager: INFO: Finished task 122.0 in stage 0.0 (TID 122) in 3153 ms on 192.168.0.54 (executor driver) (124/175) 2021-12-17 08:48:27 Executor: INFO: Running task 129.0 in stage 0.0 (TID 129) 2021-12-17 08:48:27 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 129.0 in stage 0.0 (TID 129) 2021-12-17 08:48:27 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 129.0 in stage 0.0 (TID 129) 2021-12-17 08:48:28 root: INFO: TaskReport: stage=0, partition=124, attempt=0, peakBytes=312320, peakBytesReadable=305.00 KiB, chunks requested=3, cache hits=1 2021-12-17 08:48:28 root: INFO: RegionPool: FREE: 305.0K allocated (302.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 124.0 in stage 0.0 (TID 124) 2021-12-17 08:48:28 Executor: INFO: Finished task 124.0 in stage 0.0 (TID 124). 1449 bytes result sent to driver 2021-12-17 08:48:28 TaskSetManager: INFO: Starting task 130.0 in stage 0.0 (TID 130) (192.168.0.54, executor driver, partition 130, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:28 TaskSetManager: INFO: Finished task 124.0 in stage 0.0 (TID 124) in 3109 ms on 192.168.0.54 (executor driver) (125/175) 2021-12-17 08:48:28 Executor: INFO: Running task 130.0 in stage 0.0 (TID 130) 2021-12-17 08:48:28 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 130.0 in stage 0.0 (TID 130) 2021-12-17 08:48:28 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 130.0 in stage 0.0 (TID 130) 2021-12-17 08:48:28 root: INFO: TaskReport: stage=0, partition=125, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:28 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 125.0 in stage 0.0 (TID 125) 2021-12-17 08:48:28 Executor: INFO: Finished task 125.0 in stage 0.0 (TID 125). 1505 bytes result sent to driver 2021-12-17 08:48:28 TaskSetManager: INFO: Starting task 131.0 in stage 0.0 (TID 131) (192.168.0.54, executor driver, partition 131, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:28 TaskSetManager: INFO: Finished task 125.0 in stage 0.0 (TID 125) in 2983 ms on 192.168.0.54 (executor driver) (126/175) 2021-12-17 08:48:28 Executor: INFO: Running task 131.0 in stage 0.0 (TID 131) 2021-12-17 08:48:28 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 131.0 in stage 0.0 (TID 131) 2021-12-17 08:48:28 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 131.0 in stage 0.0 (TID 131) 2021-12-17 08:48:30 root: INFO: TaskReport: stage=0, partition=126, attempt=0, peakBytes=313856, peakBytesReadable=306.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:30 root: INFO: RegionPool: FREE: 306.5K allocated (304.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 126.0 in stage 0.0 (TID 126) 2021-12-17 08:48:30 Executor: INFO: Finished task 126.0 in stage 0.0 (TID 126). 1501 bytes result sent to driver 2021-12-17 08:48:30 TaskSetManager: INFO: Starting task 132.0 in stage 0.0 (TID 132) (192.168.0.54, executor driver, partition 132, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:30 TaskSetManager: INFO: Finished task 126.0 in stage 0.0 (TID 126) in 3132 ms on 192.168.0.54 (executor driver) (127/175) 2021-12-17 08:48:30 Executor: INFO: Running task 132.0 in stage 0.0 (TID 132) 2021-12-17 08:48:30 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 132.0 in stage 0.0 (TID 132) 2021-12-17 08:48:30 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 132.0 in stage 0.0 (TID 132) 2021-12-17 08:48:30 root: INFO: TaskReport: stage=0, partition=127, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=7, cache hits=4 2021-12-17 08:48:30 root: INFO: RegionPool: FREE: 307.5K allocated (305.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 127.0 in stage 0.0 (TID 127) 2021-12-17 08:48:30 Executor: INFO: Finished task 127.0 in stage 0.0 (TID 127). 1492 bytes result sent to driver 2021-12-17 08:48:30 TaskSetManager: INFO: Starting task 133.0 in stage 0.0 (TID 133) (192.168.0.54, executor driver, partition 133, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:30 TaskSetManager: INFO: Finished task 127.0 in stage 0.0 (TID 127) in 3285 ms on 192.168.0.54 (executor driver) (128/175) 2021-12-17 08:48:30 Executor: INFO: Running task 133.0 in stage 0.0 (TID 133) 2021-12-17 08:48:30 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 133.0 in stage 0.0 (TID 133) 2021-12-17 08:48:30 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 133.0 in stage 0.0 (TID 133) 2021-12-17 08:48:30 root: INFO: TaskReport: stage=0, partition=129, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:30 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 129.0 in stage 0.0 (TID 129) 2021-12-17 08:48:30 Executor: INFO: Finished task 129.0 in stage 0.0 (TID 129). 1438 bytes result sent to driver 2021-12-17 08:48:30 TaskSetManager: INFO: Starting task 134.0 in stage 0.0 (TID 134) (192.168.0.54, executor driver, partition 134, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:30 TaskSetManager: INFO: Finished task 129.0 in stage 0.0 (TID 129) in 3326 ms on 192.168.0.54 (executor driver) (129/175) 2021-12-17 08:48:30 Executor: INFO: Running task 134.0 in stage 0.0 (TID 134) 2021-12-17 08:48:30 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 134.0 in stage 0.0 (TID 134) 2021-12-17 08:48:30 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 134.0 in stage 0.0 (TID 134) 2021-12-17 08:48:30 root: INFO: TaskReport: stage=0, partition=128, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=5, cache hits=3 2021-12-17 08:48:30 root: INFO: RegionPool: FREE: 307.5K allocated (305.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 128.0 in stage 0.0 (TID 128) 2021-12-17 08:48:30 Executor: INFO: Finished task 128.0 in stage 0.0 (TID 128). 1454 bytes result sent to driver 2021-12-17 08:48:30 TaskSetManager: INFO: Starting task 135.0 in stage 0.0 (TID 135) (192.168.0.54, executor driver, partition 135, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:30 TaskSetManager: INFO: Finished task 128.0 in stage 0.0 (TID 128) in 3352 ms on 192.168.0.54 (executor driver) (130/175) 2021-12-17 08:48:30 Executor: INFO: Running task 135.0 in stage 0.0 (TID 135) 2021-12-17 08:48:30 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 135.0 in stage 0.0 (TID 135) 2021-12-17 08:48:30 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 135.0 in stage 0.0 (TID 135) 2021-12-17 08:48:31 root: INFO: TaskReport: stage=0, partition=130, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:31 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 130.0 in stage 0.0 (TID 130) 2021-12-17 08:48:31 Executor: INFO: Finished task 130.0 in stage 0.0 (TID 130). 1462 bytes result sent to driver 2021-12-17 08:48:31 TaskSetManager: INFO: Starting task 136.0 in stage 0.0 (TID 136) (192.168.0.54, executor driver, partition 136, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:31 TaskSetManager: INFO: Finished task 130.0 in stage 0.0 (TID 130) in 3412 ms on 192.168.0.54 (executor driver) (131/175) 2021-12-17 08:48:31 Executor: INFO: Running task 136.0 in stage 0.0 (TID 136) 2021-12-17 08:48:31 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 136.0 in stage 0.0 (TID 136) 2021-12-17 08:48:31 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 136.0 in stage 0.0 (TID 136) 2021-12-17 08:48:31 root: INFO: TaskReport: stage=0, partition=131, attempt=0, peakBytes=313856, peakBytesReadable=306.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:31 root: INFO: RegionPool: FREE: 306.5K allocated (304.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 131.0 in stage 0.0 (TID 131) 2021-12-17 08:48:31 Executor: INFO: Finished task 131.0 in stage 0.0 (TID 131). 1474 bytes result sent to driver 2021-12-17 08:48:31 TaskSetManager: INFO: Starting task 137.0 in stage 0.0 (TID 137) (192.168.0.54, executor driver, partition 137, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:31 TaskSetManager: INFO: Finished task 131.0 in stage 0.0 (TID 131) in 3515 ms on 192.168.0.54 (executor driver) (132/175) 2021-12-17 08:48:31 Executor: INFO: Running task 137.0 in stage 0.0 (TID 137) 2021-12-17 08:48:31 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 137.0 in stage 0.0 (TID 137) 2021-12-17 08:48:31 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 137.0 in stage 0.0 (TID 137) 2021-12-17 08:48:34 root: INFO: TaskReport: stage=0, partition=132, attempt=0, peakBytes=313856, peakBytesReadable=306.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:34 root: INFO: RegionPool: FREE: 306.5K allocated (304.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 132.0 in stage 0.0 (TID 132) 2021-12-17 08:48:34 Executor: INFO: Finished task 132.0 in stage 0.0 (TID 132). 1447 bytes result sent to driver 2021-12-17 08:48:34 TaskSetManager: INFO: Starting task 138.0 in stage 0.0 (TID 138) (192.168.0.54, executor driver, partition 138, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:34 TaskSetManager: INFO: Finished task 132.0 in stage 0.0 (TID 132) in 3555 ms on 192.168.0.54 (executor driver) (133/175) 2021-12-17 08:48:34 Executor: INFO: Running task 138.0 in stage 0.0 (TID 138) 2021-12-17 08:48:34 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 138.0 in stage 0.0 (TID 138) 2021-12-17 08:48:34 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 138.0 in stage 0.0 (TID 138) 2021-12-17 08:48:34 root: INFO: TaskReport: stage=0, partition=135, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:34 root: INFO: RegionPool: FREE: 307.5K allocated (305.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 135.0 in stage 0.0 (TID 135) 2021-12-17 08:48:34 Executor: INFO: Finished task 135.0 in stage 0.0 (TID 135). 1439 bytes result sent to driver 2021-12-17 08:48:34 TaskSetManager: INFO: Starting task 139.0 in stage 0.0 (TID 139) (192.168.0.54, executor driver, partition 139, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:34 TaskSetManager: INFO: Finished task 135.0 in stage 0.0 (TID 135) in 3571 ms on 192.168.0.54 (executor driver) (134/175) 2021-12-17 08:48:34 Executor: INFO: Running task 139.0 in stage 0.0 (TID 139) 2021-12-17 08:48:34 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 139.0 in stage 0.0 (TID 139) 2021-12-17 08:48:34 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 139.0 in stage 0.0 (TID 139) 2021-12-17 08:48:34 root: INFO: TaskReport: stage=0, partition=134, attempt=0, peakBytes=313344, peakBytesReadable=306.00 KiB, chunks requested=10, cache hits=6 2021-12-17 08:48:34 root: INFO: RegionPool: FREE: 306.0K allocated (303.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 134.0 in stage 0.0 (TID 134) 2021-12-17 08:48:34 Executor: INFO: Finished task 134.0 in stage 0.0 (TID 134). 1447 bytes result sent to driver 2021-12-17 08:48:34 TaskSetManager: INFO: Starting task 140.0 in stage 0.0 (TID 140) (192.168.0.54, executor driver, partition 140, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:34 Executor: INFO: Running task 140.0 in stage 0.0 (TID 140) 2021-12-17 08:48:34 TaskSetManager: INFO: Finished task 134.0 in stage 0.0 (TID 134) in 3627 ms on 192.168.0.54 (executor driver) (135/175) 2021-12-17 08:48:34 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 140.0 in stage 0.0 (TID 140) 2021-12-17 08:48:34 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 140.0 in stage 0.0 (TID 140) 2021-12-17 08:48:34 root: INFO: TaskReport: stage=0, partition=133, attempt=0, peakBytes=315648, peakBytesReadable=308.25 KiB, chunks requested=4, cache hits=1 2021-12-17 08:48:34 root: INFO: RegionPool: FREE: 308.3K allocated (305.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 133.0 in stage 0.0 (TID 133) 2021-12-17 08:48:34 Executor: INFO: Finished task 133.0 in stage 0.0 (TID 133). 1470 bytes result sent to driver 2021-12-17 08:48:34 TaskSetManager: INFO: Starting task 141.0 in stage 0.0 (TID 141) (192.168.0.54, executor driver, partition 141, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:34 TaskSetManager: INFO: Finished task 133.0 in stage 0.0 (TID 133) in 3718 ms on 192.168.0.54 (executor driver) (136/175) 2021-12-17 08:48:34 Executor: INFO: Running task 141.0 in stage 0.0 (TID 141) 2021-12-17 08:48:34 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 141.0 in stage 0.0 (TID 141) 2021-12-17 08:48:34 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 141.0 in stage 0.0 (TID 141) 2021-12-17 08:48:35 root: INFO: TaskReport: stage=0, partition=136, attempt=0, peakBytes=313856, peakBytesReadable=306.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:35 root: INFO: RegionPool: FREE: 306.5K allocated (304.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 136.0 in stage 0.0 (TID 136) 2021-12-17 08:48:35 Executor: INFO: Finished task 136.0 in stage 0.0 (TID 136). 1452 bytes result sent to driver 2021-12-17 08:48:35 TaskSetManager: INFO: Starting task 142.0 in stage 0.0 (TID 142) (192.168.0.54, executor driver, partition 142, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:35 TaskSetManager: INFO: Finished task 136.0 in stage 0.0 (TID 136) in 3617 ms on 192.168.0.54 (executor driver) (137/175) 2021-12-17 08:48:35 Executor: INFO: Running task 142.0 in stage 0.0 (TID 142) 2021-12-17 08:48:35 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 142.0 in stage 0.0 (TID 142) 2021-12-17 08:48:35 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 142.0 in stage 0.0 (TID 142) 2021-12-17 08:48:35 root: INFO: TaskReport: stage=0, partition=137, attempt=0, peakBytes=311808, peakBytesReadable=304.50 KiB, chunks requested=3, cache hits=1 2021-12-17 08:48:35 root: INFO: RegionPool: FREE: 304.5K allocated (302.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 137.0 in stage 0.0 (TID 137) 2021-12-17 08:48:35 Executor: INFO: Finished task 137.0 in stage 0.0 (TID 137). 1469 bytes result sent to driver 2021-12-17 08:48:35 TaskSetManager: INFO: Starting task 143.0 in stage 0.0 (TID 143) (192.168.0.54, executor driver, partition 143, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:35 TaskSetManager: INFO: Finished task 137.0 in stage 0.0 (TID 137) in 3552 ms on 192.168.0.54 (executor driver) (138/175) 2021-12-17 08:48:35 Executor: INFO: Running task 143.0 in stage 0.0 (TID 143) 2021-12-17 08:48:35 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 143.0 in stage 0.0 (TID 143) 2021-12-17 08:48:35 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 143.0 in stage 0.0 (TID 143) 2021-12-17 08:48:37 root: INFO: TaskReport: stage=0, partition=138, attempt=0, peakBytes=315648, peakBytesReadable=308.25 KiB, chunks requested=7, cache hits=2 2021-12-17 08:48:37 root: INFO: RegionPool: FREE: 308.3K allocated (305.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 138.0 in stage 0.0 (TID 138) 2021-12-17 08:48:37 Executor: INFO: Finished task 138.0 in stage 0.0 (TID 138). 1484 bytes result sent to driver 2021-12-17 08:48:37 TaskSetManager: INFO: Starting task 144.0 in stage 0.0 (TID 144) (192.168.0.54, executor driver, partition 144, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:37 TaskSetManager: INFO: Finished task 138.0 in stage 0.0 (TID 138) in 3561 ms on 192.168.0.54 (executor driver) (139/175) 2021-12-17 08:48:37 Executor: INFO: Running task 144.0 in stage 0.0 (TID 144) 2021-12-17 08:48:37 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 144.0 in stage 0.0 (TID 144) 2021-12-17 08:48:37 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 144.0 in stage 0.0 (TID 144) 2021-12-17 08:48:37 root: INFO: TaskReport: stage=0, partition=140, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:37 root: INFO: RegionPool: FREE: 307.5K allocated (305.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 140.0 in stage 0.0 (TID 140) 2021-12-17 08:48:37 Executor: INFO: Finished task 140.0 in stage 0.0 (TID 140). 1488 bytes result sent to driver 2021-12-17 08:48:37 TaskSetManager: INFO: Starting task 145.0 in stage 0.0 (TID 145) (192.168.0.54, executor driver, partition 145, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:37 TaskSetManager: INFO: Finished task 140.0 in stage 0.0 (TID 140) in 3307 ms on 192.168.0.54 (executor driver) (140/175) 2021-12-17 08:48:37 Executor: INFO: Running task 145.0 in stage 0.0 (TID 145) 2021-12-17 08:48:37 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 145.0 in stage 0.0 (TID 145) 2021-12-17 08:48:37 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 145.0 in stage 0.0 (TID 145) 2021-12-17 08:48:37 root: INFO: TaskReport: stage=0, partition=141, attempt=0, peakBytes=322048, peakBytesReadable=314.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:37 root: INFO: RegionPool: FREE: 314.5K allocated (312.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 141.0 in stage 0.0 (TID 141) 2021-12-17 08:48:37 Executor: INFO: Finished task 141.0 in stage 0.0 (TID 141). 1541 bytes result sent to driver 2021-12-17 08:48:37 TaskSetManager: INFO: Starting task 146.0 in stage 0.0 (TID 146) (192.168.0.54, executor driver, partition 146, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:37 Executor: INFO: Running task 146.0 in stage 0.0 (TID 146) 2021-12-17 08:48:37 TaskSetManager: INFO: Finished task 141.0 in stage 0.0 (TID 141) in 3354 ms on 192.168.0.54 (executor driver) (141/175) 2021-12-17 08:48:37 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 146.0 in stage 0.0 (TID 146) 2021-12-17 08:48:37 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 146.0 in stage 0.0 (TID 146) 2021-12-17 08:48:37 root: INFO: TaskReport: stage=0, partition=139, attempt=0, peakBytes=315904, peakBytesReadable=308.50 KiB, chunks requested=5, cache hits=3 2021-12-17 08:48:37 root: INFO: RegionPool: FREE: 308.5K allocated (306.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 139.0 in stage 0.0 (TID 139) 2021-12-17 08:48:37 Executor: INFO: Finished task 139.0 in stage 0.0 (TID 139). 1474 bytes result sent to driver 2021-12-17 08:48:37 TaskSetManager: INFO: Starting task 147.0 in stage 0.0 (TID 147) (192.168.0.54, executor driver, partition 147, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:37 TaskSetManager: INFO: Finished task 139.0 in stage 0.0 (TID 139) in 3499 ms on 192.168.0.54 (executor driver) (142/175) 2021-12-17 08:48:37 Executor: INFO: Running task 147.0 in stage 0.0 (TID 147) 2021-12-17 08:48:37 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 147.0 in stage 0.0 (TID 147) 2021-12-17 08:48:37 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 147.0 in stage 0.0 (TID 147) 2021-12-17 08:48:38 root: INFO: TaskReport: stage=0, partition=142, attempt=0, peakBytes=321024, peakBytesReadable=313.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:38 root: INFO: RegionPool: FREE: 313.5K allocated (311.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 142.0 in stage 0.0 (TID 142) 2021-12-17 08:48:38 Executor: INFO: Finished task 142.0 in stage 0.0 (TID 142). 1539 bytes result sent to driver 2021-12-17 08:48:38 TaskSetManager: INFO: Starting task 148.0 in stage 0.0 (TID 148) (192.168.0.54, executor driver, partition 148, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:38 TaskSetManager: INFO: Finished task 142.0 in stage 0.0 (TID 142) in 3375 ms on 192.168.0.54 (executor driver) (143/175) 2021-12-17 08:48:38 Executor: INFO: Running task 148.0 in stage 0.0 (TID 148) 2021-12-17 08:48:38 root: INFO: RegionPool: initialized for thread 487: Executor task launch worker for task 148.0 in stage 0.0 (TID 148) 2021-12-17 08:48:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 487: Executor task launch worker for task 148.0 in stage 0.0 (TID 148) 2021-12-17 08:48:38 root: INFO: TaskReport: stage=0, partition=143, attempt=0, peakBytes=315392, peakBytesReadable=308.00 KiB, chunks requested=4, cache hits=2 2021-12-17 08:48:38 root: INFO: RegionPool: FREE: 308.0K allocated (305.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 143.0 in stage 0.0 (TID 143) 2021-12-17 08:48:38 Executor: INFO: Finished task 143.0 in stage 0.0 (TID 143). 1480 bytes result sent to driver 2021-12-17 08:48:38 TaskSetManager: INFO: Starting task 149.0 in stage 0.0 (TID 149) (192.168.0.54, executor driver, partition 149, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:38 TaskSetManager: INFO: Finished task 143.0 in stage 0.0 (TID 143) in 3389 ms on 192.168.0.54 (executor driver) (144/175) 2021-12-17 08:48:38 Executor: INFO: Running task 149.0 in stage 0.0 (TID 149) 2021-12-17 08:48:38 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 149.0 in stage 0.0 (TID 149) 2021-12-17 08:48:38 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 149.0 in stage 0.0 (TID 149) 2021-12-17 08:48:41 root: INFO: TaskReport: stage=0, partition=145, attempt=0, peakBytes=314368, peakBytesReadable=307.00 KiB, chunks requested=3, cache hits=1 2021-12-17 08:48:41 root: INFO: RegionPool: FREE: 307.0K allocated (304.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 145.0 in stage 0.0 (TID 145) 2021-12-17 08:48:41 Executor: INFO: Finished task 145.0 in stage 0.0 (TID 145). 1454 bytes result sent to driver 2021-12-17 08:48:41 TaskSetManager: INFO: Starting task 150.0 in stage 0.0 (TID 150) (192.168.0.54, executor driver, partition 150, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:41 TaskSetManager: INFO: Finished task 145.0 in stage 0.0 (TID 145) in 3189 ms on 192.168.0.54 (executor driver) (145/175) 2021-12-17 08:48:41 Executor: INFO: Running task 150.0 in stage 0.0 (TID 150) 2021-12-17 08:48:41 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 150.0 in stage 0.0 (TID 150) 2021-12-17 08:48:41 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 150.0 in stage 0.0 (TID 150) 2021-12-17 08:48:41 root: INFO: TaskReport: stage=0, partition=146, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=4, cache hits=2 2021-12-17 08:48:41 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 146.0 in stage 0.0 (TID 146) 2021-12-17 08:48:41 Executor: INFO: Finished task 146.0 in stage 0.0 (TID 146). 1472 bytes result sent to driver 2021-12-17 08:48:41 TaskSetManager: INFO: Starting task 151.0 in stage 0.0 (TID 151) (192.168.0.54, executor driver, partition 151, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:41 TaskSetManager: INFO: Finished task 146.0 in stage 0.0 (TID 146) in 3201 ms on 192.168.0.54 (executor driver) (146/175) 2021-12-17 08:48:41 Executor: INFO: Running task 151.0 in stage 0.0 (TID 151) 2021-12-17 08:48:41 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 151.0 in stage 0.0 (TID 151) 2021-12-17 08:48:41 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 151.0 in stage 0.0 (TID 151) 2021-12-17 08:48:41 root: INFO: TaskReport: stage=0, partition=144, attempt=0, peakBytes=316672, peakBytesReadable=309.25 KiB, chunks requested=9, cache hits=7 2021-12-17 08:48:41 root: INFO: RegionPool: FREE: 309.3K allocated (306.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 144.0 in stage 0.0 (TID 144) 2021-12-17 08:48:41 Executor: INFO: Finished task 144.0 in stage 0.0 (TID 144). 1437 bytes result sent to driver 2021-12-17 08:48:41 TaskSetManager: INFO: Starting task 152.0 in stage 0.0 (TID 152) (192.168.0.54, executor driver, partition 152, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:41 TaskSetManager: INFO: Finished task 144.0 in stage 0.0 (TID 144) in 3343 ms on 192.168.0.54 (executor driver) (147/175) 2021-12-17 08:48:41 Executor: INFO: Running task 152.0 in stage 0.0 (TID 152) 2021-12-17 08:48:41 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 152.0 in stage 0.0 (TID 152) 2021-12-17 08:48:41 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 152.0 in stage 0.0 (TID 152) 2021-12-17 08:48:41 root: INFO: TaskReport: stage=0, partition=147, attempt=0, peakBytes=312576, peakBytesReadable=305.25 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:41 root: INFO: RegionPool: FREE: 305.3K allocated (303.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 147.0 in stage 0.0 (TID 147) 2021-12-17 08:48:41 Executor: INFO: Finished task 147.0 in stage 0.0 (TID 147). 1456 bytes result sent to driver 2021-12-17 08:48:41 TaskSetManager: INFO: Starting task 153.0 in stage 0.0 (TID 153) (192.168.0.54, executor driver, partition 153, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:41 TaskSetManager: INFO: Finished task 147.0 in stage 0.0 (TID 147) in 3211 ms on 192.168.0.54 (executor driver) (148/175) 2021-12-17 08:48:41 Executor: INFO: Running task 153.0 in stage 0.0 (TID 153) 2021-12-17 08:48:41 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 153.0 in stage 0.0 (TID 153) 2021-12-17 08:48:41 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 153.0 in stage 0.0 (TID 153) 2021-12-17 08:48:41 root: INFO: TaskReport: stage=0, partition=148, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:41 root: INFO: RegionPool: FREE: 307.5K allocated (305.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 487: Executor task launch worker for task 148.0 in stage 0.0 (TID 148) 2021-12-17 08:48:41 Executor: INFO: Finished task 148.0 in stage 0.0 (TID 148). 1633 bytes result sent to driver 2021-12-17 08:48:41 TaskSetManager: INFO: Starting task 154.0 in stage 0.0 (TID 154) (192.168.0.54, executor driver, partition 154, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:41 TaskSetManager: INFO: Finished task 148.0 in stage 0.0 (TID 148) in 3281 ms on 192.168.0.54 (executor driver) (149/175) 2021-12-17 08:48:41 Executor: INFO: Running task 154.0 in stage 0.0 (TID 154) 2021-12-17 08:48:41 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 154.0 in stage 0.0 (TID 154) 2021-12-17 08:48:41 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 154.0 in stage 0.0 (TID 154) 2021-12-17 08:48:41 root: INFO: TaskReport: stage=0, partition=149, attempt=0, peakBytes=321536, peakBytesReadable=314.00 KiB, chunks requested=14, cache hits=9 2021-12-17 08:48:41 root: INFO: RegionPool: FREE: 314.0K allocated (311.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 149.0 in stage 0.0 (TID 149) 2021-12-17 08:48:41 Executor: INFO: Finished task 149.0 in stage 0.0 (TID 149). 1493 bytes result sent to driver 2021-12-17 08:48:41 TaskSetManager: INFO: Starting task 155.0 in stage 0.0 (TID 155) (192.168.0.54, executor driver, partition 155, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:41 TaskSetManager: INFO: Finished task 149.0 in stage 0.0 (TID 149) in 3332 ms on 192.168.0.54 (executor driver) (150/175) 2021-12-17 08:48:41 Executor: INFO: Running task 155.0 in stage 0.0 (TID 155) 2021-12-17 08:48:41 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 155.0 in stage 0.0 (TID 155) 2021-12-17 08:48:41 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 155.0 in stage 0.0 (TID 155) 2021-12-17 08:48:44 root: INFO: TaskReport: stage=0, partition=150, attempt=0, peakBytes=317696, peakBytesReadable=310.25 KiB, chunks requested=8, cache hits=5 2021-12-17 08:48:44 root: INFO: RegionPool: FREE: 310.3K allocated (307.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 150.0 in stage 0.0 (TID 150) 2021-12-17 08:48:44 Executor: INFO: Finished task 150.0 in stage 0.0 (TID 150). 1451 bytes result sent to driver 2021-12-17 08:48:44 TaskSetManager: INFO: Starting task 156.0 in stage 0.0 (TID 156) (192.168.0.54, executor driver, partition 156, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:44 TaskSetManager: INFO: Finished task 150.0 in stage 0.0 (TID 150) in 3227 ms on 192.168.0.54 (executor driver) (151/175) 2021-12-17 08:48:44 Executor: INFO: Running task 156.0 in stage 0.0 (TID 156) 2021-12-17 08:48:44 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 156.0 in stage 0.0 (TID 156) 2021-12-17 08:48:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 156.0 in stage 0.0 (TID 156) 2021-12-17 08:48:44 root: INFO: TaskReport: stage=0, partition=153, attempt=0, peakBytes=317184, peakBytesReadable=309.75 KiB, chunks requested=3, cache hits=0 2021-12-17 08:48:44 root: INFO: RegionPool: FREE: 309.8K allocated (307.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 153.0 in stage 0.0 (TID 153) 2021-12-17 08:48:44 Executor: INFO: Finished task 153.0 in stage 0.0 (TID 153). 1520 bytes result sent to driver 2021-12-17 08:48:44 TaskSetManager: INFO: Starting task 157.0 in stage 0.0 (TID 157) (192.168.0.54, executor driver, partition 157, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:44 TaskSetManager: INFO: Finished task 153.0 in stage 0.0 (TID 153) in 3071 ms on 192.168.0.54 (executor driver) (152/175) 2021-12-17 08:48:44 Executor: INFO: Running task 157.0 in stage 0.0 (TID 157) 2021-12-17 08:48:44 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 157.0 in stage 0.0 (TID 157) 2021-12-17 08:48:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 157.0 in stage 0.0 (TID 157) 2021-12-17 08:48:44 root: INFO: TaskReport: stage=0, partition=151, attempt=0, peakBytes=313344, peakBytesReadable=306.00 KiB, chunks requested=7, cache hits=4 2021-12-17 08:48:44 root: INFO: RegionPool: FREE: 306.0K allocated (303.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 151.0 in stage 0.0 (TID 151) 2021-12-17 08:48:44 Executor: INFO: Finished task 151.0 in stage 0.0 (TID 151). 1459 bytes result sent to driver 2021-12-17 08:48:44 TaskSetManager: INFO: Starting task 158.0 in stage 0.0 (TID 158) (192.168.0.54, executor driver, partition 158, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:44 TaskSetManager: INFO: Finished task 151.0 in stage 0.0 (TID 151) in 3234 ms on 192.168.0.54 (executor driver) (153/175) 2021-12-17 08:48:44 Executor: INFO: Running task 158.0 in stage 0.0 (TID 158) 2021-12-17 08:48:44 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 158.0 in stage 0.0 (TID 158) 2021-12-17 08:48:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 158.0 in stage 0.0 (TID 158) 2021-12-17 08:48:44 root: INFO: TaskReport: stage=0, partition=152, attempt=0, peakBytes=311296, peakBytesReadable=304.00 KiB, chunks requested=8, cache hits=6 2021-12-17 08:48:44 root: INFO: RegionPool: FREE: 304.0K allocated (301.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 152.0 in stage 0.0 (TID 152) 2021-12-17 08:48:44 Executor: INFO: Finished task 152.0 in stage 0.0 (TID 152). 1470 bytes result sent to driver 2021-12-17 08:48:44 TaskSetManager: INFO: Starting task 159.0 in stage 0.0 (TID 159) (192.168.0.54, executor driver, partition 159, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:44 TaskSetManager: INFO: Finished task 152.0 in stage 0.0 (TID 152) in 3283 ms on 192.168.0.54 (executor driver) (154/175) 2021-12-17 08:48:44 Executor: INFO: Running task 159.0 in stage 0.0 (TID 159) 2021-12-17 08:48:44 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 159.0 in stage 0.0 (TID 159) 2021-12-17 08:48:44 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 159.0 in stage 0.0 (TID 159) 2021-12-17 08:48:45 root: INFO: TaskReport: stage=0, partition=154, attempt=0, peakBytes=317952, peakBytesReadable=310.50 KiB, chunks requested=16, cache hits=11 2021-12-17 08:48:45 root: INFO: RegionPool: FREE: 310.5K allocated (308.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 154.0 in stage 0.0 (TID 154) 2021-12-17 08:48:45 Executor: INFO: Finished task 154.0 in stage 0.0 (TID 154). 1448 bytes result sent to driver 2021-12-17 08:48:45 TaskSetManager: INFO: Starting task 160.0 in stage 0.0 (TID 160) (192.168.0.54, executor driver, partition 160, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:45 TaskSetManager: INFO: Finished task 154.0 in stage 0.0 (TID 154) in 3226 ms on 192.168.0.54 (executor driver) (155/175) 2021-12-17 08:48:45 Executor: INFO: Running task 160.0 in stage 0.0 (TID 160) 2021-12-17 08:48:45 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 160.0 in stage 0.0 (TID 160) 2021-12-17 08:48:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 160.0 in stage 0.0 (TID 160) 2021-12-17 08:48:45 root: INFO: TaskReport: stage=0, partition=155, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:45 root: INFO: RegionPool: FREE: 307.5K allocated (305.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 155.0 in stage 0.0 (TID 155) 2021-12-17 08:48:45 Executor: INFO: Finished task 155.0 in stage 0.0 (TID 155). 1477 bytes result sent to driver 2021-12-17 08:48:45 TaskSetManager: INFO: Starting task 161.0 in stage 0.0 (TID 161) (192.168.0.54, executor driver, partition 161, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:45 TaskSetManager: INFO: Finished task 155.0 in stage 0.0 (TID 155) in 3318 ms on 192.168.0.54 (executor driver) (156/175) 2021-12-17 08:48:45 Executor: INFO: Running task 161.0 in stage 0.0 (TID 161) 2021-12-17 08:48:45 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 161.0 in stage 0.0 (TID 161) 2021-12-17 08:48:45 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 161.0 in stage 0.0 (TID 161) 2021-12-17 08:48:47 root: INFO: TaskReport: stage=0, partition=156, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=8, cache hits=4 2021-12-17 08:48:47 root: INFO: RegionPool: FREE: 307.5K allocated (305.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 156.0 in stage 0.0 (TID 156) 2021-12-17 08:48:47 Executor: INFO: Finished task 156.0 in stage 0.0 (TID 156). 1491 bytes result sent to driver 2021-12-17 08:48:47 TaskSetManager: INFO: Starting task 162.0 in stage 0.0 (TID 162) (192.168.0.54, executor driver, partition 162, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:47 TaskSetManager: INFO: Finished task 156.0 in stage 0.0 (TID 156) in 3162 ms on 192.168.0.54 (executor driver) (157/175) 2021-12-17 08:48:47 Executor: INFO: Running task 162.0 in stage 0.0 (TID 162) 2021-12-17 08:48:47 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 162.0 in stage 0.0 (TID 162) 2021-12-17 08:48:47 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 162.0 in stage 0.0 (TID 162) 2021-12-17 08:48:47 root: INFO: TaskReport: stage=0, partition=159, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=16, cache hits=11 2021-12-17 08:48:47 root: INFO: RegionPool: FREE: 307.5K allocated (304.5K blocks / 3.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 159.0 in stage 0.0 (TID 159) 2021-12-17 08:48:47 Executor: INFO: Finished task 159.0 in stage 0.0 (TID 159). 1517 bytes result sent to driver 2021-12-17 08:48:47 TaskSetManager: INFO: Starting task 163.0 in stage 0.0 (TID 163) (192.168.0.54, executor driver, partition 163, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:47 TaskSetManager: INFO: Finished task 159.0 in stage 0.0 (TID 159) in 3127 ms on 192.168.0.54 (executor driver) (158/175) 2021-12-17 08:48:47 Executor: INFO: Running task 163.0 in stage 0.0 (TID 163) 2021-12-17 08:48:47 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 163.0 in stage 0.0 (TID 163) 2021-12-17 08:48:47 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 163.0 in stage 0.0 (TID 163) 2021-12-17 08:48:47 root: INFO: TaskReport: stage=0, partition=157, attempt=0, peakBytes=313856, peakBytesReadable=306.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:47 root: INFO: RegionPool: FREE: 306.5K allocated (304.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 157.0 in stage 0.0 (TID 157) 2021-12-17 08:48:47 Executor: INFO: Finished task 157.0 in stage 0.0 (TID 157). 1473 bytes result sent to driver 2021-12-17 08:48:47 TaskSetManager: INFO: Starting task 164.0 in stage 0.0 (TID 164) (192.168.0.54, executor driver, partition 164, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:47 TaskSetManager: INFO: Finished task 157.0 in stage 0.0 (TID 157) in 3278 ms on 192.168.0.54 (executor driver) (159/175) 2021-12-17 08:48:47 Executor: INFO: Running task 164.0 in stage 0.0 (TID 164) 2021-12-17 08:48:47 root: INFO: TaskReport: stage=0, partition=158, attempt=0, peakBytes=314880, peakBytesReadable=307.50 KiB, chunks requested=3, cache hits=1 2021-12-17 08:48:47 root: INFO: RegionPool: FREE: 307.5K allocated (305.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 158.0 in stage 0.0 (TID 158) 2021-12-17 08:48:47 Executor: INFO: Finished task 158.0 in stage 0.0 (TID 158). 1445 bytes result sent to driver 2021-12-17 08:48:47 TaskSetManager: INFO: Starting task 165.0 in stage 0.0 (TID 165) (192.168.0.54, executor driver, partition 165, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:47 TaskSetManager: INFO: Finished task 158.0 in stage 0.0 (TID 158) in 3227 ms on 192.168.0.54 (executor driver) (160/175) 2021-12-17 08:48:47 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 164.0 in stage 0.0 (TID 164) 2021-12-17 08:48:47 Executor: INFO: Running task 165.0 in stage 0.0 (TID 165) 2021-12-17 08:48:47 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 164.0 in stage 0.0 (TID 164) 2021-12-17 08:48:47 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 165.0 in stage 0.0 (TID 165) 2021-12-17 08:48:47 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 165.0 in stage 0.0 (TID 165) 2021-12-17 08:48:48 root: INFO: TaskReport: stage=0, partition=160, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=14, cache hits=9 2021-12-17 08:48:48 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 160.0 in stage 0.0 (TID 160) 2021-12-17 08:48:48 Executor: INFO: Finished task 160.0 in stage 0.0 (TID 160). 1484 bytes result sent to driver 2021-12-17 08:48:48 TaskSetManager: INFO: Starting task 166.0 in stage 0.0 (TID 166) (192.168.0.54, executor driver, partition 166, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:48 TaskSetManager: INFO: Finished task 160.0 in stage 0.0 (TID 160) in 3062 ms on 192.168.0.54 (executor driver) (161/175) 2021-12-17 08:48:48 Executor: INFO: Running task 166.0 in stage 0.0 (TID 166) 2021-12-17 08:48:48 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 166.0 in stage 0.0 (TID 166) 2021-12-17 08:48:48 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 166.0 in stage 0.0 (TID 166) 2021-12-17 08:48:48 root: INFO: TaskReport: stage=0, partition=161, attempt=0, peakBytes=313856, peakBytesReadable=306.50 KiB, chunks requested=6, cache hits=3 2021-12-17 08:48:48 root: INFO: RegionPool: FREE: 306.5K allocated (304.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 161.0 in stage 0.0 (TID 161) 2021-12-17 08:48:48 Executor: INFO: Finished task 161.0 in stage 0.0 (TID 161). 1484 bytes result sent to driver 2021-12-17 08:48:48 TaskSetManager: INFO: Starting task 167.0 in stage 0.0 (TID 167) (192.168.0.54, executor driver, partition 167, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:48 TaskSetManager: INFO: Finished task 161.0 in stage 0.0 (TID 161) in 3298 ms on 192.168.0.54 (executor driver) (162/175) 2021-12-17 08:48:48 Executor: INFO: Running task 167.0 in stage 0.0 (TID 167) 2021-12-17 08:48:48 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 167.0 in stage 0.0 (TID 167) 2021-12-17 08:48:48 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 167.0 in stage 0.0 (TID 167) 2021-12-17 08:48:50 root: INFO: TaskReport: stage=0, partition=162, attempt=0, peakBytes=315648, peakBytesReadable=308.25 KiB, chunks requested=18, cache hits=13 2021-12-17 08:48:50 root: INFO: RegionPool: FREE: 308.3K allocated (305.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 162.0 in stage 0.0 (TID 162) 2021-12-17 08:48:50 Executor: INFO: Finished task 162.0 in stage 0.0 (TID 162). 1512 bytes result sent to driver 2021-12-17 08:48:50 TaskSetManager: INFO: Starting task 168.0 in stage 0.0 (TID 168) (192.168.0.54, executor driver, partition 168, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:50 TaskSetManager: INFO: Finished task 162.0 in stage 0.0 (TID 162) in 3418 ms on 192.168.0.54 (executor driver) (163/175) 2021-12-17 08:48:50 Executor: INFO: Running task 168.0 in stage 0.0 (TID 168) 2021-12-17 08:48:50 root: INFO: RegionPool: initialized for thread 490: Executor task launch worker for task 168.0 in stage 0.0 (TID 168) 2021-12-17 08:48:50 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 490: Executor task launch worker for task 168.0 in stage 0.0 (TID 168) 2021-12-17 08:48:50 root: INFO: TaskReport: stage=0, partition=163, attempt=0, peakBytes=315904, peakBytesReadable=308.50 KiB, chunks requested=3, cache hits=0 2021-12-17 08:48:50 root: INFO: RegionPool: FREE: 308.5K allocated (306.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 163.0 in stage 0.0 (TID 163) 2021-12-17 08:48:50 Executor: INFO: Finished task 163.0 in stage 0.0 (TID 163). 1480 bytes result sent to driver 2021-12-17 08:48:50 TaskSetManager: INFO: Starting task 169.0 in stage 0.0 (TID 169) (192.168.0.54, executor driver, partition 169, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:50 TaskSetManager: INFO: Finished task 163.0 in stage 0.0 (TID 163) in 3393 ms on 192.168.0.54 (executor driver) (164/175) 2021-12-17 08:48:50 Executor: INFO: Running task 169.0 in stage 0.0 (TID 169) 2021-12-17 08:48:50 root: INFO: TaskReport: stage=0, partition=164, attempt=0, peakBytes=315648, peakBytesReadable=308.25 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:50 root: INFO: RegionPool: FREE: 308.3K allocated (306.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 164.0 in stage 0.0 (TID 164) 2021-12-17 08:48:50 Executor: INFO: Finished task 164.0 in stage 0.0 (TID 164). 1510 bytes result sent to driver 2021-12-17 08:48:50 TaskSetManager: INFO: Starting task 170.0 in stage 0.0 (TID 170) (192.168.0.54, executor driver, partition 170, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:50 TaskSetManager: INFO: Finished task 164.0 in stage 0.0 (TID 164) in 3363 ms on 192.168.0.54 (executor driver) (165/175) 2021-12-17 08:48:50 Executor: INFO: Running task 170.0 in stage 0.0 (TID 170) 2021-12-17 08:48:50 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 169.0 in stage 0.0 (TID 169) 2021-12-17 08:48:50 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 169.0 in stage 0.0 (TID 169) 2021-12-17 08:48:50 root: INFO: RegionPool: initialized for thread 496: Executor task launch worker for task 170.0 in stage 0.0 (TID 170) 2021-12-17 08:48:50 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 496: Executor task launch worker for task 170.0 in stage 0.0 (TID 170) 2021-12-17 08:48:50 root: INFO: TaskReport: stage=0, partition=165, attempt=0, peakBytes=316672, peakBytesReadable=309.25 KiB, chunks requested=21, cache hits=17 2021-12-17 08:48:50 root: INFO: RegionPool: FREE: 309.3K allocated (306.8K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 165.0 in stage 0.0 (TID 165) 2021-12-17 08:48:50 Executor: INFO: Finished task 165.0 in stage 0.0 (TID 165). 1528 bytes result sent to driver 2021-12-17 08:48:50 TaskSetManager: INFO: Starting task 171.0 in stage 0.0 (TID 171) (192.168.0.54, executor driver, partition 171, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:50 TaskSetManager: INFO: Finished task 165.0 in stage 0.0 (TID 165) in 3410 ms on 192.168.0.54 (executor driver) (166/175) 2021-12-17 08:48:50 Executor: INFO: Running task 171.0 in stage 0.0 (TID 171) 2021-12-17 08:48:50 root: INFO: RegionPool: initialized for thread 486: Executor task launch worker for task 171.0 in stage 0.0 (TID 171) 2021-12-17 08:48:50 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 486: Executor task launch worker for task 171.0 in stage 0.0 (TID 171) 2021-12-17 08:48:51 root: INFO: TaskReport: stage=0, partition=166, attempt=0, peakBytes=312832, peakBytesReadable=305.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:51 root: INFO: RegionPool: FREE: 305.5K allocated (303.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 166.0 in stage 0.0 (TID 166) 2021-12-17 08:48:51 Executor: INFO: Finished task 166.0 in stage 0.0 (TID 166). 1494 bytes result sent to driver 2021-12-17 08:48:51 TaskSetManager: INFO: Starting task 172.0 in stage 0.0 (TID 172) (192.168.0.54, executor driver, partition 172, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:51 TaskSetManager: INFO: Finished task 166.0 in stage 0.0 (TID 166) in 3239 ms on 192.168.0.54 (executor driver) (167/175) 2021-12-17 08:48:51 Executor: INFO: Running task 172.0 in stage 0.0 (TID 172) 2021-12-17 08:48:51 root: INFO: RegionPool: initialized for thread 489: Executor task launch worker for task 172.0 in stage 0.0 (TID 172) 2021-12-17 08:48:51 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 489: Executor task launch worker for task 172.0 in stage 0.0 (TID 172) 2021-12-17 08:48:52 root: INFO: TaskReport: stage=0, partition=167, attempt=0, peakBytes=314368, peakBytesReadable=307.00 KiB, chunks requested=12, cache hits=9 2021-12-17 08:48:52 root: INFO: RegionPool: FREE: 307.0K allocated (304.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 167.0 in stage 0.0 (TID 167) 2021-12-17 08:48:52 Executor: INFO: Finished task 167.0 in stage 0.0 (TID 167). 1466 bytes result sent to driver 2021-12-17 08:48:52 TaskSetManager: INFO: Starting task 173.0 in stage 0.0 (TID 173) (192.168.0.54, executor driver, partition 173, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:52 TaskSetManager: INFO: Finished task 167.0 in stage 0.0 (TID 167) in 3555 ms on 192.168.0.54 (executor driver) (168/175) 2021-12-17 08:48:52 Executor: INFO: Running task 173.0 in stage 0.0 (TID 173) 2021-12-17 08:48:52 root: INFO: RegionPool: initialized for thread 488: Executor task launch worker for task 173.0 in stage 0.0 (TID 173) 2021-12-17 08:48:52 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 488: Executor task launch worker for task 173.0 in stage 0.0 (TID 173) 2021-12-17 08:48:54 root: INFO: TaskReport: stage=0, partition=169, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=6, cache hits=3 2021-12-17 08:48:54 root: INFO: RegionPool: FREE: 302.0K allocated (299.5K blocks / 2.5K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 169.0 in stage 0.0 (TID 169) 2021-12-17 08:48:54 Executor: INFO: Finished task 169.0 in stage 0.0 (TID 169). 1442 bytes result sent to driver 2021-12-17 08:48:54 TaskSetManager: INFO: Starting task 174.0 in stage 0.0 (TID 174) (192.168.0.54, executor driver, partition 174, PROCESS_LOCAL, 4373 bytes) taskResourceAssignments Map() 2021-12-17 08:48:54 TaskSetManager: INFO: Finished task 169.0 in stage 0.0 (TID 169) in 3490 ms on 192.168.0.54 (executor driver) (169/175) 2021-12-17 08:48:54 Executor: INFO: Running task 174.0 in stage 0.0 (TID 174) 2021-12-17 08:48:54 root: INFO: RegionPool: initialized for thread 491: Executor task launch worker for task 174.0 in stage 0.0 (TID 174) 2021-12-17 08:48:54 root: INFO: RegionPool: REPORT_THRESHOLD: 259.0K allocated (195.0K blocks / 64.0K chunks), regions.size = 6, 0 current java objects, thread 491: Executor task launch worker for task 174.0 in stage 0.0 (TID 174) 2021-12-17 08:48:54 root: INFO: TaskReport: stage=0, partition=170, attempt=0, peakBytes=306944, peakBytesReadable=299.75 KiB, chunks requested=2, cache hits=0 2021-12-17 08:48:54 root: INFO: RegionPool: FREE: 299.5K allocated (297.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 496: Executor task launch worker for task 170.0 in stage 0.0 (TID 170) 2021-12-17 08:48:54 Executor: INFO: Finished task 170.0 in stage 0.0 (TID 170). 1464 bytes result sent to driver 2021-12-17 08:48:54 TaskSetManager: INFO: Finished task 170.0 in stage 0.0 (TID 170) in 3525 ms on 192.168.0.54 (executor driver) (170/175) 2021-12-17 08:48:54 root: INFO: TaskReport: stage=0, partition=168, attempt=0, peakBytes=318464, peakBytesReadable=311.00 KiB, chunks requested=11, cache hits=7 2021-12-17 08:48:54 root: INFO: RegionPool: FREE: 310.8K allocated (308.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 490: Executor task launch worker for task 168.0 in stage 0.0 (TID 168) 2021-12-17 08:48:54 Executor: INFO: Finished task 168.0 in stage 0.0 (TID 168). 1576 bytes result sent to driver 2021-12-17 08:48:54 TaskSetManager: INFO: Finished task 168.0 in stage 0.0 (TID 168) in 3623 ms on 192.168.0.54 (executor driver) (171/175) 2021-12-17 08:48:54 root: INFO: TaskReport: stage=0, partition=171, attempt=0, peakBytes=307456, peakBytesReadable=300.25 KiB, chunks requested=6, cache hits=4 2021-12-17 08:48:54 root: INFO: RegionPool: FREE: 300.3K allocated (298.3K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 486: Executor task launch worker for task 171.0 in stage 0.0 (TID 171) 2021-12-17 08:48:54 Executor: INFO: Finished task 171.0 in stage 0.0 (TID 171). 1446 bytes result sent to driver 2021-12-17 08:48:54 TaskSetManager: INFO: Finished task 171.0 in stage 0.0 (TID 171) in 3533 ms on 192.168.0.54 (executor driver) (172/175) 2021-12-17 08:48:54 root: INFO: TaskReport: stage=0, partition=172, attempt=0, peakBytes=306688, peakBytesReadable=299.50 KiB, chunks requested=1, cache hits=0 2021-12-17 08:48:54 root: INFO: RegionPool: FREE: 299.5K allocated (297.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 489: Executor task launch worker for task 172.0 in stage 0.0 (TID 172) 2021-12-17 08:48:54 Executor: INFO: Finished task 172.0 in stage 0.0 (TID 172). 1436 bytes result sent to driver 2021-12-17 08:48:54 TaskSetManager: INFO: Finished task 172.0 in stage 0.0 (TID 172) in 3401 ms on 192.168.0.54 (executor driver) (173/175) 2021-12-17 08:48:55 root: INFO: TaskReport: stage=0, partition=173, attempt=0, peakBytes=309248, peakBytesReadable=302.00 KiB, chunks requested=9, cache hits=5 2021-12-17 08:48:55 root: INFO: RegionPool: FREE: 301.8K allocated (299.8K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 488: Executor task launch worker for task 173.0 in stage 0.0 (TID 173) 2021-12-17 08:48:55 Executor: INFO: Finished task 173.0 in stage 0.0 (TID 173). 1467 bytes result sent to driver 2021-12-17 08:48:55 TaskSetManager: INFO: Finished task 173.0 in stage 0.0 (TID 173) in 3349 ms on 192.168.0.54 (executor driver) (174/175) 2021-12-17 08:48:57 root: INFO: TaskReport: stage=0, partition=174, attempt=0, peakBytes=308736, peakBytesReadable=301.50 KiB, chunks requested=3, cache hits=1 2021-12-17 08:48:57 root: INFO: RegionPool: FREE: 301.5K allocated (299.5K blocks / 2.0K chunks), regions.size = 9, 0 current java objects, thread 491: Executor task launch worker for task 174.0 in stage 0.0 (TID 174) 2021-12-17 08:48:57 Executor: INFO: Finished task 174.0 in stage 0.0 (TID 174). 1433 bytes result sent to driver 2021-12-17 08:48:57 TaskSetManager: INFO: Finished task 174.0 in stage 0.0 (TID 174) in 2934 ms on 192.168.0.54 (executor driver) (175/175) 2021-12-17 08:48:57 TaskSchedulerImpl: INFO: Removed TaskSet 0.0, whose tasks have all completed, from pool 2021-12-17 08:48:57 DAGScheduler: INFO: ResultStage 0 (collect at SparkBackend.scala:286) finished in 96.571 s 2021-12-17 08:48:57 DAGScheduler: INFO: Job 0 is finished. Cancelling potential speculative or zombie tasks for this job 2021-12-17 08:48:57 TaskSchedulerImpl: INFO: Killing all running tasks in stage 0: Stage finished 2021-12-17 08:48:57 DAGScheduler: INFO: Job 0 finished: collect at SparkBackend.scala:286, took 96.571069 s 2021-12-17 08:48:57 root: INFO: RegionPool: REPORT_THRESHOLD: 256.0K allocated (192.0K blocks / 64.0K chunks), regions.size = 2, 0 current java objects, thread 240: Thread-44 2021-12-17 08:48:57 Hail: INFO: Coerced prefix-sorted dataset 2021-12-17 08:48:57 root: INFO: invalid partitioner: !lteqWithOverlap(0)([[chr1:203901030]-[chr1:221526905]].right, [[chr1:221526905]-[chr1:237032495]].left) 2021-12-17 08:48:57 root: INFO: invalid partitioner: !lteqWithOverlap(1)([[chr1:203901030]-[chr1:221526905]].right, [[chr1:221526905]-[chr1:237032495]].left) 2021-12-17 08:48:57 root: ERROR: error while applying lowering 'LowerOrInterpretNonCompilable' 2021-12-17 08:48:57 root: INFO: RegionPool: FREE: 384.0K allocated (384.0K blocks / 0 chunks), regions.size = 2, 0 current java objects, thread 240: Thread-44 2021-12-17 08:48:57 root: ERROR: IllegalArgumentException: requirement failed From java.lang.IllegalArgumentException: requirement failed at scala.Predef$.require(Predef.scala:268) at is.hail.rvd.RVDPartitioner.(RVDPartitioner.scala:52) at is.hail.rvd.RVDPartitioner.extendKeySamePartitions(RVDPartitioner.scala:141) at is.hail.expr.ir.LoweredTableReader$$anon$2.coerce(TableIR.scala:383) at is.hail.expr.ir.GenericTableValue.toTableStage(GenericTableValue.scala:162) at is.hail.io.vcf.MatrixVCFReader.lower(LoadVCF.scala:1790) at is.hail.expr.ir.lowering.LowerTableIR$.lower$1(LowerTableIR.scala:407) at is.hail.expr.ir.lowering.LowerTableIR$.apply(LowerTableIR.scala:1199) at is.hail.expr.ir.lowering.LowerToCDA$.lower(LowerToCDA.scala:69) at is.hail.expr.ir.lowering.LowerToCDA$.apply(LowerToCDA.scala:18) at is.hail.expr.ir.lowering.LowerToDistributedArrayPass.transform(LoweringPass.scala:77) at is.hail.expr.ir.LowerOrInterpretNonCompilable$.evaluate$1(LowerOrInterpretNonCompilable.scala:27) at is.hail.expr.ir.LowerOrInterpretNonCompilable$.rewrite$1(LowerOrInterpretNonCompilable.scala:67) at is.hail.expr.ir.LowerOrInterpretNonCompilable$.rewrite$1(LowerOrInterpretNonCompilable.scala:53) at is.hail.expr.ir.LowerOrInterpretNonCompilable$.apply(LowerOrInterpretNonCompilable.scala:72) at is.hail.expr.ir.lowering.LowerOrInterpretNonCompilablePass$.transform(LoweringPass.scala:69) at is.hail.expr.ir.lowering.LoweringPass.$anonfun$apply$3(LoweringPass.scala:16) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.lowering.LoweringPass.$anonfun$apply$1(LoweringPass.scala:16) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.lowering.LoweringPass.apply(LoweringPass.scala:14) at is.hail.expr.ir.lowering.LoweringPass.apply$(LoweringPass.scala:13) at is.hail.expr.ir.lowering.LowerOrInterpretNonCompilablePass$.apply(LoweringPass.scala:64) at is.hail.expr.ir.lowering.LoweringPipeline.$anonfun$apply$1(LoweringPipeline.scala:15) at is.hail.expr.ir.lowering.LoweringPipeline.$anonfun$apply$1$adapted(LoweringPipeline.scala:13) at scala.collection.IndexedSeqOptimized.foreach(IndexedSeqOptimized.scala:36) at scala.collection.IndexedSeqOptimized.foreach$(IndexedSeqOptimized.scala:33) at scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:38) at is.hail.expr.ir.lowering.LoweringPipeline.apply(LoweringPipeline.scala:13) at is.hail.expr.ir.CompileAndEvaluate$._apply(CompileAndEvaluate.scala:47) at is.hail.backend.spark.SparkBackend._execute(SparkBackend.scala:381) at is.hail.backend.spark.SparkBackend.$anonfun$executeEncode$2(SparkBackend.scala:417) at is.hail.backend.ExecuteContext$.$anonfun$scoped$3(ExecuteContext.scala:47) at is.hail.utils.package$.using(package.scala:638) at is.hail.backend.ExecuteContext$.$anonfun$scoped$2(ExecuteContext.scala:47) at is.hail.utils.package$.using(package.scala:638) at is.hail.annotations.RegionPool$.scoped(RegionPool.scala:17) at is.hail.backend.ExecuteContext$.scoped(ExecuteContext.scala:46) at is.hail.backend.spark.SparkBackend.withExecuteContext(SparkBackend.scala:275) at is.hail.backend.spark.SparkBackend.$anonfun$executeEncode$1(SparkBackend.scala:414) at is.hail.utils.ExecutionTimer$.time(ExecutionTimer.scala:52) at is.hail.backend.spark.SparkBackend.executeEncode(SparkBackend.scala:413) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244) at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357) at py4j.Gateway.invoke(Gateway.java:282) at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132) at py4j.commands.CallCommand.execute(CallCommand.java:79) at py4j.GatewayConnection.run(GatewayConnection.java:238) at java.lang.Thread.run(Thread.java:748)