2023-09-29 17:52:52.553 Hail: INFO: SparkUI: http://dcotter-burden-testing-vep-m.c.xxx.internal:45805 2023-09-29 17:52:52.881 Hail: INFO: Running Hail version 0.2.124-13536b531342 2023-09-29 17:52:56.159 : INFO: RegionPool: initialized for thread 19: Thread-4 2023-09-29 17:53:00.068 : INFO: RegionPool: initialized for thread 19: Thread-4 2023-09-29 17:53:00.070 : INFO: TaskReport: stage=0, partition=0, attempt=0, peakBytes=0, peakBytesReadable=0.00 B, chunks requested=0, cache hits=0 2023-09-29 17:53:00.075 : INFO: RegionPool: FREE: 0 allocated (0 blocks / 0 chunks), regions.size = 0, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:00.075 : INFO: RegionPool: FREE: 64.0K allocated (64.0K blocks / 0 chunks), regions.size = 1, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:00.076 : INFO: timing SparkBackend.parse_matrix_ir total 3.922s self 3.922s children 0.000ms %children 0.00% 2023-09-29 17:53:00.098 : INFO: RegionPool: initialized for thread 19: Thread-4 2023-09-29 17:53:00.175 : INFO: vep config json: JObject(List((name,JString(VEP)), (config,JString(file:///vep_data/vep-gcloud.json)), (csq,JBool(false)), (blockSize,JInt(1000)), (tolerateParseError,JBool(false)))) 2023-09-29 17:53:00.190 : INFO: RegionPool: initialized for thread 19: Thread-4 2023-09-29 17:53:00.191 : INFO: TaskReport: stage=0, partition=0, attempt=0, peakBytes=0, peakBytesReadable=0.00 B, chunks requested=0, cache hits=0 2023-09-29 17:53:00.191 : INFO: RegionPool: FREE: 0 allocated (0 blocks / 0 chunks), regions.size = 0, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:00.191 : INFO: RegionPool: FREE: 64.0K allocated (64.0K blocks / 0 chunks), regions.size = 1, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:00.191 : INFO: timing SparkBackend.parse_table_ir total 93.247ms self 93.247ms children 0.000ms %children 0.00% 2023-09-29 17:53:00.225 : INFO: RegionPool: initialized for thread 19: Thread-4 2023-09-29 17:53:00.245 : INFO: RegionPool: initialized for thread 19: Thread-4 2023-09-29 17:53:00.245 : INFO: TaskReport: stage=0, partition=0, attempt=0, peakBytes=0, peakBytesReadable=0.00 B, chunks requested=0, cache hits=0 2023-09-29 17:53:00.245 : INFO: RegionPool: FREE: 0 allocated (0 blocks / 0 chunks), regions.size = 0, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:00.245 : INFO: RegionPool: FREE: 64.0K allocated (64.0K blocks / 0 chunks), regions.size = 1, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:00.246 : INFO: timing SparkBackend.parse_value_ir total 20.355ms self 20.355ms children 0.000ms %children 0.00% 2023-09-29 17:53:00.247 : INFO: RegionPool: initialized for thread 19: Thread-4 2023-09-29 17:53:00.255 : INFO: starting execution of query hail_query_1 of initial size 12 2023-09-29 17:53:00.312 : WARN: Failed to compute SemanticHash: SemanticHash unknown: is.hail.expr.ir.TableToTableApply 2023-09-29 17:53:00.312 : INFO: IR Semantic Hash: None 2023-09-29 17:53:00.477 : INFO: initial IR: IR size 12: %1 = RNGStateLiteral !2 = MatrixRead [Matrix{global:Struct{},col_key:[s],col:Struct{s:String},row_key:[[locus,alleles]],row:Struct{locus:Locus(GRCh38),alleles:Array[String]},entry:Struct{GT:Call}}, False, False, (MatrixNativeReader gs://xxx)] !ht = MatrixRowsTable(!2) !ht2 = TableMapRows(!ht) { (%g, %row) => !3 = SelectFields(%row) [(locus alleles)] !4 = SelectFields(!3) [(locus alleles)] InsertFields !4 () } !ht3 = TableDistinct(!ht2) !ht4 = TableToTableApply(!ht3) ["{\"config\":\"file:///vep_data/vep-gcloud.json\",\"csq\":false,\"blockSize\":1000,\"tolerateParseError\":false,\"name\":\"VEP\"}"] TableWrite(!ht4) ["{\"name\":\"TableNativeWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"stageLocally\":false,\"codecSpecJSONStr\":null}"] 2023-09-29 17:53:00.563 : INFO: after optimize: relationalLowerer, initial IR: IR size 5: !1 = MatrixRead [Matrix{global:Struct{},col_key:[s],col:Struct{s:String},row_key:[[locus,alleles]],row:Struct{locus:Locus(GRCh38),alleles:Array[String]},entry:Struct{}}, True, False, (MatrixNativeReader gs://xxx)] !ht = MatrixRowsTable(!1) !ht2 = TableDistinct(!ht) !ht3 = TableToTableApply(!ht2) ["{\"config\":\"file:///vep_data/vep-gcloud.json\",\"csq\":false,\"blockSize\":1000,\"tolerateParseError\":false,\"name\":\"VEP\"}"] TableWrite(!ht3) ["{\"name\":\"TableNativeWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"stageLocally\":false,\"codecSpecJSONStr\":null}"] 2023-09-29 17:53:00.590 : INFO: after LowerMatrixToTable: IR size 18: !ht = TableRead [Table{global:Struct{},key:[locus,alleles],row:Struct{locus:Locus(GRCh38),alleles:Array[String]}}, False, (TableNativeReader gs://xxx)] !ht2 = TableMapGlobals(!ht) { (%g) => !1 = MakeArray [Array[Struct{s:String}]] InsertFields %g (__cols: !1) } !ht3 = TableMapRows(!ht2) { (%g2, %row) => !2 = MakeArray [Array[Struct{}]] InsertFields %row (the entries! [877f12a8827e18f61222c6c8c5fb04a8]: !2) } !ht4 = TableMapGlobals(!ht3) { (%g3) => SelectFields(%g3) [()] } !ht5 = TableMapRows(!ht4) { (%g4, %row2) => SelectFields(%row2) [(locus alleles)] } !ht6 = TableDistinct(!ht5) !ht7 = TableToTableApply(!ht6) ["{\"config\":\"file:///vep_data/vep-gcloud.json\",\"csq\":false,\"blockSize\":1000,\"tolerateParseError\":false,\"name\":\"VEP\"}"] TableWrite(!ht7) ["{\"name\":\"TableNativeWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"stageLocally\":false,\"codecSpecJSONStr\":null}"] 2023-09-29 17:53:00.619 : INFO: Prune: InsertFields: eliminating field '__cols' 2023-09-29 17:53:00.620 : INFO: Prune: InsertFields: eliminating field 'the entries! [877f12a8827e18f61222c6c8c5fb04a8]' 2023-09-29 17:53:00.628 : INFO: after optimize: relationalLowerer, after LowerMatrixToTable: IR size 4: !ht = TableRead [Table{global:Struct{},key:[locus,alleles],row:Struct{locus:Locus(GRCh38),alleles:Array[String]}}, False, (TableNativeReader gs://xxx)] !ht2 = TableDistinct(!ht) !ht3 = TableToTableApply(!ht2) ["{\"config\":\"file:///vep_data/vep-gcloud.json\",\"csq\":false,\"blockSize\":1000,\"tolerateParseError\":false,\"name\":\"VEP\"}"] TableWrite(!ht3) ["{\"name\":\"TableNativeWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"stageLocally\":false,\"codecSpecJSONStr\":null}"] 2023-09-29 17:53:00.631 : INFO: after LiftRelationalValuesToRelationalLets: IR size 4: !ht = TableRead [Table{global:Struct{},key:[locus,alleles],row:Struct{locus:Locus(GRCh38),alleles:Array[String]}}, False, (TableNativeReader gs://xxx)] !ht2 = TableDistinct(!ht) !ht3 = TableToTableApply(!ht2) ["{\"config\":\"file:///vep_data/vep-gcloud.json\",\"csq\":false,\"blockSize\":1000,\"tolerateParseError\":false,\"name\":\"VEP\"}"] TableWrite(!ht3) ["{\"name\":\"TableNativeWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"stageLocally\":false,\"codecSpecJSONStr\":null}"] 2023-09-29 17:53:00.633 : INFO: after EvalRelationalLets: IR size 4: !ht = TableRead [Table{global:Struct{},key:[locus,alleles],row:Struct{locus:Locus(GRCh38),alleles:Array[String]}}, False, (TableNativeReader gs://xxx)] !ht2 = TableDistinct(!ht) !ht3 = TableToTableApply(!ht2) ["{\"config\":\"file:///vep_data/vep-gcloud.json\",\"csq\":false,\"blockSize\":1000,\"tolerateParseError\":false,\"name\":\"VEP\"}"] TableWrite(!ht3) ["{\"name\":\"TableNativeWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"stageLocally\":false,\"codecSpecJSONStr\":null}"] 2023-09-29 17:53:00.637 : INFO: after LowerAndExecuteShuffles: IR size 4: !ht = TableRead [Table{global:Struct{},key:[locus,alleles],row:Struct{locus:Locus(GRCh38),alleles:Array[String]}}, False, (TableNativeReader gs://xxx)] !ht2 = TableDistinct(!ht) !ht3 = TableToTableApply(!ht2) ["{\"config\":\"file:///vep_data/vep-gcloud.json\",\"csq\":false,\"blockSize\":1000,\"tolerateParseError\":false,\"name\":\"VEP\"}"] TableWrite(!ht3) ["{\"name\":\"TableNativeWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"stageLocally\":false,\"codecSpecJSONStr\":null}"] 2023-09-29 17:53:00.640 : INFO: after optimize: relationalLowerer, after LowerAndExecuteShuffles: IR size 4: !ht = TableRead [Table{global:Struct{},key:[locus,alleles],row:Struct{locus:Locus(GRCh38),alleles:Array[String]}}, False, (TableNativeReader gs://xxx)] !ht2 = TableDistinct(!ht) !ht3 = TableToTableApply(!ht2) ["{\"config\":\"file:///vep_data/vep-gcloud.json\",\"csq\":false,\"blockSize\":1000,\"tolerateParseError\":false,\"name\":\"VEP\"}"] TableWrite(!ht3) ["{\"name\":\"TableNativeWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"stageLocally\":false,\"codecSpecJSONStr\":null}"] 2023-09-29 17:53:00.644 : INFO: LowerOrInterpretNonCompilable: cannot efficiently lower query: TableToTableApply 2023-09-29 17:53:00.644 : INFO: interpreting non-compilable result: TableWrite 2023-09-29 17:53:04.418 : INFO: initial IR: IR size 18: !1 = I64 [0] !2 = Str ["gs://xxx..."] !3 = MakeStruct(partitionIndex: !1, partitionPath: !2) !s = ReadPartition(!3) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !4 = ToArray(!s) !c0 = I32 [0] %5 = ArrayRef(!4, !c0) [-1] !6 = MakeStruct(__iruid_1: %5) !7 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!7) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !8 = ToArray(!s3) MakeStruct(globals: %5, broadcastVals: !6, contexts: !8) 2023-09-29 17:53:04.452 : INFO: after optimize: compileLowerer, initial IR: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:04.458 : INFO: after InlineApplyIR: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:04.486 : INFO: after optimize: compileLowerer, after InlineApplyIR: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:04.543 : INFO: after LowerArrayAggsToRunAggs: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:04.560 : INFO: after optimize: compileLowerer, after LowerArrayAggsToRunAggs: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:04.880 : INFO: encoder cache miss (0 hits, 1 misses, 0.000) 2023-09-29 17:53:04.937 : INFO: instruction count: 3: __C45HailClassLoaderContainer. 2023-09-29 17:53:04.938 : INFO: instruction count: 3: __C45HailClassLoaderContainer. 2023-09-29 17:53:04.940 : INFO: instruction count: 3: __C47FSContainer. 2023-09-29 17:53:04.940 : INFO: instruction count: 3: __C47FSContainer. 2023-09-29 17:53:04.949 : INFO: instruction count: 3: __C49etypeEncode. 2023-09-29 17:53:04.950 : INFO: instruction count: 7: __C49etypeEncode.apply 2023-09-29 17:53:04.950 : INFO: instruction count: 33: __C49etypeEncode.__m51ENCODE_SBaseStructPointer_TO_r_struct_of_r_array_of_r_struct_of_r_int64ANDr_binaryENDANDr_struct_of_r_int64ANDr_binaryENDEND 2023-09-29 17:53:04.951 : INFO: instruction count: 35: __C49etypeEncode.__m52ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_int64ANDr_binaryEND 2023-09-29 17:53:04.952 : INFO: instruction count: 25: __C49etypeEncode.__m53ENCODE_SBaseStructPointer_TO_r_struct_of_r_int64ANDr_binaryEND 2023-09-29 17:53:04.952 : INFO: instruction count: 4: __C49etypeEncode.__m54ENCODE_SInt64$_TO_r_int64 2023-09-29 17:53:04.952 : INFO: instruction count: 16: __C49etypeEncode.__m55ENCODE_SStringPointer_TO_r_binary 2023-09-29 17:53:04.976 : INFO: RegionPool: REPORT_THRESHOLD: 2.1M allocated (128.0K blocks / 2.0M chunks), regions.size = 2, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:04.982 : INFO: RegionPool: REPORT_THRESHOLD: 2.2M allocated (128.0K blocks / 2.1M chunks), regions.size = 2, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:04.985 : INFO: RegionPool: REPORT_THRESHOLD: 2.3M allocated (192.0K blocks / 2.1M chunks), regions.size = 2, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:04.987 : INFO: RegionPool: REPORT_THRESHOLD: 2.3M allocated (256.0K blocks / 2.1M chunks), regions.size = 2, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:05.008 : INFO: RegionPool: REPORT_THRESHOLD: 4.0M allocated (1.9M blocks / 2.1M chunks), regions.size = 2, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:05.031 : INFO: RegionPool: REPORT_THRESHOLD: 8.0M allocated (5.9M blocks / 2.1M chunks), regions.size = 2, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:05.058 : INFO: RegionPool: REPORT_THRESHOLD: 16.0M allocated (13.9M blocks / 2.1M chunks), regions.size = 2, 0 current java objects, thread 19: Thread-4 2023-09-29 17:53:05.513 : INFO: instruction count: 3: __C1HailClassLoaderContainer. 2023-09-29 17:53:05.513 : INFO: instruction count: 3: __C1HailClassLoaderContainer. 2023-09-29 17:53:05.514 : INFO: instruction count: 3: __C3FSContainer. 2023-09-29 17:53:05.514 : INFO: instruction count: 3: __C3FSContainer. 2023-09-29 17:53:05.535 : INFO: instruction count: 3: __C5Compiled. 2023-09-29 17:53:05.535 : INFO: instruction count: 87: __C5Compiled.apply 2023-09-29 17:53:05.538 : INFO: instruction count: 294: __C5Compiled.__m7split_ToArray 2023-09-29 17:53:05.539 : INFO: instruction count: 18: __C5Compiled.__m15DECODE_r_struct_of_END_TO_SBaseStructPointer 2023-09-29 17:53:05.539 : INFO: instruction count: 12: __C5Compiled.__m18setup_jab 2023-09-29 17:53:05.540 : INFO: instruction count: 35: __C5Compiled.__m23arrayref_bounds_check 2023-09-29 17:53:05.541 : INFO: instruction count: 156: __C5Compiled.__m25split_ToArray 2023-09-29 17:53:05.541 : INFO: instruction count: 9: __C5Compiled.setPartitionIndex 2023-09-29 17:53:05.541 : INFO: instruction count: 4: __C5Compiled.addPartitionRegion 2023-09-29 17:53:05.541 : INFO: instruction count: 4: __C5Compiled.setPool 2023-09-29 17:53:05.541 : INFO: instruction count: 3: __C5Compiled.addHailClassLoader 2023-09-29 17:53:05.541 : INFO: instruction count: 3: __C5Compiled.addFS 2023-09-29 17:53:05.542 : INFO: instruction count: 4: __C5Compiled.addTaskContext 2023-09-29 17:53:05.543 : INFO: instruction count: 75: __C5Compiled.addAndDecodeLiterals 2023-09-29 17:53:05.544 : INFO: instruction count: 36: __C5Compiled.__m40DECODE_r_struct_of_r_array_of_r_struct_of_r_int64ANDr_binaryENDANDr_struct_of_r_int64ANDr_binaryENDEND_TO_SBaseStructPointer 2023-09-29 17:53:05.544 : INFO: instruction count: 58: __C5Compiled.__m41INPLACE_DECODE_r_array_of_r_struct_of_r_int64ANDr_binaryEND_TO_r_array_of_r_struct_of_r_int64ANDr_stringEND 2023-09-29 17:53:05.545 : INFO: instruction count: 26: __C5Compiled.__m42INPLACE_DECODE_r_struct_of_r_int64ANDr_binaryEND_TO_r_struct_of_r_int64ANDr_stringEND 2023-09-29 17:53:05.545 : INFO: instruction count: 10: __C5Compiled.__m43INPLACE_DECODE_r_int64_TO_r_int64 2023-09-29 17:53:05.545 : INFO: instruction count: 31: __C5Compiled.__m44INPLACE_DECODE_r_binary_TO_r_string 2023-09-29 17:53:05.549 : INFO: initial IR: IR size 18: !1 = I64 [0] !2 = Str ["gs://xxx..."] !3 = MakeStruct(partitionIndex: !1, partitionPath: !2) !s = ReadPartition(!3) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !4 = ToArray(!s) !c0 = I32 [0] %5 = ArrayRef(!4, !c0) [-1] !6 = MakeStruct(__iruid_1: %5) !7 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!7) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !8 = ToArray(!s3) MakeStruct(globals: %5, broadcastVals: !6, contexts: !8) 2023-09-29 17:53:05.573 : INFO: after optimize: compileLowerer, initial IR: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:05.576 : INFO: after InlineApplyIR: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:05.590 : INFO: after optimize: compileLowerer, after InlineApplyIR: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:05.605 : INFO: after LowerArrayAggsToRunAggs: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:05.616 : INFO: after optimize: compileLowerer, after LowerArrayAggsToRunAggs: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:05.662 : INFO: encoder cache hit 2023-09-29 17:53:05.770 : INFO: instruction count: 3: __C56HailClassLoaderContainer. 2023-09-29 17:53:05.771 : INFO: instruction count: 3: __C56HailClassLoaderContainer. 2023-09-29 17:53:05.771 : INFO: instruction count: 3: __C58FSContainer. 2023-09-29 17:53:05.772 : INFO: instruction count: 3: __C58FSContainer. 2023-09-29 17:53:05.782 : INFO: instruction count: 3: __C60Compiled. 2023-09-29 17:53:05.783 : INFO: instruction count: 87: __C60Compiled.apply 2023-09-29 17:53:05.785 : INFO: instruction count: 294: __C60Compiled.__m62split_ToArray 2023-09-29 17:53:05.786 : INFO: instruction count: 18: __C60Compiled.__m70DECODE_r_struct_of_END_TO_SBaseStructPointer 2023-09-29 17:53:05.786 : INFO: instruction count: 12: __C60Compiled.__m73setup_jab 2023-09-29 17:53:05.786 : INFO: instruction count: 35: __C60Compiled.__m78arrayref_bounds_check 2023-09-29 17:53:05.787 : INFO: instruction count: 156: __C60Compiled.__m80split_ToArray 2023-09-29 17:53:05.787 : INFO: instruction count: 9: __C60Compiled.setPartitionIndex 2023-09-29 17:53:05.787 : INFO: instruction count: 4: __C60Compiled.addPartitionRegion 2023-09-29 17:53:05.787 : INFO: instruction count: 4: __C60Compiled.setPool 2023-09-29 17:53:05.788 : INFO: instruction count: 3: __C60Compiled.addHailClassLoader 2023-09-29 17:53:05.788 : INFO: instruction count: 3: __C60Compiled.addFS 2023-09-29 17:53:05.788 : INFO: instruction count: 4: __C60Compiled.addTaskContext 2023-09-29 17:53:05.788 : INFO: instruction count: 75: __C60Compiled.addAndDecodeLiterals 2023-09-29 17:53:05.789 : INFO: instruction count: 36: __C60Compiled.__m95DECODE_r_struct_of_r_array_of_r_struct_of_r_int64ANDr_binaryENDANDr_struct_of_r_int64ANDr_binaryENDEND_TO_SBaseStructPointer 2023-09-29 17:53:05.789 : INFO: instruction count: 58: __C60Compiled.__m96INPLACE_DECODE_r_array_of_r_struct_of_r_int64ANDr_binaryEND_TO_r_array_of_r_struct_of_r_int64ANDr_stringEND 2023-09-29 17:53:05.789 : INFO: instruction count: 26: __C60Compiled.__m97INPLACE_DECODE_r_struct_of_r_int64ANDr_binaryEND_TO_r_struct_of_r_int64ANDr_stringEND 2023-09-29 17:53:05.790 : INFO: instruction count: 10: __C60Compiled.__m98INPLACE_DECODE_r_int64_TO_r_int64 2023-09-29 17:53:05.790 : INFO: instruction count: 31: __C60Compiled.__m99INPLACE_DECODE_r_binary_TO_r_string 2023-09-29 17:53:05.799 : INFO: initial IR: IR size 18: !1 = I64 [0] !2 = Str ["gs://xxx..."] !3 = MakeStruct(partitionIndex: !1, partitionPath: !2) !s = ReadPartition(!3) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !4 = ToArray(!s) !c0 = I32 [0] %5 = ArrayRef(!4, !c0) [-1] !6 = MakeStruct(__iruid_1: %5) !7 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!7) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !8 = ToArray(!s3) MakeStruct(globals: %5, broadcastVals: !6, contexts: !8) 2023-09-29 17:53:05.811 : INFO: after optimize: compileLowerer, initial IR: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:05.813 : INFO: after InlineApplyIR: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:05.824 : INFO: after optimize: compileLowerer, after InlineApplyIR: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:05.838 : INFO: after LowerArrayAggsToRunAggs: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:05.848 : INFO: after optimize: compileLowerer, after LowerArrayAggsToRunAggs: IR size 16: !1 = Literal [Struct{partitionIndex:Int64,partitionPath:String}, ] !s = ReadPartition(!1) [Struct{}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] !2 = ToArray(!s) !c0 = I32 [0] %3 = ArrayRef(!2, !c0) [-1] !4 = MakeStruct(__iruid_1: %3) !5 = Literal [Array[Struct{partitionIndex:Int64,partitionPath:String}], ] !s2 = ToStream(!5) [False] !s3 = StreamMap(!s2) { (%elt) => MakeStruct(context: %elt) } !6 = ToArray(!s3) MakeStruct(globals: %3, broadcastVals: !4, contexts: !6) 2023-09-29 17:53:05.891 : INFO: encoder cache hit 2023-09-29 17:53:05.997 : INFO: instruction count: 3: __C100HailClassLoaderContainer. 2023-09-29 17:53:05.997 : INFO: instruction count: 3: __C100HailClassLoaderContainer. 2023-09-29 17:53:05.998 : INFO: instruction count: 3: __C102FSContainer. 2023-09-29 17:53:05.998 : INFO: instruction count: 3: __C102FSContainer. 2023-09-29 17:53:06.006 : INFO: instruction count: 3: __C104Compiled. 2023-09-29 17:53:06.007 : INFO: instruction count: 87: __C104Compiled.apply 2023-09-29 17:53:06.008 : INFO: instruction count: 294: __C104Compiled.__m106split_ToArray 2023-09-29 17:53:06.008 : INFO: instruction count: 18: __C104Compiled.__m114DECODE_r_struct_of_END_TO_SBaseStructPointer 2023-09-29 17:53:06.009 : INFO: instruction count: 12: __C104Compiled.__m117setup_jab 2023-09-29 17:53:06.009 : INFO: instruction count: 35: __C104Compiled.__m122arrayref_bounds_check 2023-09-29 17:53:06.010 : INFO: instruction count: 156: __C104Compiled.__m124split_ToArray 2023-09-29 17:53:06.010 : INFO: instruction count: 9: __C104Compiled.setPartitionIndex 2023-09-29 17:53:06.010 : INFO: instruction count: 4: __C104Compiled.addPartitionRegion 2023-09-29 17:53:06.010 : INFO: instruction count: 4: __C104Compiled.setPool 2023-09-29 17:53:06.010 : INFO: instruction count: 3: __C104Compiled.addHailClassLoader 2023-09-29 17:53:06.010 : INFO: instruction count: 3: __C104Compiled.addFS 2023-09-29 17:53:06.011 : INFO: instruction count: 4: __C104Compiled.addTaskContext 2023-09-29 17:53:06.011 : INFO: instruction count: 75: __C104Compiled.addAndDecodeLiterals 2023-09-29 17:53:06.011 : INFO: instruction count: 36: __C104Compiled.__m139DECODE_r_struct_of_r_array_of_r_struct_of_r_int64ANDr_binaryENDANDr_struct_of_r_int64ANDr_binaryENDEND_TO_SBaseStructPointer 2023-09-29 17:53:06.012 : INFO: instruction count: 58: __C104Compiled.__m140INPLACE_DECODE_r_array_of_r_struct_of_r_int64ANDr_binaryEND_TO_r_array_of_r_struct_of_r_int64ANDr_stringEND 2023-09-29 17:53:06.012 : INFO: instruction count: 26: __C104Compiled.__m141INPLACE_DECODE_r_struct_of_r_int64ANDr_binaryEND_TO_r_struct_of_r_int64ANDr_stringEND 2023-09-29 17:53:06.012 : INFO: instruction count: 10: __C104Compiled.__m142INPLACE_DECODE_r_int64_TO_r_int64 2023-09-29 17:53:06.012 : INFO: instruction count: 31: __C104Compiled.__m143INPLACE_DECODE_r_binary_TO_r_string 2023-09-29 17:53:06.222 : INFO: encoder cache miss (2 hits, 2 misses, 0.500) 2023-09-29 17:53:06.224 : INFO: instruction count: 3: __C144HailClassLoaderContainer. 2023-09-29 17:53:06.224 : INFO: instruction count: 3: __C144HailClassLoaderContainer. 2023-09-29 17:53:06.225 : INFO: instruction count: 3: __C146FSContainer. 2023-09-29 17:53:06.225 : INFO: instruction count: 3: __C146FSContainer. 2023-09-29 17:53:06.226 : INFO: instruction count: 3: __C148etypeEncode. 2023-09-29 17:53:06.226 : INFO: instruction count: 7: __C148etypeEncode.apply 2023-09-29 17:53:06.226 : INFO: instruction count: 9: __C148etypeEncode.__m150ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_ENDEND 2023-09-29 17:53:06.226 : INFO: instruction count: 1: __C148etypeEncode.__m151ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-09-29 17:53:06.231 : INFO: decoder cache miss (0 hits, 1 misses, 0.000 2023-09-29 17:53:06.234 : INFO: instruction count: 3: __C152HailClassLoaderContainer. 2023-09-29 17:53:06.234 : INFO: instruction count: 3: __C152HailClassLoaderContainer. 2023-09-29 17:53:06.235 : INFO: instruction count: 3: __C154FSContainer. 2023-09-29 17:53:06.235 : INFO: instruction count: 3: __C154FSContainer. 2023-09-29 17:53:06.236 : INFO: instruction count: 3: __C156etypeDecode. 2023-09-29 17:53:06.236 : INFO: instruction count: 7: __C156etypeDecode.apply 2023-09-29 17:53:06.236 : INFO: instruction count: 27: __C156etypeDecode.__m158DECODE_r_struct_of_r_struct_of_ENDEND_TO_SBaseStructPointer 2023-09-29 17:53:06.236 : INFO: instruction count: 8: __C156etypeDecode.__m159INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-09-29 17:53:06.238 : INFO: decoder cache miss (0 hits, 2 misses, 0.000 2023-09-29 17:53:06.241 : INFO: instruction count: 3: __C160HailClassLoaderContainer. 2023-09-29 17:53:06.241 : INFO: instruction count: 3: __C160HailClassLoaderContainer. 2023-09-29 17:53:06.241 : INFO: instruction count: 3: __C162FSContainer. 2023-09-29 17:53:06.242 : INFO: instruction count: 3: __C162FSContainer. 2023-09-29 17:53:06.243 : INFO: instruction count: 3: __C164etypeDecode. 2023-09-29 17:53:06.243 : INFO: instruction count: 7: __C164etypeDecode.apply 2023-09-29 17:53:06.243 : INFO: instruction count: 27: __C164etypeDecode.__m166DECODE_r_struct_of_r_struct_of_r_int64ANDr_binaryENDEND_TO_SBaseStructPointer 2023-09-29 17:53:06.243 : INFO: instruction count: 26: __C164etypeDecode.__m167INPLACE_DECODE_r_struct_of_r_int64ANDr_binaryEND_TO_r_struct_of_r_int64ANDr_stringEND 2023-09-29 17:53:06.244 : INFO: instruction count: 10: __C164etypeDecode.__m168INPLACE_DECODE_r_int64_TO_r_int64 2023-09-29 17:53:06.244 : INFO: instruction count: 31: __C164etypeDecode.__m169INPLACE_DECODE_r_binary_TO_r_string 2023-09-29 17:53:06.244 : INFO: encoder cache miss (2 hits, 3 misses, 0.400) 2023-09-29 17:53:06.246 : INFO: instruction count: 3: __C170HailClassLoaderContainer. 2023-09-29 17:53:06.247 : INFO: instruction count: 3: __C170HailClassLoaderContainer. 2023-09-29 17:53:06.247 : INFO: instruction count: 3: __C172FSContainer. 2023-09-29 17:53:06.247 : INFO: instruction count: 3: __C172FSContainer. 2023-09-29 17:53:06.248 : INFO: instruction count: 3: __C174etypeEncode. 2023-09-29 17:53:06.249 : INFO: instruction count: 7: __C174etypeEncode.apply 2023-09-29 17:53:06.249 : INFO: instruction count: 9: __C174etypeEncode.__m176ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_int64ANDr_binaryENDEND 2023-09-29 17:53:06.249 : INFO: instruction count: 25: __C174etypeEncode.__m177ENCODE_SBaseStructPointer_TO_r_struct_of_r_int64ANDr_binaryEND 2023-09-29 17:53:06.249 : INFO: instruction count: 4: __C174etypeEncode.__m178ENCODE_SInt64$_TO_r_int64 2023-09-29 17:53:06.249 : INFO: instruction count: 16: __C174etypeEncode.__m179ENCODE_SStringPointer_TO_r_binary 2023-09-29 17:53:09.321 : INFO: initial IR: IR size 10: !1 = In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{__iruid_1:+PCStruct{}})), 1] %2 = GetField(!1) [__iruid_1] %3 = In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{context:+PCStruct{partitionIndex:+PInt64,partitionPath:+PCString}})), 0] %4 = GetField(%3) [context] ReadPartition(%4) [Struct{locus:Locus(GRCh38),alleles:Array[String]}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary]}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] 2023-09-29 17:53:09.327 : INFO: after optimize: compileLowerer, initial IR: IR size 3: !1 = In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{context:+PCStruct{partitionIndex:+PInt64,partitionPath:+PCString}})), 0] !2 = GetField(!1) [context] ReadPartition(!2) [Struct{locus:Locus(GRCh38),alleles:Array[String]}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary]}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] 2023-09-29 17:53:09.329 : INFO: after InlineApplyIR: IR size 3: !1 = In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{context:+PCStruct{partitionIndex:+PInt64,partitionPath:+PCString}})), 0] !2 = GetField(!1) [context] ReadPartition(!2) [Struct{locus:Locus(GRCh38),alleles:Array[String]}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary]}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] 2023-09-29 17:53:09.331 : INFO: after optimize: compileLowerer, after InlineApplyIR: IR size 3: !1 = In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{context:+PCStruct{partitionIndex:+PInt64,partitionPath:+PCString}})), 0] !2 = GetField(!1) [context] ReadPartition(!2) [Struct{locus:Locus(GRCh38),alleles:Array[String]}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary]}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] 2023-09-29 17:53:09.334 : INFO: after LowerArrayAggsToRunAggs: IR size 3: !1 = In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{context:+PCStruct{partitionIndex:+PInt64,partitionPath:+PCString}})), 0] !2 = GetField(!1) [context] ReadPartition(!2) [Struct{locus:Locus(GRCh38),alleles:Array[String]}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary]}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] 2023-09-29 17:53:09.336 : INFO: after optimize: compileLowerer, after LowerArrayAggsToRunAggs: IR size 3: !1 = In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{context:+PCStruct{partitionIndex:+PInt64,partitionPath:+PCString}})), 0] !2 = GetField(!1) [context] ReadPartition(!2) [Struct{locus:Locus(GRCh38),alleles:Array[String]}, "{\"name\":\"PartitionNativeReader\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary]}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String]}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"LZ4HCBlockBufferSpec\",\"blockSize\":32768,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"uidFieldName\":\"__row_uid\"}"] 2023-09-29 17:53:09.353 : INFO: instruction count: 3: __C180HailClassLoaderContainer. 2023-09-29 17:53:09.353 : INFO: instruction count: 3: __C180HailClassLoaderContainer. 2023-09-29 17:53:09.353 : INFO: instruction count: 3: __C182FSContainer. 2023-09-29 17:53:09.354 : INFO: instruction count: 3: __C182FSContainer. 2023-09-29 17:53:09.357 : INFO: instruction count: 3: __C184stream_Let. 2023-09-29 17:53:09.358 : INFO: instruction count: 153: __C184stream_Let.apply 2023-09-29 17:53:09.358 : INFO: instruction count: 7: __C184stream_Let.setRegions 2023-09-29 17:53:09.359 : INFO: instruction count: 85: __C184stream_Let.__m196DECODE_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryEND_TO_SBaseStructPointer 2023-09-29 17:53:09.359 : INFO: instruction count: 26: __C184stream_Let.__m197INPLACE_DECODE_o_struct_of_r_binaryANDr_int32END_TO_o_locus 2023-09-29 17:53:09.359 : INFO: instruction count: 31: __C184stream_Let.__m198INPLACE_DECODE_r_binary_TO_r_string 2023-09-29 17:53:09.359 : INFO: instruction count: 10: __C184stream_Let.__m199INPLACE_DECODE_r_int32_TO_r_int32 2023-09-29 17:53:09.360 : INFO: instruction count: 114: __C184stream_Let.__m200INPLACE_DECODE_o_array_of_o_binary_TO_o_array_of_o_string 2023-09-29 17:53:09.360 : INFO: instruction count: 31: __C184stream_Let.__m201INPLACE_DECODE_o_binary_TO_o_string 2023-09-29 17:53:09.360 : INFO: instruction count: 3: __C184stream_Let.loadAddress 2023-09-29 17:53:09.360 : INFO: instruction count: 9: __C184stream_Let.setPartitionIndex 2023-09-29 17:53:09.360 : INFO: instruction count: 4: __C184stream_Let.addPartitionRegion 2023-09-29 17:53:09.360 : INFO: instruction count: 4: __C184stream_Let.setPool 2023-09-29 17:53:09.360 : INFO: instruction count: 3: __C184stream_Let.addHailClassLoader 2023-09-29 17:53:09.361 : INFO: instruction count: 3: __C184stream_Let.addFS 2023-09-29 17:53:09.361 : INFO: instruction count: 4: __C184stream_Let.addTaskContext 2023-09-29 17:53:10.045 : INFO: encoder cache miss (2 hits, 4 misses, 0.333) 2023-09-29 17:53:10.047 : INFO: instruction count: 3: __C209HailClassLoaderContainer. 2023-09-29 17:53:10.047 : INFO: instruction count: 3: __C209HailClassLoaderContainer. 2023-09-29 17:53:10.048 : INFO: instruction count: 3: __C211FSContainer. 2023-09-29 17:53:10.048 : INFO: instruction count: 3: __C211FSContainer. 2023-09-29 17:53:10.048 : INFO: instruction count: 3: __C213etypeEncode. 2023-09-29 17:53:10.048 : INFO: instruction count: 7: __C213etypeEncode.apply 2023-09-29 17:53:10.049 : INFO: instruction count: 1: __C213etypeEncode.__m215ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-09-29 17:53:11.259 : INFO: initial IR: IR size 57: %1 = EncodedLiteral [Struct{}] !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !2 = Literal [Array[String], ] !s2 = ToStream(!2) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !3 = MakeStruct(__iruid_62: %1) !4 = NA [String] %11 = CollectDistributedArray(!s3, !3, !4) { (%ctx, %g) => %5 = GetField(%g) [__iruid_62] %6 = GetField(%ctx) [oldCtx] %7 = Ref [__iruid_67] !s4 = ReadPartition(%7) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !8 = GetField(%ctx) [writeCtx] !9 = UUID4 [__iruid_69] !10 = Apply(!8, !9) [-1, concat, (), String] WritePartition(!s4, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } %12 = Ref [__iruid_70] !s5 = MakeStream(%1) [Stream[Struct{}], False] !13 = Str ["part-0"] !14 = WritePartition(!s5, !13) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !15 = GetField(!14) [filePath] !16 = MakeArray(!15) [Array[String]] !17 = WriteMetadata(!16) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%12) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !18 = ToArray(!s7) !19 = WriteMetadata(!18) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%12) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !20 = ToArray(!s9) !21 = WriteMetadata(!20) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !22 = Begin(!17, !19, !21) WriteMetadata(!22) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:11.296 : INFO: Prune: MakeStruct: eliminating field '__iruid_62' 2023-09-29 17:53:11.762 : INFO: after optimize: relationalLowerer, initial IR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:12.109 : INFO: after LowerMatrixToTable: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:12.429 : INFO: after optimize: relationalLowerer, after LowerMatrixToTable: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:12.720 : INFO: after LiftRelationalValuesToRelationalLets: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:13.006 : INFO: after EvalRelationalLets: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:13.297 : INFO: after LowerAndExecuteShuffles: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:13.612 : INFO: after optimize: relationalLowerer, after LowerAndExecuteShuffles: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:13.902 : INFO: after LowerOrInterpretNonCompilable: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:14.207 : INFO: after optimize: relationalLowerer, after LowerOrInterpretNonCompilable: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:14.905 : INFO: initial IR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:15.207 : INFO: after optimize: compileLowerer, initial IR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:15.488 : INFO: after InlineApplyIR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:15.790 : INFO: after optimize: compileLowerer, after InlineApplyIR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:16.095 : INFO: after LowerArrayAggsToRunAggs: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:16.396 : INFO: after optimize: compileLowerer, after LowerArrayAggsToRunAggs: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:16.457 : INFO: initial IR: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.459 : INFO: after optimize: compileLowerer, initial IR: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.459 : INFO: after InlineApplyIR: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.460 : INFO: after optimize: compileLowerer, after InlineApplyIR: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.461 : INFO: after LowerArrayAggsToRunAggs: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.461 : INFO: after optimize: compileLowerer, after LowerArrayAggsToRunAggs: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.464 : INFO: instruction count: 3: __C261HailClassLoaderContainer. 2023-09-29 17:53:16.464 : INFO: instruction count: 3: __C261HailClassLoaderContainer. 2023-09-29 17:53:16.464 : INFO: instruction count: 3: __C263FSContainer. 2023-09-29 17:53:16.465 : INFO: instruction count: 3: __C263FSContainer. 2023-09-29 17:53:16.465 : INFO: instruction count: 3: __C265Compiled. 2023-09-29 17:53:16.466 : INFO: instruction count: 12: __C265Compiled.apply 2023-09-29 17:53:16.466 : INFO: instruction count: 9: __C265Compiled.setPartitionIndex 2023-09-29 17:53:16.466 : INFO: instruction count: 4: __C265Compiled.addPartitionRegion 2023-09-29 17:53:16.466 : INFO: instruction count: 4: __C265Compiled.setPool 2023-09-29 17:53:16.466 : INFO: instruction count: 3: __C265Compiled.addHailClassLoader 2023-09-29 17:53:16.466 : INFO: instruction count: 3: __C265Compiled.addFS 2023-09-29 17:53:16.467 : INFO: instruction count: 4: __C265Compiled.addTaskContext 2023-09-29 17:53:16.467 : INFO: initial IR: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.468 : INFO: after optimize: compileLowerer, initial IR: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.468 : INFO: after InlineApplyIR: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.469 : INFO: after optimize: compileLowerer, after InlineApplyIR: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.469 : INFO: after LowerArrayAggsToRunAggs: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.470 : INFO: after optimize: compileLowerer, after LowerArrayAggsToRunAggs: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.472 : INFO: instruction count: 3: __C273HailClassLoaderContainer. 2023-09-29 17:53:16.473 : INFO: instruction count: 3: __C273HailClassLoaderContainer. 2023-09-29 17:53:16.473 : INFO: instruction count: 3: __C275FSContainer. 2023-09-29 17:53:16.473 : INFO: instruction count: 3: __C275FSContainer. 2023-09-29 17:53:16.474 : INFO: instruction count: 3: __C277Compiled. 2023-09-29 17:53:16.474 : INFO: instruction count: 12: __C277Compiled.apply 2023-09-29 17:53:16.474 : INFO: instruction count: 9: __C277Compiled.setPartitionIndex 2023-09-29 17:53:16.474 : INFO: instruction count: 4: __C277Compiled.addPartitionRegion 2023-09-29 17:53:16.474 : INFO: instruction count: 4: __C277Compiled.setPool 2023-09-29 17:53:16.474 : INFO: instruction count: 3: __C277Compiled.addHailClassLoader 2023-09-29 17:53:16.474 : INFO: instruction count: 3: __C277Compiled.addFS 2023-09-29 17:53:16.475 : INFO: instruction count: 4: __C277Compiled.addTaskContext 2023-09-29 17:53:16.475 : INFO: initial IR: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.476 : INFO: after optimize: compileLowerer, initial IR: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.476 : INFO: after InlineApplyIR: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.477 : INFO: after optimize: compileLowerer, after InlineApplyIR: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.477 : INFO: after LowerArrayAggsToRunAggs: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.478 : INFO: after optimize: compileLowerer, after LowerArrayAggsToRunAggs: IR size 1: In [SingleCodeEmitParamType(true, PTypeReferenceSingleCodeType(+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString],vep:PCStruct{assembly_name:PCString,allele_string:PCString,ancestral:PCString,colocated_variants:PCArray[PCStruct{aa_allele:PCString,aa_maf:PFloat64,afr_allele:PCString,afr_maf:PFloat64,allele_string:PCString,amr_allele:PCString,amr_maf:PFloat64,clin_sig:PCArray[PCString],end:PInt32,eas_allele:PCString,eas_maf:PFloat64,ea_allele:PCString,ea_maf:PFloat64,eur_allele:PCString,eur_maf:PFloat64,exac_adj_allele:PCString,exac_adj_maf:PFloat64,exac_allele:PCString,exac_afr_allele:PCString,exac_afr_maf:PFloat64,exac_amr_allele:PCString,exac_amr_maf:PFloat64,exac_eas_allele:PCString,exac_eas_maf:PFloat64,exac_fin_allele:PCString,exac_fin_maf:PFloat64,exac_maf:PFloat64,exac_nfe_allele:PCString,exac_nfe_maf:PFloat64,exac_oth_allele:PCString,exac_oth_maf:PFloat64,exac_sas_allele:PCString,exac_sas_maf:PFloat64,id:PCString,minor_allele:PCString,minor_allele_freq:PFloat64,phenotype_or_disease:PInt32,pubmed:PCArray[PInt32],sas_allele:PCString,sas_maf:PFloat64,somatic:PInt32,start:PInt32,strand:PInt32}],context:PCString,end:PInt32,id:PCString,input:PCString,intergenic_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,variant_allele:PCString}],most_severe_consequence:PCString,motif_feature_consequences:PCArray[PCStruct{allele_num:PInt32,consequence_terms:PCArray[PCString],high_inf_pos:PCString,impact:PCString,minimised:PInt32,motif_feature_id:PCString,motif_name:PCString,motif_pos:PInt32,motif_score_change:PFloat64,strand:PInt32,variant_allele:PCString}],regulatory_feature_consequences:PCArray[PCStruct{allele_num:PInt32,biotype:PCString,consequence_terms:PCArray[PCString],impact:PCString,minimised:PInt32,regulatory_feature_id:PCString,variant_allele:PCString}],seq_region_name:PCString,start:PInt32,strand:PInt32,transcript_consequences:PCArray[PCStruct{allele_num:PInt32,amino_acids:PCString,appris:PCString,biotype:PCString,canonical:PInt32,ccds:PCString,cdna_start:PInt32,cdna_end:PInt32,cds_end:PInt32,cds_start:PInt32,codons:PCString,consequence_terms:PCArray[PCString],distance:PInt32,domains:PCArray[PCStruct{db:PCString,name:PCString}],exon:PCString,gene_id:PCString,gene_pheno:PInt32,gene_symbol:PCString,gene_symbol_source:PCString,hgnc_id:PCString,hgvsc:PCString,hgvsp:PCString,hgvs_offset:PInt32,impact:PCString,intron:PCString,lof:PCString,lof_flags:PCString,lof_filter:PCString,lof_info:PCString,minimised:PInt32,polyphen_prediction:PCString,polyphen_score:PFloat64,protein_end:PInt32,protein_start:PInt32,protein_id:PCString,sift_prediction:PCString,sift_score:PFloat64,strand:PInt32,swissprot:PCString,transcript_id:PCString,trembl:PCString,tsl:PInt32,uniparc:PCString,variant_allele:PCString}],variant_class:PCString},vep_proc_id:+PCStruct{part_idx:+PInt32,block_idx:+PInt32}})), 0] 2023-09-29 17:53:16.480 : INFO: instruction count: 3: __C285HailClassLoaderContainer. 2023-09-29 17:53:16.480 : INFO: instruction count: 3: __C285HailClassLoaderContainer. 2023-09-29 17:53:16.481 : INFO: instruction count: 3: __C287FSContainer. 2023-09-29 17:53:16.481 : INFO: instruction count: 3: __C287FSContainer. 2023-09-29 17:53:16.482 : INFO: instruction count: 3: __C289Compiled. 2023-09-29 17:53:16.482 : INFO: instruction count: 12: __C289Compiled.apply 2023-09-29 17:53:16.482 : INFO: instruction count: 9: __C289Compiled.setPartitionIndex 2023-09-29 17:53:16.482 : INFO: instruction count: 4: __C289Compiled.addPartitionRegion 2023-09-29 17:53:16.482 : INFO: instruction count: 4: __C289Compiled.setPool 2023-09-29 17:53:16.482 : INFO: instruction count: 3: __C289Compiled.addHailClassLoader 2023-09-29 17:53:16.482 : INFO: instruction count: 3: __C289Compiled.addFS 2023-09-29 17:53:16.482 : INFO: instruction count: 4: __C289Compiled.addTaskContext 2023-09-29 17:53:16.831 : INFO: instruction count: 3: __C242HailClassLoaderContainer. 2023-09-29 17:53:16.831 : INFO: instruction count: 3: __C242HailClassLoaderContainer. 2023-09-29 17:53:16.831 : INFO: instruction count: 3: __C244FSContainer. 2023-09-29 17:53:16.831 : INFO: instruction count: 3: __C244FSContainer. 2023-09-29 17:53:16.946 : INFO: instruction count: 3: __C246collect_distributed_array_table_native_writer. 2023-09-29 17:53:16.948 : INFO: instruction count: 181: __C246collect_distributed_array_table_native_writer.apply 2023-09-29 17:53:16.948 : INFO: instruction count: 17: __C246collect_distributed_array_table_native_writer.apply 2023-09-29 17:53:16.948 : INFO: instruction count: 27: __C246collect_distributed_array_table_native_writer.__m248DECODE_r_struct_of_r_struct_of_r_int32ANDr_binaryENDEND_TO_SBaseStructPointer 2023-09-29 17:53:16.949 : INFO: instruction count: 26: __C246collect_distributed_array_table_native_writer.__m249INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryEND_TO_r_struct_of_r_int32ANDr_stringEND 2023-09-29 17:53:16.949 : INFO: instruction count: 10: __C246collect_distributed_array_table_native_writer.__m250INPLACE_DECODE_r_int32_TO_r_int32 2023-09-29 17:53:16.949 : INFO: instruction count: 31: __C246collect_distributed_array_table_native_writer.__m251INPLACE_DECODE_r_binary_TO_r_string 2023-09-29 17:53:16.949 : INFO: instruction count: 27: __C246collect_distributed_array_table_native_writer.__m253DECODE_r_struct_of_r_struct_of_ENDEND_TO_SBaseStructPointer 2023-09-29 17:53:16.950 : INFO: instruction count: 8: __C246collect_distributed_array_table_native_writer.__m254INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-09-29 17:53:16.950 : INFO: instruction count: 49: __C246collect_distributed_array_table_native_writer.__m258concat 2023-09-29 17:53:16.953 : INFO: instruction count: 653: __C246collect_distributed_array_table_native_writer.__m313writeInternalNode 2023-09-29 17:53:16.954 : INFO: instruction count: 25: __C246collect_distributed_array_table_native_writer.__m314ENCODE_SBaseStructPointer_TO_o_struct_of_r_array_of_r_struct_of_r_int64ANDr_int64ANDr_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDENDEND 2023-09-29 17:53:16.954 : INFO: instruction count: 35: __C246collect_distributed_array_table_native_writer.__m315ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_int64ANDr_int64ANDr_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDEND 2023-09-29 17:53:16.955 : INFO: instruction count: 53: __C246collect_distributed_array_table_native_writer.__m316ENCODE_SBaseStructPointer_TO_r_struct_of_r_int64ANDr_int64ANDr_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDEND 2023-09-29 17:53:16.955 : INFO: instruction count: 4: __C246collect_distributed_array_table_native_writer.__m317ENCODE_SInt64$_TO_r_int64 2023-09-29 17:53:16.955 : INFO: instruction count: 96: __C246collect_distributed_array_table_native_writer.__m318ENCODE_SBaseStructPointer_TO_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryEND 2023-09-29 17:53:16.956 : INFO: instruction count: 25: __C246collect_distributed_array_table_native_writer.__m319ENCODE_SCanonicalLocusPointer_TO_o_struct_of_r_binaryANDr_int32END 2023-09-29 17:53:16.956 : INFO: instruction count: 16: __C246collect_distributed_array_table_native_writer.__m320ENCODE_SStringPointer_TO_r_binary 2023-09-29 17:53:16.956 : INFO: instruction count: 4: __C246collect_distributed_array_table_native_writer.__m321ENCODE_SInt32$_TO_r_int32 2023-09-29 17:53:16.957 : INFO: instruction count: 115: __C246collect_distributed_array_table_native_writer.__m322ENCODE_SIndexablePointer_TO_o_array_of_o_binary 2023-09-29 17:53:16.957 : INFO: instruction count: 16: __C246collect_distributed_array_table_native_writer.__m323ENCODE_SStringPointer_TO_o_binary 2023-09-29 17:53:16.957 : INFO: instruction count: 1: __C246collect_distributed_array_table_native_writer.__m324ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-09-29 17:53:16.959 : INFO: instruction count: 552: __C246collect_distributed_array_table_native_writer.__m326writeLeafNode 2023-09-29 17:53:16.959 : INFO: instruction count: 37: __C246collect_distributed_array_table_native_writer.__m327ENCODE_SBaseStructPointer_TO_o_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDENDEND 2023-09-29 17:53:16.959 : INFO: instruction count: 35: __C246collect_distributed_array_table_native_writer.__m328ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDEND 2023-09-29 17:53:16.960 : INFO: instruction count: 29: __C246collect_distributed_array_table_native_writer.__m329ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDEND 2023-09-29 17:53:16.960 : INFO: instruction count: 52: __C246collect_distributed_array_table_native_writer.__m330flush 2023-09-29 17:53:16.960 : INFO: instruction count: 25: __C246collect_distributed_array_table_native_writer.__m332ord_equiv 2023-09-29 17:53:16.961 : INFO: instruction count: 273: __C246collect_distributed_array_table_native_writer.__m333ord_equivNonnull 2023-09-29 17:53:16.962 : INFO: instruction count: 34: __C246collect_distributed_array_table_native_writer.__m334ord_equiv 2023-09-29 17:53:16.962 : INFO: instruction count: 25: __C246collect_distributed_array_table_native_writer.__m335ord_equivNonnull 2023-09-29 17:53:16.963 : INFO: instruction count: 74: __C246collect_distributed_array_table_native_writer.__m336ord_compareNonnull 2023-09-29 17:53:16.963 : INFO: instruction count: 9: __C246collect_distributed_array_table_native_writer.__m339ord_compareNonnull 2023-09-29 17:53:16.963 : INFO: instruction count: 89: __C246collect_distributed_array_table_native_writer.__m340ord_compareNonnull 2023-09-29 17:53:16.963 : INFO: instruction count: 34: __C246collect_distributed_array_table_native_writer.__m341ord_equiv 2023-09-29 17:53:16.964 : INFO: instruction count: 187: __C246collect_distributed_array_table_native_writer.__m342ord_equivNonnull 2023-09-29 17:53:16.965 : INFO: instruction count: 30: __C246collect_distributed_array_table_native_writer.__m343ord_equiv 2023-09-29 17:53:16.965 : INFO: instruction count: 21: __C246collect_distributed_array_table_native_writer.__m344ord_equivNonnull 2023-09-29 17:53:16.965 : INFO: instruction count: 123: __C246collect_distributed_array_table_native_writer.__m345ENCODE_SBaseStructPointer_TO_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryANDo_struct_of_o_binaryANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryENDANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryENDANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryANDo_int32ANDo_int32ANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryENDANDr_struct_of_r_int32ANDr_int32ENDEND 2023-09-29 17:53:16.967 : INFO: instruction count: 495: __C246collect_distributed_array_table_native_writer.__m346ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryENDANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryENDANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryANDo_int32ANDo_int32ANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryEND 2023-09-29 17:53:16.968 : INFO: instruction count: 111: __C246collect_distributed_array_table_native_writer.__m347ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END 2023-09-29 17:53:16.969 : INFO: instruction count: 489: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END 2023-09-29 17:53:16.970 : INFO: instruction count: 4: __C246collect_distributed_array_table_native_writer.__m349ENCODE_SFloat64$_TO_o_float64 2023-09-29 17:53:16.970 : INFO: instruction count: 4: __C246collect_distributed_array_table_native_writer.__m350ENCODE_SInt32$_TO_o_int32 2023-09-29 17:53:16.970 : INFO: instruction count: 115: __C246collect_distributed_array_table_native_writer.__m351ENCODE_SIndexablePointer_TO_o_array_of_o_int32 2023-09-29 17:53:16.971 : INFO: instruction count: 111: __C246collect_distributed_array_table_native_writer.__m352ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryEND 2023-09-29 17:53:16.971 : INFO: instruction count: 151: __C246collect_distributed_array_table_native_writer.__m353ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryEND 2023-09-29 17:53:16.972 : INFO: instruction count: 111: __C246collect_distributed_array_table_native_writer.__m354ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryEND 2023-09-29 17:53:16.973 : INFO: instruction count: 293: __C246collect_distributed_array_table_native_writer.__m355ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryEND 2023-09-29 17:53:16.973 : INFO: instruction count: 111: __C246collect_distributed_array_table_native_writer.__m356ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND 2023-09-29 17:53:16.974 : INFO: instruction count: 197: __C246collect_distributed_array_table_native_writer.__m357ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND 2023-09-29 17:53:16.974 : INFO: instruction count: 111: __C246collect_distributed_array_table_native_writer.__m358ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND 2023-09-29 17:53:16.976 : INFO: instruction count: 466: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND 2023-09-29 17:53:16.976 : INFO: instruction count: 111: __C246collect_distributed_array_table_native_writer.__m360ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_binaryANDo_binaryEND 2023-09-29 17:53:16.976 : INFO: instruction count: 59: __C246collect_distributed_array_table_native_writer.__m361ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_binaryEND 2023-09-29 17:53:16.977 : INFO: instruction count: 25: __C246collect_distributed_array_table_native_writer.__m362ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_int32END 2023-09-29 17:53:16.977 : INFO: instruction count: 9: __C246collect_distributed_array_table_native_writer.__m363ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDENDEND 2023-09-29 17:53:16.977 : INFO: instruction count: 87: __C246collect_distributed_array_table_native_writer.__m364ENCODE_SBaseStructPointer_TO_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDEND 2023-09-29 17:53:16.977 : INFO: instruction count: 4: __C246collect_distributed_array_table_native_writer.__m365ENCODE_SBoolean$_TO_r_bool 2023-09-29 17:53:16.978 : INFO: instruction count: 96: __C246collect_distributed_array_table_native_writer.__m366ENCODE_SBaseStructPointer_TO_o_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryEND 2023-09-29 17:53:16.978 : INFO: instruction count: 9: __C246collect_distributed_array_table_native_writer.setPartitionIndex 2023-09-29 17:53:16.978 : INFO: instruction count: 4: __C246collect_distributed_array_table_native_writer.addPartitionRegion 2023-09-29 17:53:16.978 : INFO: instruction count: 4: __C246collect_distributed_array_table_native_writer.setPool 2023-09-29 17:53:16.978 : INFO: instruction count: 3: __C246collect_distributed_array_table_native_writer.addHailClassLoader 2023-09-29 17:53:16.978 : INFO: instruction count: 3: __C246collect_distributed_array_table_native_writer.addFS 2023-09-29 17:53:16.979 : INFO: instruction count: 4: __C246collect_distributed_array_table_native_writer.addTaskContext 2023-09-29 17:53:16.979 : INFO: instruction count: 43: __C246collect_distributed_array_table_native_writer.addReferenceGenomes 2023-09-29 17:53:16.979 : INFO: instruction count: 3: __C246collect_distributed_array_table_native_writer.setObjects 2023-09-29 17:53:16.980 : INFO: instruction count: 422: __C246collect_distributed_array_table_native_writer.apply_region41_72 2023-09-29 17:53:16.980 : INFO: instruction count: 270: __C246collect_distributed_array_table_native_writer.apply_region29_40 2023-09-29 17:53:16.981 : INFO: instruction count: 258: __C246collect_distributed_array_table_native_writer.apply_region73_85 2023-09-29 17:53:16.982 : INFO: instruction count: 528: __C246collect_distributed_array_table_native_writer.apply_region1_86 2023-09-29 17:53:16.983 : INFO: instruction count: 469: __C246collect_distributed_array_table_native_writer.apply_region0_0 2023-09-29 17:53:16.984 : INFO: instruction count: 373: __C246collect_distributed_array_table_native_writer.apply_region87_110 2023-09-29 17:53:16.984 : INFO: instruction count: 102: __C246collect_distributed_array_table_native_writer.__m346ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryENDANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryENDANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryANDo_int32ANDo_int32ANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryEND_region30_35 2023-09-29 17:53:16.985 : INFO: instruction count: 79: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region108_113 2023-09-29 17:53:16.985 : INFO: instruction count: 79: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region18_23 2023-09-29 17:53:16.986 : INFO: instruction count: 83: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region0_5 2023-09-29 17:53:16.986 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region120_125 2023-09-29 17:53:16.986 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region114_119 2023-09-29 17:53:16.986 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region102_107 2023-09-29 17:53:16.987 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region96_101 2023-09-29 17:53:16.987 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region90_95 2023-09-29 17:53:16.988 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region84_89 2023-09-29 17:53:16.988 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region78_83 2023-09-29 17:53:16.988 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region72_77 2023-09-29 17:53:16.988 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region66_71 2023-09-29 17:53:16.989 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region60_65 2023-09-29 17:53:16.989 : INFO: instruction count: 79: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region36_41 2023-09-29 17:53:16.989 : INFO: instruction count: 79: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region30_35 2023-09-29 17:53:16.990 : INFO: instruction count: 83: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region0_5 2023-09-29 17:53:16.990 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region120_125 2023-09-29 17:53:16.991 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region114_119 2023-09-29 17:53:16.991 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region108_113 2023-09-29 17:53:16.991 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region102_107 2023-09-29 17:53:16.991 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region96_101 2023-09-29 17:53:16.992 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region90_95 2023-09-29 17:53:16.992 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region84_89 2023-09-29 17:53:16.992 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region78_83 2023-09-29 17:53:16.993 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region72_77 2023-09-29 17:53:16.993 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region66_71 2023-09-29 17:53:16.993 : INFO: instruction count: 56: __C246collect_distributed_array_table_native_writer.__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region60_65 2023-09-29 17:53:16.994 : INFO: instruction count: 3: __C369applySpills. 2023-09-29 17:53:16.994 : INFO: instruction count: 3: __C410__m313writeInternalNodeSpills. 2023-09-29 17:53:16.994 : INFO: instruction count: 3: __C413__m326writeLeafNodeSpills. 2023-09-29 17:53:16.995 : INFO: instruction count: 3: __C414__m346ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryENDANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryENDANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryANDo_int32ANDo_int32ANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryENDSpills. 2023-09-29 17:53:16.995 : INFO: instruction count: 3: __C419__m348ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDSpills. 2023-09-29 17:53:16.995 : INFO: instruction count: 3: __C437__m359ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDSpills. 2023-09-29 17:53:16.995 : INFO: instruction count: 3: __C297staticWrapperClass_1. 2023-09-29 17:53:16.996 : INFO: instruction count: 3: __C337RGContainer_GRCh38. 2023-09-29 17:53:16.996 : INFO: instruction count: 3: __C337RGContainer_GRCh38. 2023-09-29 17:53:17.069 : INFO: encoder cache miss (2 hits, 5 misses, 0.286) 2023-09-29 17:53:17.071 : INFO: instruction count: 3: __C526HailClassLoaderContainer. 2023-09-29 17:53:17.072 : INFO: instruction count: 3: __C526HailClassLoaderContainer. 2023-09-29 17:53:17.072 : INFO: instruction count: 3: __C528FSContainer. 2023-09-29 17:53:17.072 : INFO: instruction count: 3: __C528FSContainer. 2023-09-29 17:53:17.073 : INFO: instruction count: 3: __C530etypeEncode. 2023-09-29 17:53:17.073 : INFO: instruction count: 7: __C530etypeEncode.apply 2023-09-29 17:53:17.073 : INFO: instruction count: 45: __C530etypeEncode.__m532ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_ENDANDr_binaryANDr_array_of_r_binaryEND 2023-09-29 17:53:17.073 : INFO: instruction count: 1: __C530etypeEncode.__m533ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-09-29 17:53:17.073 : INFO: instruction count: 16: __C530etypeEncode.__m534ENCODE_SStringPointer_TO_r_binary 2023-09-29 17:53:17.074 : INFO: instruction count: 39: __C530etypeEncode.__m535ENCODE_SIndexablePointer_TO_r_array_of_r_binary 2023-09-29 17:53:17.115 : INFO: instruction count: 3: __C216HailClassLoaderContainer. 2023-09-29 17:53:17.115 : INFO: instruction count: 3: __C216HailClassLoaderContainer. 2023-09-29 17:53:17.115 : INFO: instruction count: 3: __C218FSContainer. 2023-09-29 17:53:17.116 : INFO: instruction count: 3: __C218FSContainer. 2023-09-29 17:53:17.139 : INFO: instruction count: 3: __C220Compiled. 2023-09-29 17:53:17.139 : INFO: instruction count: 50: __C220Compiled.apply 2023-09-29 17:53:17.140 : INFO: instruction count: 473: __C220Compiled.__m224split_Let 2023-09-29 17:53:17.140 : INFO: instruction count: 4: __C220Compiled.setBackend 2023-09-29 17:53:17.141 : INFO: instruction count: 9: __C220Compiled.__m460ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_int32ANDr_binaryENDEND 2023-09-29 17:53:17.141 : INFO: instruction count: 25: __C220Compiled.__m461ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_binaryEND 2023-09-29 17:53:17.141 : INFO: instruction count: 4: __C220Compiled.__m462ENCODE_SInt32$_TO_r_int32 2023-09-29 17:53:17.141 : INFO: instruction count: 16: __C220Compiled.__m463ENCODE_SStringPointer_TO_r_binary 2023-09-29 17:53:17.141 : INFO: instruction count: 9: __C220Compiled.__m464ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_ENDEND 2023-09-29 17:53:17.141 : INFO: instruction count: 1: __C220Compiled.__m465ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-09-29 17:53:17.141 : INFO: instruction count: 27: __C220Compiled.__m468DECODE_r_struct_of_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDENDEND_TO_SBaseStructPointer 2023-09-29 17:53:17.141 : INFO: instruction count: 102: __C220Compiled.__m469INPLACE_DECODE_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDEND_TO_r_struct_of_r_stringANDr_int64ANDr_boolANDo_struct_of_o_locusANDo_array_of_o_stringENDANDo_struct_of_o_locusANDo_array_of_o_stringENDEND 2023-09-29 17:53:17.142 : INFO: instruction count: 31: __C220Compiled.__m470INPLACE_DECODE_r_binary_TO_r_string 2023-09-29 17:53:17.142 : INFO: instruction count: 10: __C220Compiled.__m471INPLACE_DECODE_r_int64_TO_r_int64 2023-09-29 17:53:17.142 : INFO: instruction count: 10: __C220Compiled.__m472INPLACE_DECODE_r_bool_TO_r_bool 2023-09-29 17:53:17.142 : INFO: instruction count: 75: __C220Compiled.__m473INPLACE_DECODE_o_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryEND_TO_o_struct_of_o_locusANDo_array_of_o_stringEND 2023-09-29 17:53:17.142 : INFO: instruction count: 26: __C220Compiled.__m474INPLACE_DECODE_o_struct_of_r_binaryANDr_int32END_TO_o_locus 2023-09-29 17:53:17.142 : INFO: instruction count: 10: __C220Compiled.__m475INPLACE_DECODE_r_int32_TO_r_int32 2023-09-29 17:53:17.143 : INFO: instruction count: 114: __C220Compiled.__m476INPLACE_DECODE_o_array_of_o_binary_TO_o_array_of_o_string 2023-09-29 17:53:17.143 : INFO: instruction count: 31: __C220Compiled.__m477INPLACE_DECODE_o_binary_TO_o_string 2023-09-29 17:53:17.144 : INFO: instruction count: 301: __C220Compiled.__m481begin_group_0 2023-09-29 17:53:17.144 : INFO: instruction count: 143: __C220Compiled.__m485split_ToArray 2023-09-29 17:53:17.145 : INFO: instruction count: 229: __C220Compiled.__m496split_ToArray 2023-09-29 17:53:17.145 : INFO: instruction count: 18: __C220Compiled.__m507ord_equiv 2023-09-29 17:53:17.147 : INFO: instruction count: 336: __C220Compiled.__m508ord_equivNonnull 2023-09-29 17:53:17.147 : INFO: instruction count: 34: __C220Compiled.__m509ord_equiv 2023-09-29 17:53:17.147 : INFO: instruction count: 25: __C220Compiled.__m510ord_equivNonnull 2023-09-29 17:53:17.148 : INFO: instruction count: 74: __C220Compiled.__m511ord_compareNonnull 2023-09-29 17:53:17.148 : INFO: instruction count: 9: __C220Compiled.__m512ord_compareNonnull 2023-09-29 17:53:17.148 : INFO: instruction count: 89: __C220Compiled.__m513ord_compareNonnull 2023-09-29 17:53:17.149 : INFO: instruction count: 34: __C220Compiled.__m514ord_equiv 2023-09-29 17:53:17.149 : INFO: instruction count: 187: __C220Compiled.__m515ord_equivNonnull 2023-09-29 17:53:17.150 : INFO: instruction count: 30: __C220Compiled.__m516ord_equiv 2023-09-29 17:53:17.150 : INFO: instruction count: 21: __C220Compiled.__m517ord_equivNonnull 2023-09-29 17:53:17.150 : INFO: instruction count: 9: __C220Compiled.setPartitionIndex 2023-09-29 17:53:17.150 : INFO: instruction count: 4: __C220Compiled.addPartitionRegion 2023-09-29 17:53:17.150 : INFO: instruction count: 4: __C220Compiled.setPool 2023-09-29 17:53:17.151 : INFO: instruction count: 3: __C220Compiled.addHailClassLoader 2023-09-29 17:53:17.151 : INFO: instruction count: 3: __C220Compiled.addFS 2023-09-29 17:53:17.151 : INFO: instruction count: 4: __C220Compiled.addTaskContext 2023-09-29 17:53:17.152 : INFO: instruction count: 43: __C220Compiled.addReferenceGenomes 2023-09-29 17:53:17.152 : INFO: instruction count: 3: __C220Compiled.setObjects 2023-09-29 17:53:17.152 : INFO: instruction count: 131: __C220Compiled.addAndDecodeLiterals 2023-09-29 17:53:17.153 : INFO: instruction count: 45: __C220Compiled.__m522DECODE_r_struct_of_r_struct_of_ENDANDr_binaryANDr_array_of_r_binaryEND_TO_SBaseStructPointer 2023-09-29 17:53:17.153 : INFO: instruction count: 8: __C220Compiled.__m523INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-09-29 17:53:17.153 : INFO: instruction count: 58: __C220Compiled.__m524INPLACE_DECODE_r_array_of_r_binary_TO_r_array_of_r_string 2023-09-29 17:53:17.153 : INFO: instruction count: 18: __C220Compiled.__m525DECODE_r_struct_of_END_TO_SBaseStructPointer 2023-09-29 17:53:17.154 : INFO: instruction count: 335: __C220Compiled.__m481begin_group_0_region18_47 2023-09-29 17:53:17.155 : INFO: instruction count: 3: __C536__m481begin_group_0Spills. 2023-09-29 17:53:17.155 : INFO: instruction count: 3: __C222RGContainer_GRCh38. 2023-09-29 17:53:17.155 : INFO: instruction count: 3: __C222RGContainer_GRCh38. 2023-09-29 17:53:17.156 : INFO: instruction count: 3: __C466staticWrapperClass_1. 2023-09-29 17:53:17.700 : INFO: initial IR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:18.016 : INFO: after optimize: compileLowerer, initial IR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:18.493 : INFO: after InlineApplyIR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:18.824 : INFO: after optimize: compileLowerer, after InlineApplyIR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:19.125 : INFO: after LowerArrayAggsToRunAggs: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:19.424 : INFO: after optimize: compileLowerer, after LowerArrayAggsToRunAggs: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:19.625 : INFO: instruction count: 3: __C571HailClassLoaderContainer. 2023-09-29 17:53:19.625 : INFO: instruction count: 3: __C571HailClassLoaderContainer. 2023-09-29 17:53:19.625 : INFO: instruction count: 3: __C573FSContainer. 2023-09-29 17:53:19.626 : INFO: instruction count: 3: __C573FSContainer. 2023-09-29 17:53:19.688 : INFO: instruction count: 3: __C575collect_distributed_array_table_native_writer. 2023-09-29 17:53:19.689 : INFO: instruction count: 181: __C575collect_distributed_array_table_native_writer.apply 2023-09-29 17:53:19.689 : INFO: instruction count: 17: __C575collect_distributed_array_table_native_writer.apply 2023-09-29 17:53:19.690 : INFO: instruction count: 27: __C575collect_distributed_array_table_native_writer.__m577DECODE_r_struct_of_r_struct_of_r_int32ANDr_binaryENDEND_TO_SBaseStructPointer 2023-09-29 17:53:19.690 : INFO: instruction count: 26: __C575collect_distributed_array_table_native_writer.__m578INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryEND_TO_r_struct_of_r_int32ANDr_stringEND 2023-09-29 17:53:19.690 : INFO: instruction count: 10: __C575collect_distributed_array_table_native_writer.__m579INPLACE_DECODE_r_int32_TO_r_int32 2023-09-29 17:53:19.690 : INFO: instruction count: 31: __C575collect_distributed_array_table_native_writer.__m580INPLACE_DECODE_r_binary_TO_r_string 2023-09-29 17:53:19.690 : INFO: instruction count: 27: __C575collect_distributed_array_table_native_writer.__m582DECODE_r_struct_of_r_struct_of_ENDEND_TO_SBaseStructPointer 2023-09-29 17:53:19.690 : INFO: instruction count: 8: __C575collect_distributed_array_table_native_writer.__m583INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-09-29 17:53:19.691 : INFO: instruction count: 49: __C575collect_distributed_array_table_native_writer.__m587concat 2023-09-29 17:53:19.691 : INFO: instruction count: 653: __C575collect_distributed_array_table_native_writer.__m606writeInternalNode 2023-09-29 17:53:19.691 : INFO: instruction count: 25: __C575collect_distributed_array_table_native_writer.__m607ENCODE_SBaseStructPointer_TO_o_struct_of_r_array_of_r_struct_of_r_int64ANDr_int64ANDr_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDENDEND 2023-09-29 17:53:19.692 : INFO: instruction count: 35: __C575collect_distributed_array_table_native_writer.__m608ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_int64ANDr_int64ANDr_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDEND 2023-09-29 17:53:19.692 : INFO: instruction count: 53: __C575collect_distributed_array_table_native_writer.__m609ENCODE_SBaseStructPointer_TO_r_struct_of_r_int64ANDr_int64ANDr_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDEND 2023-09-29 17:53:19.692 : INFO: instruction count: 4: __C575collect_distributed_array_table_native_writer.__m610ENCODE_SInt64$_TO_r_int64 2023-09-29 17:53:19.692 : INFO: instruction count: 96: __C575collect_distributed_array_table_native_writer.__m611ENCODE_SBaseStructPointer_TO_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryEND 2023-09-29 17:53:19.693 : INFO: instruction count: 25: __C575collect_distributed_array_table_native_writer.__m612ENCODE_SCanonicalLocusPointer_TO_o_struct_of_r_binaryANDr_int32END 2023-09-29 17:53:19.693 : INFO: instruction count: 16: __C575collect_distributed_array_table_native_writer.__m613ENCODE_SStringPointer_TO_r_binary 2023-09-29 17:53:19.693 : INFO: instruction count: 4: __C575collect_distributed_array_table_native_writer.__m614ENCODE_SInt32$_TO_r_int32 2023-09-29 17:53:19.693 : INFO: instruction count: 115: __C575collect_distributed_array_table_native_writer.__m615ENCODE_SIndexablePointer_TO_o_array_of_o_binary 2023-09-29 17:53:19.693 : INFO: instruction count: 16: __C575collect_distributed_array_table_native_writer.__m616ENCODE_SStringPointer_TO_o_binary 2023-09-29 17:53:19.693 : INFO: instruction count: 1: __C575collect_distributed_array_table_native_writer.__m617ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-09-29 17:53:19.694 : INFO: instruction count: 552: __C575collect_distributed_array_table_native_writer.__m619writeLeafNode 2023-09-29 17:53:19.694 : INFO: instruction count: 37: __C575collect_distributed_array_table_native_writer.__m620ENCODE_SBaseStructPointer_TO_o_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDENDEND 2023-09-29 17:53:19.694 : INFO: instruction count: 35: __C575collect_distributed_array_table_native_writer.__m621ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDEND 2023-09-29 17:53:19.695 : INFO: instruction count: 29: __C575collect_distributed_array_table_native_writer.__m622ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDEND 2023-09-29 17:53:19.695 : INFO: instruction count: 52: __C575collect_distributed_array_table_native_writer.__m623flush 2023-09-29 17:53:19.695 : INFO: instruction count: 25: __C575collect_distributed_array_table_native_writer.__m625ord_equiv 2023-09-29 17:53:19.696 : INFO: instruction count: 273: __C575collect_distributed_array_table_native_writer.__m626ord_equivNonnull 2023-09-29 17:53:19.696 : INFO: instruction count: 34: __C575collect_distributed_array_table_native_writer.__m627ord_equiv 2023-09-29 17:53:19.696 : INFO: instruction count: 25: __C575collect_distributed_array_table_native_writer.__m628ord_equivNonnull 2023-09-29 17:53:19.697 : INFO: instruction count: 74: __C575collect_distributed_array_table_native_writer.__m629ord_compareNonnull 2023-09-29 17:53:19.697 : INFO: instruction count: 9: __C575collect_distributed_array_table_native_writer.__m632ord_compareNonnull 2023-09-29 17:53:19.697 : INFO: instruction count: 89: __C575collect_distributed_array_table_native_writer.__m633ord_compareNonnull 2023-09-29 17:53:19.697 : INFO: instruction count: 34: __C575collect_distributed_array_table_native_writer.__m634ord_equiv 2023-09-29 17:53:19.698 : INFO: instruction count: 187: __C575collect_distributed_array_table_native_writer.__m635ord_equivNonnull 2023-09-29 17:53:19.698 : INFO: instruction count: 30: __C575collect_distributed_array_table_native_writer.__m636ord_equiv 2023-09-29 17:53:19.698 : INFO: instruction count: 21: __C575collect_distributed_array_table_native_writer.__m637ord_equivNonnull 2023-09-29 17:53:19.698 : INFO: instruction count: 123: __C575collect_distributed_array_table_native_writer.__m638ENCODE_SBaseStructPointer_TO_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryANDo_struct_of_o_binaryANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryENDANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryENDANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryANDo_int32ANDo_int32ANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryENDANDr_struct_of_r_int32ANDr_int32ENDEND 2023-09-29 17:53:19.699 : INFO: instruction count: 495: __C575collect_distributed_array_table_native_writer.__m639ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryENDANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryENDANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryANDo_int32ANDo_int32ANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryEND 2023-09-29 17:53:19.700 : INFO: instruction count: 111: __C575collect_distributed_array_table_native_writer.__m640ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END 2023-09-29 17:53:19.700 : INFO: instruction count: 489: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END 2023-09-29 17:53:19.701 : INFO: instruction count: 4: __C575collect_distributed_array_table_native_writer.__m642ENCODE_SFloat64$_TO_o_float64 2023-09-29 17:53:19.701 : INFO: instruction count: 4: __C575collect_distributed_array_table_native_writer.__m643ENCODE_SInt32$_TO_o_int32 2023-09-29 17:53:19.701 : INFO: instruction count: 115: __C575collect_distributed_array_table_native_writer.__m644ENCODE_SIndexablePointer_TO_o_array_of_o_int32 2023-09-29 17:53:19.702 : INFO: instruction count: 111: __C575collect_distributed_array_table_native_writer.__m645ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryEND 2023-09-29 17:53:19.702 : INFO: instruction count: 151: __C575collect_distributed_array_table_native_writer.__m646ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryEND 2023-09-29 17:53:19.702 : INFO: instruction count: 111: __C575collect_distributed_array_table_native_writer.__m647ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryEND 2023-09-29 17:53:19.703 : INFO: instruction count: 293: __C575collect_distributed_array_table_native_writer.__m648ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryEND 2023-09-29 17:53:19.703 : INFO: instruction count: 111: __C575collect_distributed_array_table_native_writer.__m649ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND 2023-09-29 17:53:19.703 : INFO: instruction count: 197: __C575collect_distributed_array_table_native_writer.__m650ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND 2023-09-29 17:53:19.704 : INFO: instruction count: 111: __C575collect_distributed_array_table_native_writer.__m651ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND 2023-09-29 17:53:19.704 : INFO: instruction count: 466: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND 2023-09-29 17:53:19.705 : INFO: instruction count: 111: __C575collect_distributed_array_table_native_writer.__m653ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_binaryANDo_binaryEND 2023-09-29 17:53:19.705 : INFO: instruction count: 59: __C575collect_distributed_array_table_native_writer.__m654ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_binaryEND 2023-09-29 17:53:19.705 : INFO: instruction count: 25: __C575collect_distributed_array_table_native_writer.__m655ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_int32END 2023-09-29 17:53:19.705 : INFO: instruction count: 9: __C575collect_distributed_array_table_native_writer.__m656ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDENDEND 2023-09-29 17:53:19.705 : INFO: instruction count: 87: __C575collect_distributed_array_table_native_writer.__m657ENCODE_SBaseStructPointer_TO_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDEND 2023-09-29 17:53:19.705 : INFO: instruction count: 4: __C575collect_distributed_array_table_native_writer.__m658ENCODE_SBoolean$_TO_r_bool 2023-09-29 17:53:19.706 : INFO: instruction count: 96: __C575collect_distributed_array_table_native_writer.__m659ENCODE_SBaseStructPointer_TO_o_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryEND 2023-09-29 17:53:19.706 : INFO: instruction count: 9: __C575collect_distributed_array_table_native_writer.setPartitionIndex 2023-09-29 17:53:19.706 : INFO: instruction count: 4: __C575collect_distributed_array_table_native_writer.addPartitionRegion 2023-09-29 17:53:19.706 : INFO: instruction count: 4: __C575collect_distributed_array_table_native_writer.setPool 2023-09-29 17:53:19.706 : INFO: instruction count: 3: __C575collect_distributed_array_table_native_writer.addHailClassLoader 2023-09-29 17:53:19.706 : INFO: instruction count: 3: __C575collect_distributed_array_table_native_writer.addFS 2023-09-29 17:53:19.706 : INFO: instruction count: 4: __C575collect_distributed_array_table_native_writer.addTaskContext 2023-09-29 17:53:19.707 : INFO: instruction count: 43: __C575collect_distributed_array_table_native_writer.addReferenceGenomes 2023-09-29 17:53:19.707 : INFO: instruction count: 3: __C575collect_distributed_array_table_native_writer.setObjects 2023-09-29 17:53:19.707 : INFO: instruction count: 422: __C575collect_distributed_array_table_native_writer.apply_region41_72 2023-09-29 17:53:19.708 : INFO: instruction count: 270: __C575collect_distributed_array_table_native_writer.apply_region29_40 2023-09-29 17:53:19.708 : INFO: instruction count: 258: __C575collect_distributed_array_table_native_writer.apply_region73_85 2023-09-29 17:53:19.709 : INFO: instruction count: 528: __C575collect_distributed_array_table_native_writer.apply_region1_86 2023-09-29 17:53:19.709 : INFO: instruction count: 469: __C575collect_distributed_array_table_native_writer.apply_region0_0 2023-09-29 17:53:19.710 : INFO: instruction count: 373: __C575collect_distributed_array_table_native_writer.apply_region87_110 2023-09-29 17:53:19.710 : INFO: instruction count: 102: __C575collect_distributed_array_table_native_writer.__m639ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryENDANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryENDANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryANDo_int32ANDo_int32ANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryEND_region30_35 2023-09-29 17:53:19.710 : INFO: instruction count: 79: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region108_113 2023-09-29 17:53:19.710 : INFO: instruction count: 79: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region18_23 2023-09-29 17:53:19.711 : INFO: instruction count: 83: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region0_5 2023-09-29 17:53:19.711 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region120_125 2023-09-29 17:53:19.711 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region114_119 2023-09-29 17:53:19.711 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region102_107 2023-09-29 17:53:19.711 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region96_101 2023-09-29 17:53:19.712 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region90_95 2023-09-29 17:53:19.712 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region84_89 2023-09-29 17:53:19.712 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region78_83 2023-09-29 17:53:19.712 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region72_77 2023-09-29 17:53:19.712 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region66_71 2023-09-29 17:53:19.712 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region60_65 2023-09-29 17:53:19.713 : INFO: instruction count: 79: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region36_41 2023-09-29 17:53:19.713 : INFO: instruction count: 79: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region30_35 2023-09-29 17:53:19.713 : INFO: instruction count: 83: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region0_5 2023-09-29 17:53:19.713 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region120_125 2023-09-29 17:53:19.713 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region114_119 2023-09-29 17:53:19.714 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region108_113 2023-09-29 17:53:19.714 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region102_107 2023-09-29 17:53:19.714 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region96_101 2023-09-29 17:53:19.714 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region90_95 2023-09-29 17:53:19.714 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region84_89 2023-09-29 17:53:19.714 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region78_83 2023-09-29 17:53:19.715 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region72_77 2023-09-29 17:53:19.715 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region66_71 2023-09-29 17:53:19.715 : INFO: instruction count: 56: __C575collect_distributed_array_table_native_writer.__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region60_65 2023-09-29 17:53:19.715 : INFO: instruction count: 3: __C662applySpills. 2023-09-29 17:53:19.716 : INFO: instruction count: 3: __C703__m606writeInternalNodeSpills. 2023-09-29 17:53:19.716 : INFO: instruction count: 3: __C706__m619writeLeafNodeSpills. 2023-09-29 17:53:19.716 : INFO: instruction count: 3: __C707__m639ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryENDANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryENDANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryANDo_int32ANDo_int32ANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryENDSpills. 2023-09-29 17:53:19.716 : INFO: instruction count: 3: __C712__m641ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDSpills. 2023-09-29 17:53:19.716 : INFO: instruction count: 3: __C730__m652ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDSpills. 2023-09-29 17:53:19.717 : INFO: instruction count: 3: __C590staticWrapperClass_1. 2023-09-29 17:53:19.717 : INFO: instruction count: 3: __C630RGContainer_GRCh38. 2023-09-29 17:53:19.717 : INFO: instruction count: 3: __C630RGContainer_GRCh38. 2023-09-29 17:53:19.742 : INFO: encoder cache hit 2023-09-29 17:53:19.764 : INFO: instruction count: 3: __C545HailClassLoaderContainer. 2023-09-29 17:53:19.764 : INFO: instruction count: 3: __C545HailClassLoaderContainer. 2023-09-29 17:53:19.765 : INFO: instruction count: 3: __C547FSContainer. 2023-09-29 17:53:19.765 : INFO: instruction count: 3: __C547FSContainer. 2023-09-29 17:53:19.784 : INFO: instruction count: 3: __C549Compiled. 2023-09-29 17:53:19.784 : INFO: instruction count: 50: __C549Compiled.apply 2023-09-29 17:53:19.785 : INFO: instruction count: 473: __C549Compiled.__m553split_Let 2023-09-29 17:53:19.785 : INFO: instruction count: 4: __C549Compiled.setBackend 2023-09-29 17:53:19.785 : INFO: instruction count: 9: __C549Compiled.__m753ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_int32ANDr_binaryENDEND 2023-09-29 17:53:19.786 : INFO: instruction count: 25: __C549Compiled.__m754ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_binaryEND 2023-09-29 17:53:19.786 : INFO: instruction count: 4: __C549Compiled.__m755ENCODE_SInt32$_TO_r_int32 2023-09-29 17:53:19.786 : INFO: instruction count: 16: __C549Compiled.__m756ENCODE_SStringPointer_TO_r_binary 2023-09-29 17:53:19.786 : INFO: instruction count: 9: __C549Compiled.__m757ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_ENDEND 2023-09-29 17:53:19.786 : INFO: instruction count: 1: __C549Compiled.__m758ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-09-29 17:53:19.786 : INFO: instruction count: 27: __C549Compiled.__m761DECODE_r_struct_of_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDENDEND_TO_SBaseStructPointer 2023-09-29 17:53:19.786 : INFO: instruction count: 102: __C549Compiled.__m762INPLACE_DECODE_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDEND_TO_r_struct_of_r_stringANDr_int64ANDr_boolANDo_struct_of_o_locusANDo_array_of_o_stringENDANDo_struct_of_o_locusANDo_array_of_o_stringENDEND 2023-09-29 17:53:19.787 : INFO: instruction count: 31: __C549Compiled.__m763INPLACE_DECODE_r_binary_TO_r_string 2023-09-29 17:53:19.787 : INFO: instruction count: 10: __C549Compiled.__m764INPLACE_DECODE_r_int64_TO_r_int64 2023-09-29 17:53:19.787 : INFO: instruction count: 10: __C549Compiled.__m765INPLACE_DECODE_r_bool_TO_r_bool 2023-09-29 17:53:19.787 : INFO: instruction count: 75: __C549Compiled.__m766INPLACE_DECODE_o_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryEND_TO_o_struct_of_o_locusANDo_array_of_o_stringEND 2023-09-29 17:53:19.787 : INFO: instruction count: 26: __C549Compiled.__m767INPLACE_DECODE_o_struct_of_r_binaryANDr_int32END_TO_o_locus 2023-09-29 17:53:19.787 : INFO: instruction count: 10: __C549Compiled.__m768INPLACE_DECODE_r_int32_TO_r_int32 2023-09-29 17:53:19.787 : INFO: instruction count: 114: __C549Compiled.__m769INPLACE_DECODE_o_array_of_o_binary_TO_o_array_of_o_string 2023-09-29 17:53:19.788 : INFO: instruction count: 31: __C549Compiled.__m770INPLACE_DECODE_o_binary_TO_o_string 2023-09-29 17:53:19.788 : INFO: instruction count: 301: __C549Compiled.__m774begin_group_0 2023-09-29 17:53:19.788 : INFO: instruction count: 143: __C549Compiled.__m778split_ToArray 2023-09-29 17:53:19.789 : INFO: instruction count: 229: __C549Compiled.__m789split_ToArray 2023-09-29 17:53:19.789 : INFO: instruction count: 18: __C549Compiled.__m800ord_equiv 2023-09-29 17:53:19.790 : INFO: instruction count: 336: __C549Compiled.__m801ord_equivNonnull 2023-09-29 17:53:19.790 : INFO: instruction count: 34: __C549Compiled.__m802ord_equiv 2023-09-29 17:53:19.790 : INFO: instruction count: 25: __C549Compiled.__m803ord_equivNonnull 2023-09-29 17:53:19.790 : INFO: instruction count: 74: __C549Compiled.__m804ord_compareNonnull 2023-09-29 17:53:19.790 : INFO: instruction count: 9: __C549Compiled.__m805ord_compareNonnull 2023-09-29 17:53:19.791 : INFO: instruction count: 89: __C549Compiled.__m806ord_compareNonnull 2023-09-29 17:53:19.791 : INFO: instruction count: 34: __C549Compiled.__m807ord_equiv 2023-09-29 17:53:19.791 : INFO: instruction count: 187: __C549Compiled.__m808ord_equivNonnull 2023-09-29 17:53:19.791 : INFO: instruction count: 30: __C549Compiled.__m809ord_equiv 2023-09-29 17:53:19.791 : INFO: instruction count: 21: __C549Compiled.__m810ord_equivNonnull 2023-09-29 17:53:19.792 : INFO: instruction count: 9: __C549Compiled.setPartitionIndex 2023-09-29 17:53:19.792 : INFO: instruction count: 4: __C549Compiled.addPartitionRegion 2023-09-29 17:53:19.792 : INFO: instruction count: 4: __C549Compiled.setPool 2023-09-29 17:53:19.792 : INFO: instruction count: 3: __C549Compiled.addHailClassLoader 2023-09-29 17:53:19.792 : INFO: instruction count: 3: __C549Compiled.addFS 2023-09-29 17:53:19.792 : INFO: instruction count: 4: __C549Compiled.addTaskContext 2023-09-29 17:53:19.792 : INFO: instruction count: 43: __C549Compiled.addReferenceGenomes 2023-09-29 17:53:19.792 : INFO: instruction count: 3: __C549Compiled.setObjects 2023-09-29 17:53:19.793 : INFO: instruction count: 131: __C549Compiled.addAndDecodeLiterals 2023-09-29 17:53:19.793 : INFO: instruction count: 45: __C549Compiled.__m815DECODE_r_struct_of_r_struct_of_ENDANDr_binaryANDr_array_of_r_binaryEND_TO_SBaseStructPointer 2023-09-29 17:53:19.793 : INFO: instruction count: 8: __C549Compiled.__m816INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-09-29 17:53:19.794 : INFO: instruction count: 58: __C549Compiled.__m817INPLACE_DECODE_r_array_of_r_binary_TO_r_array_of_r_string 2023-09-29 17:53:19.794 : INFO: instruction count: 18: __C549Compiled.__m818DECODE_r_struct_of_END_TO_SBaseStructPointer 2023-09-29 17:53:19.795 : INFO: instruction count: 335: __C549Compiled.__m774begin_group_0_region18_47 2023-09-29 17:53:19.795 : INFO: instruction count: 3: __C819__m774begin_group_0Spills. 2023-09-29 17:53:19.795 : INFO: instruction count: 3: __C551RGContainer_GRCh38. 2023-09-29 17:53:19.795 : INFO: instruction count: 3: __C551RGContainer_GRCh38. 2023-09-29 17:53:19.796 : INFO: instruction count: 3: __C759staticWrapperClass_1. 2023-09-29 17:53:20.484 : INFO: initial IR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:20.783 : INFO: after optimize: compileLowerer, initial IR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:21.072 : INFO: after InlineApplyIR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:21.373 : INFO: after optimize: compileLowerer, after InlineApplyIR: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:21.676 : INFO: after LowerArrayAggsToRunAggs: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:21.983 : INFO: after optimize: compileLowerer, after LowerArrayAggsToRunAggs: IR size 45: !c0 = I32 [0] !c121044 = I32 [121044] !c1 = I32 [1] !s = StreamRange(!c0, !c121044, !c1) [-1, False] !1 = Literal [Array[String], ] !s2 = ToStream(!1) [False] !s3 = StreamZip(!s, !s2) [-1, AssertSameLength] { (%elt, %elt2) => MakeStruct(oldCtx: %elt, writeCtx: %elt2) } !2 = Literal [Struct{}, ] !3 = NA [String] %8 = CollectDistributedArray(!s3, !2, !3) { (%ctx, %g) => !4 = GetField(%ctx) [oldCtx] !s4 = ReadPartition(!4) [Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}, "\"\""] !5 = GetField(%ctx) [writeCtx] !6 = UUID4 [__iruid_69] !7 = Apply(!5, !6) [-1, concat, (), String] WritePartition(!s4, !7) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat64,exac_sas_allele:EBinary,exac_sas_maf:EFloat64,id:EBinary,minor_allele:EBinary,minor_allele_freq:EFloat64,phenotype_or_disease:EInt32,pubmed:EArray[EInt32],sas_allele:EBinary,sas_maf:EFloat64,somatic:EInt32,start:EInt32,strand:EInt32}],context:EBinary,end:EInt32,id:EBinary,input:EBinary,intergenic_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,variant_allele:EBinary}],most_severe_consequence:EBinary,motif_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,consequence_terms:EArray[EBinary],high_inf_pos:EBinary,impact:EBinary,minimised:EInt32,motif_feature_id:EBinary,motif_name:EBinary,motif_pos:EInt32,motif_score_change:EFloat64,strand:EInt32,variant_allele:EBinary}],regulatory_feature_consequences:EArray[EBaseStruct{allele_num:EInt32,biotype:EBinary,consequence_terms:EArray[EBinary],impact:EBinary,minimised:EInt32,regulatory_feature_id:EBinary,variant_allele:EBinary}],seq_region_name:EBinary,start:EInt32,strand:EInt32,transcript_consequences:EArray[EBaseStruct{allele_num:EInt32,amino_acids:EBinary,appris:EBinary,biotype:EBinary,canonical:EInt32,ccds:EBinary,cdna_start:EInt32,cdna_end:EInt32,cds_end:EInt32,cds_start:EInt32,codons:EBinary,consequence_terms:EArray[EBinary],distance:EInt32,domains:EArray[EBaseStruct{db:EBinary,name:EBinary}],exon:EBinary,gene_id:EBinary,gene_pheno:EInt32,gene_symbol:EBinary,gene_symbol_source:EBinary,hgnc_id:EBinary,hgvsc:EBinary,hgvsp:EBinary,hgvs_offset:EInt32,impact:EBinary,intron:EBinary,lof:EBinary,lof_flags:EBinary,lof_filter:EBinary,lof_info:EBinary,minimised:EInt32,polyphen_prediction:EBinary,polyphen_score:EFloat64,protein_end:EInt32,protein_start:EInt32,protein_id:EBinary,sift_prediction:EBinary,sift_score:EFloat64,strand:EInt32,swissprot:EBinary,transcript_id:EBinary,trembl:EBinary,tsl:EInt32,uniparc:EBinary,variant_allele:EBinary}],variant_class:EBinary},vep_proc_id:+EBaseStruct{part_idx:+EInt32,block_idx:+EInt32}}\",\"_vType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allele:String,sas_maf:Float64,somatic:Int32,start:Int32,strand:Int32}],context:String,end:Int32,id:String,input:String,intergenic_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],impact:String,minimised:Int32,variant_allele:String}],most_severe_consequence:String,motif_feature_consequences:Array[Struct{allele_num:Int32,consequence_terms:Array[String],high_inf_pos:String,impact:String,minimised:Int32,motif_feature_id:String,motif_name:String,motif_pos:Int32,motif_score_change:Float64,strand:Int32,variant_allele:String}],regulatory_feature_consequences:Array[Struct{allele_num:Int32,biotype:String,consequence_terms:Array[String],impact:String,minimised:Int32,regulatory_feature_id:String,variant_allele:String}],seq_region_name:String,start:Int32,strand:Int32,transcript_consequences:Array[Struct{allele_num:Int32,amino_acids:String,appris:String,biotype:String,canonical:Int32,ccds:String,cdna_start:Int32,cdna_end:Int32,cds_end:Int32,cds_start:Int32,codons:String,consequence_terms:Array[String],distance:Int32,domains:Array[Struct{db:String,name:String}],exon:String,gene_id:String,gene_pheno:Int32,gene_symbol:String,gene_symbol_source:String,hgnc_id:String,hgvsc:String,hgvsp:String,hgvs_offset:Int32,impact:String,intron:String,lof:String,lof_flags:String,lof_filter:String,lof_info:String,minimised:Int32,polyphen_prediction:String,polyphen_score:Float64,protein_end:Int32,protein_start:Int32,protein_id:String,sift_prediction:String,sift_score:Float64,strand:Int32,swissprot:String,transcript_id:String,trembl:String,tsl:Int32,uniparc:String,variant_allele:String}],variant_class:String},vep_proc_id:Struct{part_idx:Int32,block_idx:Int32}}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[\"locus\",\"alleles\"],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/rows/parts/\",\"index\":{\"/tmp/persist_TableEJFCqZneo1/index/\":\"+PCStruct{locus:PCLocus(GRCh38),alleles:PCArray[PCString]}\"},\"trackTotalBytes\":false}"] } !9 = EncodedLiteral [Struct{}] !s5 = MakeStream(!9) [Stream[Struct{}], False] !10 = Str ["part-0"] !11 = WritePartition(!s5, !10) ["{\"name\":\"PartitionNativeWriter\",\"spec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"keyFields\":[],\"partPrefix\":\"/tmp/persist_TableEJFCqZneo1/globals/parts/\",\"trackTotalBytes\":false}"] !12 = GetField(!11) [filePath] !13 = MakeArray(!12) [Array[String]] !14 = WriteMetadata(!13) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/globals\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{}\",\"_vType\":\"Struct{}\",\"_bufferSpec\":{\"name\":\"LEB128BufferSpec\",\"child\":{\"name\":\"BlockingBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"ZstdBlockBufferSpec\",\"blockSize\":65536,\"child\":{\"name\":\"StreamBlockBufferSpec\"}}}}},\"key\":[],\"bounds\":[{\"start\":{},\"end\":{},\"includeStart\":true,\"includeEnd\":true}],\"indexSpec\":null,\"attrs\":{}}}"] !s6 = ToStream(%8) [False] !s7 = StreamMap(!s6) { (%elt3) => GetField(%elt3) [filePath] } !15 = ToArray(!s7) !16 = WriteMetadata(!15) ["{\"name\":\"RVDSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1/rows\",\"spec\":{\"name\":\"RVDSpecMaker\",\"codecSpec\":{\"name\":\"TypedCodecSpec\",\"_eType\":\"+EBaseStruct{locus:EBaseStruct{contig:+EBinary,position:+EInt32},alleles:EArray[EBinary],vep:EBaseStruct{assembly_name:EBinary,allele_string:EBinary,ancestral:EBinary,colocated_variants:EArray[EBaseStruct{aa_allele:EBinary,aa_maf:EFloat64,afr_allele:EBinary,afr_maf:EFloat64,allele_string:EBinary,amr_allele:EBinary,amr_maf:EFloat64,clin_sig:EArray[EBinary],end:EInt32,eas_allele:EBinary,eas_maf:EFloat64,ea_allele:EBinary,ea_maf:EFloat64,eur_allele:EBinary,eur_maf:EFloat64,exac_adj_allele:EBinary,exac_adj_maf:EFloat64,exac_allele:EBinary,exac_afr_allele:EBinary,exac_afr_maf:EFloat64,exac_amr_allele:EBinary,exac_amr_maf:EFloat64,exac_eas_allele:EBinary,exac_eas_maf:EFloat64,exac_fin_allele:EBinary,exac_fin_maf:EFloat64,exac_maf:EFloat64,exac_nfe_allele:EBinary,exac_nfe_maf:EFloat64,exac_oth_allele:EBinary,exac_oth_maf:EFloat6..."] !s8 = ToStream(%8) [False] !s9 = StreamMap(!s8) { (%elt4) => SelectFields(%elt4) [ (partitionCounts distinctlyKeyed firstKey lastKey)] } !17 = ToArray(!s9) !18 = WriteMetadata(!17) ["{\"name\":\"TableSpecWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"typ\":{\"rowType\":\"Struct{locus:Locus(GRCh38),alleles:Array[String],vep:Struct{assembly_name:String,allele_string:String,ancestral:String,colocated_variants:Array[Struct{aa_allele:String,aa_maf:Float64,afr_allele:String,afr_maf:Float64,allele_string:String,amr_allele:String,amr_maf:Float64,clin_sig:Array[String],end:Int32,eas_allele:String,eas_maf:Float64,ea_allele:String,ea_maf:Float64,eur_allele:String,eur_maf:Float64,exac_adj_allele:String,exac_adj_maf:Float64,exac_allele:String,exac_afr_allele:String,exac_afr_maf:Float64,exac_amr_allele:String,exac_amr_maf:Float64,exac_eas_allele:String,exac_eas_maf:Float64,exac_fin_allele:String,exac_fin_maf:Float64,exac_maf:Float64,exac_nfe_allele:String,exac_nfe_maf:Float64,exac_oth_allele:String,exac_oth_maf:Float64,exac_sas_allele:String,exac_sas_maf:Float64,id:String,minor_allele:String,minor_allele_freq:Float64,phenotype_or_disease:Int32,pubmed:Array[Int32],sas_allel..."] !19 = Begin(!14, !16, !18) WriteMetadata(!19) ["{\"name\":\"RelationalWriter\",\"path\":\"/tmp/persist_TableEJFCqZneo1\",\"overwrite\":false,\"maybeRefs\":{\"references\":[\"GRCh38\"]}}"] 2023-09-29 17:53:22.157 : INFO: instruction count: 3: __C854HailClassLoaderContainer. 2023-09-29 17:53:22.158 : INFO: instruction count: 3: __C854HailClassLoaderContainer. 2023-09-29 17:53:22.158 : INFO: instruction count: 3: __C856FSContainer. 2023-09-29 17:53:22.158 : INFO: instruction count: 3: __C856FSContainer. 2023-09-29 17:53:22.205 : INFO: instruction count: 3: __C858collect_distributed_array_table_native_writer. 2023-09-29 17:53:22.205 : INFO: instruction count: 181: __C858collect_distributed_array_table_native_writer.apply 2023-09-29 17:53:22.206 : INFO: instruction count: 17: __C858collect_distributed_array_table_native_writer.apply 2023-09-29 17:53:22.206 : INFO: instruction count: 27: __C858collect_distributed_array_table_native_writer.__m860DECODE_r_struct_of_r_struct_of_r_int32ANDr_binaryENDEND_TO_SBaseStructPointer 2023-09-29 17:53:22.206 : INFO: instruction count: 26: __C858collect_distributed_array_table_native_writer.__m861INPLACE_DECODE_r_struct_of_r_int32ANDr_binaryEND_TO_r_struct_of_r_int32ANDr_stringEND 2023-09-29 17:53:22.206 : INFO: instruction count: 10: __C858collect_distributed_array_table_native_writer.__m862INPLACE_DECODE_r_int32_TO_r_int32 2023-09-29 17:53:22.206 : INFO: instruction count: 31: __C858collect_distributed_array_table_native_writer.__m863INPLACE_DECODE_r_binary_TO_r_string 2023-09-29 17:53:22.206 : INFO: instruction count: 27: __C858collect_distributed_array_table_native_writer.__m865DECODE_r_struct_of_r_struct_of_ENDEND_TO_SBaseStructPointer 2023-09-29 17:53:22.206 : INFO: instruction count: 8: __C858collect_distributed_array_table_native_writer.__m866INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-09-29 17:53:22.206 : INFO: instruction count: 49: __C858collect_distributed_array_table_native_writer.__m870concat 2023-09-29 17:53:22.207 : INFO: instruction count: 653: __C858collect_distributed_array_table_native_writer.__m889writeInternalNode 2023-09-29 17:53:22.207 : INFO: instruction count: 25: __C858collect_distributed_array_table_native_writer.__m890ENCODE_SBaseStructPointer_TO_o_struct_of_r_array_of_r_struct_of_r_int64ANDr_int64ANDr_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDENDEND 2023-09-29 17:53:22.207 : INFO: instruction count: 35: __C858collect_distributed_array_table_native_writer.__m891ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_int64ANDr_int64ANDr_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDEND 2023-09-29 17:53:22.208 : INFO: instruction count: 53: __C858collect_distributed_array_table_native_writer.__m892ENCODE_SBaseStructPointer_TO_r_struct_of_r_int64ANDr_int64ANDr_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDEND 2023-09-29 17:53:22.208 : INFO: instruction count: 4: __C858collect_distributed_array_table_native_writer.__m893ENCODE_SInt64$_TO_r_int64 2023-09-29 17:53:22.208 : INFO: instruction count: 96: __C858collect_distributed_array_table_native_writer.__m894ENCODE_SBaseStructPointer_TO_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryEND 2023-09-29 17:53:22.208 : INFO: instruction count: 25: __C858collect_distributed_array_table_native_writer.__m895ENCODE_SCanonicalLocusPointer_TO_o_struct_of_r_binaryANDr_int32END 2023-09-29 17:53:22.208 : INFO: instruction count: 16: __C858collect_distributed_array_table_native_writer.__m896ENCODE_SStringPointer_TO_r_binary 2023-09-29 17:53:22.208 : INFO: instruction count: 4: __C858collect_distributed_array_table_native_writer.__m897ENCODE_SInt32$_TO_r_int32 2023-09-29 17:53:22.208 : INFO: instruction count: 115: __C858collect_distributed_array_table_native_writer.__m898ENCODE_SIndexablePointer_TO_o_array_of_o_binary 2023-09-29 17:53:22.208 : INFO: instruction count: 16: __C858collect_distributed_array_table_native_writer.__m899ENCODE_SStringPointer_TO_o_binary 2023-09-29 17:53:22.208 : INFO: instruction count: 1: __C858collect_distributed_array_table_native_writer.__m900ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-09-29 17:53:22.209 : INFO: instruction count: 552: __C858collect_distributed_array_table_native_writer.__m902writeLeafNode 2023-09-29 17:53:22.209 : INFO: instruction count: 37: __C858collect_distributed_array_table_native_writer.__m903ENCODE_SBaseStructPointer_TO_o_struct_of_r_int64ANDr_array_of_r_struct_of_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDENDEND 2023-09-29 17:53:22.209 : INFO: instruction count: 35: __C858collect_distributed_array_table_native_writer.__m904ENCODE_SIndexablePointer_TO_r_array_of_r_struct_of_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDEND 2023-09-29 17:53:22.209 : INFO: instruction count: 29: __C858collect_distributed_array_table_native_writer.__m905ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDr_int64ANDr_struct_of_ENDEND 2023-09-29 17:53:22.209 : INFO: instruction count: 52: __C858collect_distributed_array_table_native_writer.__m906flush 2023-09-29 17:53:22.210 : INFO: instruction count: 25: __C858collect_distributed_array_table_native_writer.__m908ord_equiv 2023-09-29 17:53:22.210 : INFO: instruction count: 273: __C858collect_distributed_array_table_native_writer.__m909ord_equivNonnull 2023-09-29 17:53:22.210 : INFO: instruction count: 34: __C858collect_distributed_array_table_native_writer.__m910ord_equiv 2023-09-29 17:53:22.210 : INFO: instruction count: 25: __C858collect_distributed_array_table_native_writer.__m911ord_equivNonnull 2023-09-29 17:53:22.210 : INFO: instruction count: 74: __C858collect_distributed_array_table_native_writer.__m912ord_compareNonnull 2023-09-29 17:53:22.210 : INFO: instruction count: 9: __C858collect_distributed_array_table_native_writer.__m915ord_compareNonnull 2023-09-29 17:53:22.211 : INFO: instruction count: 89: __C858collect_distributed_array_table_native_writer.__m916ord_compareNonnull 2023-09-29 17:53:22.211 : INFO: instruction count: 34: __C858collect_distributed_array_table_native_writer.__m917ord_equiv 2023-09-29 17:53:22.211 : INFO: instruction count: 187: __C858collect_distributed_array_table_native_writer.__m918ord_equivNonnull 2023-09-29 17:53:22.211 : INFO: instruction count: 30: __C858collect_distributed_array_table_native_writer.__m919ord_equiv 2023-09-29 17:53:22.211 : INFO: instruction count: 21: __C858collect_distributed_array_table_native_writer.__m920ord_equivNonnull 2023-09-29 17:53:22.211 : INFO: instruction count: 123: __C858collect_distributed_array_table_native_writer.__m921ENCODE_SBaseStructPointer_TO_r_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryANDo_struct_of_o_binaryANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryENDANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryENDANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryANDo_int32ANDo_int32ANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryENDANDr_struct_of_r_int32ANDr_int32ENDEND 2023-09-29 17:53:22.212 : INFO: instruction count: 495: __C858collect_distributed_array_table_native_writer.__m922ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryENDANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryENDANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryANDo_int32ANDo_int32ANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryEND 2023-09-29 17:53:22.212 : INFO: instruction count: 111: __C858collect_distributed_array_table_native_writer.__m923ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END 2023-09-29 17:53:22.213 : INFO: instruction count: 489: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END 2023-09-29 17:53:22.213 : INFO: instruction count: 4: __C858collect_distributed_array_table_native_writer.__m925ENCODE_SFloat64$_TO_o_float64 2023-09-29 17:53:22.213 : INFO: instruction count: 4: __C858collect_distributed_array_table_native_writer.__m926ENCODE_SInt32$_TO_o_int32 2023-09-29 17:53:22.214 : INFO: instruction count: 115: __C858collect_distributed_array_table_native_writer.__m927ENCODE_SIndexablePointer_TO_o_array_of_o_int32 2023-09-29 17:53:22.215 : INFO: instruction count: 111: __C858collect_distributed_array_table_native_writer.__m928ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryEND 2023-09-29 17:53:22.215 : INFO: instruction count: 151: __C858collect_distributed_array_table_native_writer.__m929ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryEND 2023-09-29 17:53:22.215 : INFO: instruction count: 111: __C858collect_distributed_array_table_native_writer.__m930ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryEND 2023-09-29 17:53:22.215 : INFO: instruction count: 293: __C858collect_distributed_array_table_native_writer.__m931ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryEND 2023-09-29 17:53:22.216 : INFO: instruction count: 111: __C858collect_distributed_array_table_native_writer.__m932ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND 2023-09-29 17:53:22.216 : INFO: instruction count: 197: __C858collect_distributed_array_table_native_writer.__m933ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND 2023-09-29 17:53:22.216 : INFO: instruction count: 111: __C858collect_distributed_array_table_native_writer.__m934ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND 2023-09-29 17:53:22.217 : INFO: instruction count: 466: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND 2023-09-29 17:53:22.217 : INFO: instruction count: 111: __C858collect_distributed_array_table_native_writer.__m936ENCODE_SIndexablePointer_TO_o_array_of_o_struct_of_o_binaryANDo_binaryEND 2023-09-29 17:53:22.217 : INFO: instruction count: 59: __C858collect_distributed_array_table_native_writer.__m937ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_binaryEND 2023-09-29 17:53:22.217 : INFO: instruction count: 25: __C858collect_distributed_array_table_native_writer.__m938ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_int32END 2023-09-29 17:53:22.217 : INFO: instruction count: 9: __C858collect_distributed_array_table_native_writer.__m939ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDENDEND 2023-09-29 17:53:22.217 : INFO: instruction count: 87: __C858collect_distributed_array_table_native_writer.__m940ENCODE_SBaseStructPointer_TO_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDEND 2023-09-29 17:53:22.217 : INFO: instruction count: 4: __C858collect_distributed_array_table_native_writer.__m941ENCODE_SBoolean$_TO_r_bool 2023-09-29 17:53:22.218 : INFO: instruction count: 96: __C858collect_distributed_array_table_native_writer.__m942ENCODE_SBaseStructPointer_TO_o_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryEND 2023-09-29 17:53:22.218 : INFO: instruction count: 9: __C858collect_distributed_array_table_native_writer.setPartitionIndex 2023-09-29 17:53:22.218 : INFO: instruction count: 4: __C858collect_distributed_array_table_native_writer.addPartitionRegion 2023-09-29 17:53:22.218 : INFO: instruction count: 4: __C858collect_distributed_array_table_native_writer.setPool 2023-09-29 17:53:22.218 : INFO: instruction count: 3: __C858collect_distributed_array_table_native_writer.addHailClassLoader 2023-09-29 17:53:22.218 : INFO: instruction count: 3: __C858collect_distributed_array_table_native_writer.addFS 2023-09-29 17:53:22.218 : INFO: instruction count: 4: __C858collect_distributed_array_table_native_writer.addTaskContext 2023-09-29 17:53:22.218 : INFO: instruction count: 43: __C858collect_distributed_array_table_native_writer.addReferenceGenomes 2023-09-29 17:53:22.218 : INFO: instruction count: 3: __C858collect_distributed_array_table_native_writer.setObjects 2023-09-29 17:53:22.219 : INFO: instruction count: 422: __C858collect_distributed_array_table_native_writer.apply_region41_72 2023-09-29 17:53:22.219 : INFO: instruction count: 270: __C858collect_distributed_array_table_native_writer.apply_region29_40 2023-09-29 17:53:22.219 : INFO: instruction count: 258: __C858collect_distributed_array_table_native_writer.apply_region73_85 2023-09-29 17:53:22.220 : INFO: instruction count: 528: __C858collect_distributed_array_table_native_writer.apply_region1_86 2023-09-29 17:53:22.220 : INFO: instruction count: 469: __C858collect_distributed_array_table_native_writer.apply_region0_0 2023-09-29 17:53:22.221 : INFO: instruction count: 373: __C858collect_distributed_array_table_native_writer.apply_region87_110 2023-09-29 17:53:22.221 : INFO: instruction count: 102: __C858collect_distributed_array_table_native_writer.__m922ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryENDANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryENDANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryANDo_int32ANDo_int32ANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryEND_region30_35 2023-09-29 17:53:22.221 : INFO: instruction count: 79: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region108_113 2023-09-29 17:53:22.221 : INFO: instruction count: 79: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region18_23 2023-09-29 17:53:22.222 : INFO: instruction count: 83: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region0_5 2023-09-29 17:53:22.222 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region120_125 2023-09-29 17:53:22.222 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region114_119 2023-09-29 17:53:22.222 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region102_107 2023-09-29 17:53:22.222 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region96_101 2023-09-29 17:53:22.222 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region90_95 2023-09-29 17:53:22.222 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region84_89 2023-09-29 17:53:22.222 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region78_83 2023-09-29 17:53:22.223 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region72_77 2023-09-29 17:53:22.223 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region66_71 2023-09-29 17:53:22.223 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32END_region60_65 2023-09-29 17:53:22.223 : INFO: instruction count: 79: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region36_41 2023-09-29 17:53:22.223 : INFO: instruction count: 79: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region30_35 2023-09-29 17:53:22.223 : INFO: instruction count: 83: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region0_5 2023-09-29 17:53:22.223 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region120_125 2023-09-29 17:53:22.223 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region114_119 2023-09-29 17:53:22.223 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region108_113 2023-09-29 17:53:22.224 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region102_107 2023-09-29 17:53:22.224 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region96_101 2023-09-29 17:53:22.224 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region90_95 2023-09-29 17:53:22.224 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region84_89 2023-09-29 17:53:22.224 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region78_83 2023-09-29 17:53:22.224 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region72_77 2023-09-29 17:53:22.224 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region66_71 2023-09-29 17:53:22.224 : INFO: instruction count: 56: __C858collect_distributed_array_table_native_writer.__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryEND_region60_65 2023-09-29 17:53:22.225 : INFO: instruction count: 3: __C945applySpills. 2023-09-29 17:53:22.225 : INFO: instruction count: 3: __C986__m889writeInternalNodeSpills. 2023-09-29 17:53:22.225 : INFO: instruction count: 3: __C989__m902writeLeafNodeSpills. 2023-09-29 17:53:22.225 : INFO: instruction count: 3: __C990__m922ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryENDANDo_binaryANDo_array_of_o_struct_of_o_int32ANDo_array_of_o_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_int32ANDo_float64ANDo_int32ANDo_binaryENDANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_array_of_o_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryANDo_int32ANDo_int32ANDo_array_of_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDANDo_binaryENDSpills. 2023-09-29 17:53:22.225 : INFO: instruction count: 3: __C995__m924ENCODE_SBaseStructPointer_TO_o_struct_of_o_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_array_of_o_binaryANDo_int32ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_float64ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_array_of_o_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_int32ENDSpills. 2023-09-29 17:53:22.225 : INFO: instruction count: 3: __C1013__m935ENCODE_SBaseStructPointer_TO_o_struct_of_o_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_int32ANDo_int32ANDo_int32ANDo_int32ANDo_binaryANDo_array_of_o_binaryANDo_int32ANDo_array_of_o_struct_of_o_binaryANDo_binaryENDANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_float64ANDo_int32ANDo_int32ANDo_binaryANDo_binaryANDo_float64ANDo_int32ANDo_binaryANDo_binaryANDo_binaryANDo_int32ANDo_binaryANDo_binaryENDSpills. 2023-09-29 17:53:22.226 : INFO: instruction count: 3: __C873staticWrapperClass_1. 2023-09-29 17:53:22.226 : INFO: instruction count: 3: __C913RGContainer_GRCh38. 2023-09-29 17:53:22.226 : INFO: instruction count: 3: __C913RGContainer_GRCh38. 2023-09-29 17:53:22.246 : INFO: encoder cache hit 2023-09-29 17:53:22.265 : INFO: instruction count: 3: __C828HailClassLoaderContainer. 2023-09-29 17:53:22.265 : INFO: instruction count: 3: __C828HailClassLoaderContainer. 2023-09-29 17:53:22.265 : INFO: instruction count: 3: __C830FSContainer. 2023-09-29 17:53:22.265 : INFO: instruction count: 3: __C830FSContainer. 2023-09-29 17:53:22.276 : INFO: instruction count: 3: __C832Compiled. 2023-09-29 17:53:22.276 : INFO: instruction count: 50: __C832Compiled.apply 2023-09-29 17:53:22.277 : INFO: instruction count: 473: __C832Compiled.__m836split_Let 2023-09-29 17:53:22.277 : INFO: instruction count: 4: __C832Compiled.setBackend 2023-09-29 17:53:22.277 : INFO: instruction count: 9: __C832Compiled.__m1036ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_r_int32ANDr_binaryENDEND 2023-09-29 17:53:22.277 : INFO: instruction count: 25: __C832Compiled.__m1037ENCODE_SBaseStructPointer_TO_r_struct_of_r_int32ANDr_binaryEND 2023-09-29 17:53:22.277 : INFO: instruction count: 4: __C832Compiled.__m1038ENCODE_SInt32$_TO_r_int32 2023-09-29 17:53:22.278 : INFO: instruction count: 16: __C832Compiled.__m1039ENCODE_SStringPointer_TO_r_binary 2023-09-29 17:53:22.278 : INFO: instruction count: 9: __C832Compiled.__m1040ENCODE_SBaseStructPointer_TO_r_struct_of_r_struct_of_ENDEND 2023-09-29 17:53:22.278 : INFO: instruction count: 1: __C832Compiled.__m1041ENCODE_SBaseStructPointer_TO_r_struct_of_END 2023-09-29 17:53:22.278 : INFO: instruction count: 27: __C832Compiled.__m1044DECODE_r_struct_of_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDENDEND_TO_SBaseStructPointer 2023-09-29 17:53:22.278 : INFO: instruction count: 102: __C832Compiled.__m1045INPLACE_DECODE_r_struct_of_r_binaryANDr_int64ANDr_boolANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDANDo_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryENDEND_TO_r_struct_of_r_stringANDr_int64ANDr_boolANDo_struct_of_o_locusANDo_array_of_o_stringENDANDo_struct_of_o_locusANDo_array_of_o_stringENDEND 2023-09-29 17:53:22.278 : INFO: instruction count: 31: __C832Compiled.__m1046INPLACE_DECODE_r_binary_TO_r_string 2023-09-29 17:53:22.278 : INFO: instruction count: 10: __C832Compiled.__m1047INPLACE_DECODE_r_int64_TO_r_int64 2023-09-29 17:53:22.278 : INFO: instruction count: 10: __C832Compiled.__m1048INPLACE_DECODE_r_bool_TO_r_bool 2023-09-29 17:53:22.278 : INFO: instruction count: 75: __C832Compiled.__m1049INPLACE_DECODE_o_struct_of_o_struct_of_r_binaryANDr_int32ENDANDo_array_of_o_binaryEND_TO_o_struct_of_o_locusANDo_array_of_o_stringEND 2023-09-29 17:53:22.278 : INFO: instruction count: 26: __C832Compiled.__m1050INPLACE_DECODE_o_struct_of_r_binaryANDr_int32END_TO_o_locus 2023-09-29 17:53:22.278 : INFO: instruction count: 10: __C832Compiled.__m1051INPLACE_DECODE_r_int32_TO_r_int32 2023-09-29 17:53:22.279 : INFO: instruction count: 114: __C832Compiled.__m1052INPLACE_DECODE_o_array_of_o_binary_TO_o_array_of_o_string 2023-09-29 17:53:22.279 : INFO: instruction count: 31: __C832Compiled.__m1053INPLACE_DECODE_o_binary_TO_o_string 2023-09-29 17:53:22.279 : INFO: instruction count: 301: __C832Compiled.__m1057begin_group_0 2023-09-29 17:53:22.280 : INFO: instruction count: 143: __C832Compiled.__m1061split_ToArray 2023-09-29 17:53:22.280 : INFO: instruction count: 229: __C832Compiled.__m1072split_ToArray 2023-09-29 17:53:22.280 : INFO: instruction count: 18: __C832Compiled.__m1083ord_equiv 2023-09-29 17:53:22.280 : INFO: instruction count: 336: __C832Compiled.__m1084ord_equivNonnull 2023-09-29 17:53:22.281 : INFO: instruction count: 34: __C832Compiled.__m1085ord_equiv 2023-09-29 17:53:22.281 : INFO: instruction count: 25: __C832Compiled.__m1086ord_equivNonnull 2023-09-29 17:53:22.281 : INFO: instruction count: 74: __C832Compiled.__m1087ord_compareNonnull 2023-09-29 17:53:22.281 : INFO: instruction count: 9: __C832Compiled.__m1088ord_compareNonnull 2023-09-29 17:53:22.281 : INFO: instruction count: 89: __C832Compiled.__m1089ord_compareNonnull 2023-09-29 17:53:22.281 : INFO: instruction count: 34: __C832Compiled.__m1090ord_equiv 2023-09-29 17:53:22.281 : INFO: instruction count: 187: __C832Compiled.__m1091ord_equivNonnull 2023-09-29 17:53:22.282 : INFO: instruction count: 30: __C832Compiled.__m1092ord_equiv 2023-09-29 17:53:22.282 : INFO: instruction count: 21: __C832Compiled.__m1093ord_equivNonnull 2023-09-29 17:53:22.282 : INFO: instruction count: 9: __C832Compiled.setPartitionIndex 2023-09-29 17:53:22.282 : INFO: instruction count: 4: __C832Compiled.addPartitionRegion 2023-09-29 17:53:22.282 : INFO: instruction count: 4: __C832Compiled.setPool 2023-09-29 17:53:22.282 : INFO: instruction count: 3: __C832Compiled.addHailClassLoader 2023-09-29 17:53:22.282 : INFO: instruction count: 3: __C832Compiled.addFS 2023-09-29 17:53:22.282 : INFO: instruction count: 4: __C832Compiled.addTaskContext 2023-09-29 17:53:22.282 : INFO: instruction count: 43: __C832Compiled.addReferenceGenomes 2023-09-29 17:53:22.282 : INFO: instruction count: 3: __C832Compiled.setObjects 2023-09-29 17:53:22.282 : INFO: instruction count: 131: __C832Compiled.addAndDecodeLiterals 2023-09-29 17:53:22.282 : INFO: instruction count: 45: __C832Compiled.__m1098DECODE_r_struct_of_r_struct_of_ENDANDr_binaryANDr_array_of_r_binaryEND_TO_SBaseStructPointer 2023-09-29 17:53:22.283 : INFO: instruction count: 8: __C832Compiled.__m1099INPLACE_DECODE_r_struct_of_END_TO_r_struct_of_END 2023-09-29 17:53:22.283 : INFO: instruction count: 58: __C832Compiled.__m1100INPLACE_DECODE_r_array_of_r_binary_TO_r_array_of_r_string 2023-09-29 17:53:22.283 : INFO: instruction count: 18: __C832Compiled.__m1101DECODE_r_struct_of_END_TO_SBaseStructPointer 2023-09-29 17:53:22.283 : INFO: instruction count: 335: __C832Compiled.__m1057begin_group_0_region18_47 2023-09-29 17:53:22.283 : INFO: instruction count: 3: __C1102__m1057begin_group_0Spills. 2023-09-29 17:53:22.284 : INFO: instruction count: 3: __C834RGContainer_GRCh38. 2023-09-29 17:53:22.284 : INFO: instruction count: 3: __C834RGContainer_GRCh38. 2023-09-29 17:53:22.284 : INFO: instruction count: 3: __C1042staticWrapperClass_1. 2023-09-29 17:53:22.410 : INFO: [collectDArray|table_native_writer]: executing 121044 tasks, contexts size = 2.77 MiB, globals size = 4.00 B 2023-09-29 18:52:50.253 : INFO: RegionPool: initialized for thread 19: Thread-4 2023-09-29 18:52:50.254 : INFO: TaskReport: stage=0, partition=0, attempt=0, peakBytes=0, peakBytesReadable=0.00 B, chunks requested=0, cache hits=0 2023-09-29 18:52:50.254 : INFO: RegionPool: FREE: 0 allocated (0 blocks / 0 chunks), regions.size = 0, 0 current java objects, thread 19: Thread-4 2023-09-29 18:52:50.254 : ERROR: error while applying lowering 'LowerOrInterpretNonCompilable' 2023-09-29 18:52:50.254 : INFO: RegionPool: initialized for thread 19: Thread-4 2023-09-29 18:52:50.254 : INFO: TaskReport: stage=0, partition=0, attempt=0, peakBytes=0, peakBytesReadable=0.00 B, chunks requested=0, cache hits=0 2023-09-29 18:52:50.254 : INFO: RegionPool: FREE: 0 allocated (0 blocks / 0 chunks), regions.size = 0, 0 current java objects, thread 19: Thread-4 2023-09-29 18:52:50.254 : INFO: RegionPool: FREE: 28.1M allocated (23.1M blocks / 5.0M chunks), regions.size = 2, 0 current java objects, thread 19: Thread-4 2023-09-29 18:52:50.259 : ERROR: SparkException: Job 0 cancelled because SparkContext was shut down From org.apache.spark.SparkException: Job 0 cancelled because SparkContext was shut down at org.apache.spark.scheduler.DAGScheduler.$anonfun$cleanUpAfterSchedulerStop$1(DAGScheduler.scala:1188) at org.apache.spark.scheduler.DAGScheduler.$anonfun$cleanUpAfterSchedulerStop$1$adapted(DAGScheduler.scala:1186) at scala.collection.mutable.HashSet.foreach(HashSet.scala:79) at org.apache.spark.scheduler.DAGScheduler.cleanUpAfterSchedulerStop(DAGScheduler.scala:1186) at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onStop(DAGScheduler.scala:2887) at org.apache.spark.util.EventLoop.stop(EventLoop.scala:84) at org.apache.spark.scheduler.DAGScheduler.stop(DAGScheduler.scala:2784) at org.apache.spark.SparkContext.$anonfun$stop$11(SparkContext.scala:2095) at org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1484) at org.apache.spark.SparkContext.stop(SparkContext.scala:2095) at org.apache.spark.scheduler.cluster.YarnClientSchedulerBackend$MonitorThread.run(YarnClientSchedulerBackend.scala:125) at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:952) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2228) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2249) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2268) at org.apache.spark.SparkContext.runJob(SparkContext.scala:2293) at org.apache.spark.rdd.RDD.$anonfun$collect$1(RDD.scala:1021) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151) at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112) at org.apache.spark.rdd.RDD.withScope(RDD.scala:406) at org.apache.spark.rdd.RDD.collect(RDD.scala:1020) at is.hail.backend.spark.SparkBackend.parallelizeAndComputeWithIndex(SparkBackend.scala:406) at is.hail.backend.BackendUtils.collectDArray(BackendUtils.scala:86) at __C832Compiled.__m836split_Let(Emit.scala) at __C832Compiled.apply(Emit.scala) at is.hail.expr.ir.CompileAndEvaluate$.$anonfun$_apply$4(CompileAndEvaluate.scala:61) at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.CompileAndEvaluate$.$anonfun$_apply$2(CompileAndEvaluate.scala:61) at is.hail.expr.ir.CompileAndEvaluate$.$anonfun$_apply$2$adapted(CompileAndEvaluate.scala:59) at is.hail.backend.ExecuteContext.$anonfun$scopedExecution$1(ExecuteContext.scala:140) at is.hail.utils.package$.using(package.scala:637) at is.hail.backend.ExecuteContext.scopedExecution(ExecuteContext.scala:140) at is.hail.expr.ir.CompileAndEvaluate$._apply(CompileAndEvaluate.scala:59) at is.hail.expr.ir.CompileAndEvaluate$.$anonfun$apply$1(CompileAndEvaluate.scala:19) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.CompileAndEvaluate$.apply(CompileAndEvaluate.scala:19) at is.hail.expr.ir.TableWriter.apply(TableWriter.scala:46) at is.hail.expr.ir.Interpret$.run(Interpret.scala:865) at is.hail.expr.ir.Interpret$.alreadyLowered(Interpret.scala:59) at is.hail.expr.ir.LowerOrInterpretNonCompilable$.evaluate$1(LowerOrInterpretNonCompilable.scala:20) at is.hail.expr.ir.LowerOrInterpretNonCompilable$.rewrite$1(LowerOrInterpretNonCompilable.scala:58) at is.hail.expr.ir.LowerOrInterpretNonCompilable$.apply(LowerOrInterpretNonCompilable.scala:63) at is.hail.expr.ir.lowering.LowerOrInterpretNonCompilablePass$.transform(LoweringPass.scala:77) at is.hail.expr.ir.lowering.LoweringPass.$anonfun$apply$3(LoweringPass.scala:26) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.lowering.LoweringPass.$anonfun$apply$1(LoweringPass.scala:26) at is.hail.utils.ExecutionTimer.time(ExecutionTimer.scala:81) at is.hail.expr.ir.lowering.LoweringPass.apply(LoweringPass.scala:24) at is.hail.expr.ir.lowering.LoweringPass.apply$(LoweringPass.scala:23) at is.hail.expr.ir.lowering.LowerOrInterpretNonCompilablePass$.apply(LoweringPass.scala:72) at is.hail.expr.ir.lowering.LoweringPipeline.$anonfun$apply$1(LoweringPipeline.scala:22) at is.hail.expr.ir.lowering.LoweringPipeline.$anonfun$apply$1$adapted(LoweringPipeline.scala:20) at scala.collection.mutable.ResizableArray.foreach(ResizableArray.scala:62) at scala.collection.mutable.ResizableArray.foreach$(ResizableArray.scala:55) at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:49) at is.hail.expr.ir.lowering.LoweringPipeline.apply(LoweringPipeline.scala:20) at is.hail.expr.ir.CompileAndEvaluate$._apply(CompileAndEvaluate.scala:50) at is.hail.backend.spark.SparkBackend._execute(SparkBackend.scala:505) at is.hail.backend.spark.SparkBackend.$anonfun$executeEncode$2(SparkBackend.scala:541) at is.hail.backend.ExecuteContext$.$anonfun$scoped$3(ExecuteContext.scala:76) at is.hail.utils.package$.using(package.scala:637) at is.hail.backend.ExecuteContext$.$anonfun$scoped$2(ExecuteContext.scala:76) at is.hail.utils.package$.using(package.scala:637) at is.hail.annotations.RegionPool$.scoped(RegionPool.scala:17) at is.hail.backend.ExecuteContext$.scoped(ExecuteContext.scala:62) at is.hail.backend.spark.SparkBackend.$anonfun$withExecuteContext$1(SparkBackend.scala:345) at is.hail.backend.spark.SparkBackend.$anonfun$executeEncode$1(SparkBackend.scala:538) at is.hail.utils.ExecutionTimer$.time(ExecutionTimer.scala:52) at is.hail.backend.spark.SparkBackend.executeEncode(SparkBackend.scala:537) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:566) at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244) at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357) at py4j.Gateway.invoke(Gateway.java:282) at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132) at py4j.commands.CallCommand.execute(CallCommand.java:79) at py4j.ClientServerConnection.waitForCommands(ClientServerConnection.java:182) at py4j.ClientServerConnection.run(ClientServerConnection.java:106) at java.base/java.lang.Thread.run(Thread.java:829)