2020-02-14 14:24:46 Hail: WARN: This Hail JAR was compiled for Spark 2.4.0, running with Spark 2.4.1. Compatibility is not guaranteed. 2020-02-14 14:24:46 SparkContext: INFO: Running Spark version 2.4.1 2020-02-14 14:24:46 SparkContext: INFO: Submitted application: Hail 2020-02-14 14:24:46 SparkContext: INFO: Spark configuration: spark.app.name=Hail spark.driver.extraClassPath=/home/unix/samn/miniconda3/envs/hail/lib/python3.7/site-packages/hail/hail-all-spark.jar spark.executor.extraClassPath=./hail-all-spark.jar spark.hadoop.io.compression.codecs=org.apache.hadoop.io.compress.DefaultCodec,is.hail.io.compress.BGzipCodec,is.hail.io.compress.BGzipCodecTbi,org.apache.hadoop.io.compress.GzipCodec spark.hadoop.mapreduce.input.fileinputformat.split.minsize=0 spark.jars=file:///home/unix/samn/miniconda3/envs/hail/lib/python3.7/site-packages/hail/hail-all-spark.jar spark.kryo.registrator=is.hail.kryo.HailKryoRegistrator spark.logConf=true spark.master=local[*] spark.repl.local.jars=file:///home/unix/samn/miniconda3/envs/hail/lib/python3.7/site-packages/hail/hail-all-spark.jar spark.serializer=org.apache.spark.serializer.KryoSerializer spark.submit.deployMode=client spark.ui.showConsoleProgress=false 2020-02-14 14:24:46 SecurityManager: INFO: Changing view acls to: samn 2020-02-14 14:24:46 SecurityManager: INFO: Changing modify acls to: samn 2020-02-14 14:24:46 SecurityManager: INFO: Changing view acls groups to: 2020-02-14 14:24:46 SecurityManager: INFO: Changing modify acls groups to: 2020-02-14 14:24:46 SecurityManager: INFO: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(samn); groups with view permissions: Set(); users with modify permissions: Set(samn); groups with modify permissions: Set() 2020-02-14 14:24:47 Utils: INFO: Successfully started service 'sparkDriver' on port 33671. 2020-02-14 14:24:47 SparkEnv: INFO: Registering MapOutputTracker 2020-02-14 14:24:47 SparkEnv: INFO: Registering BlockManagerMaster 2020-02-14 14:24:47 BlockManagerMasterEndpoint: INFO: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information 2020-02-14 14:24:47 BlockManagerMasterEndpoint: INFO: BlockManagerMasterEndpoint up 2020-02-14 14:24:47 DiskBlockManager: INFO: Created local directory at /tmp/blockmgr-0fe269c7-26c3-41d5-a7eb-c00616cdee60 2020-02-14 14:24:47 MemoryStore: INFO: MemoryStore started with capacity 413.9 MB 2020-02-14 14:24:47 SparkEnv: INFO: Registering OutputCommitCoordinator 2020-02-14 14:24:47 log: INFO: Logging initialized @4419ms 2020-02-14 14:24:47 Server: INFO: jetty-9.3.z-SNAPSHOT, build timestamp: unknown, git hash: unknown 2020-02-14 14:24:47 Server: INFO: Started @4619ms 2020-02-14 14:24:47 AbstractConnector: INFO: Started ServerConnector@1ceac417{HTTP/1.1,[http/1.1]}{0.0.0.0:4040} 2020-02-14 14:24:47 Utils: INFO: Successfully started service 'SparkUI' on port 4040. 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@7dc32f63{/jobs,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@1f3f70fa{/jobs/json,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@6f649f8c{/jobs/job,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@268120b5{/jobs/job/json,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@42dd2c3f{/stages,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@98e4317{/stages/json,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@5cd73471{/stages/stage,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@238623b3{/stages/stage/json,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@4617ff0e{/stages/pool,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@54671699{/stages/pool/json,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@56a48802{/storage,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@44ada2de{/storage/json,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@3dbbdaca{/storage/rdd,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@5104d03a{/storage/rdd/json,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@2392a680{/environment,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@a804b7e{/environment/json,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@690ebd6e{/executors,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@1efc3575{/executors/json,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@28ec368c{/executors/threadDump,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@20bf4354{/executors/threadDump/json,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@3c466fe0{/static,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@72a88000{/,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@618de978{/api,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@6449b5dd{/jobs/job/kill,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@14ce5b61{/stages/stage/kill,null,AVAILABLE,@Spark} 2020-02-14 14:24:47 SparkUI: INFO: Bound SparkUI to 0.0.0.0, and started at http://uger-c006.broadinstitute.org:4040 2020-02-14 14:24:47 SparkContext: INFO: Added JAR file:///home/unix/samn/miniconda3/envs/hail/lib/python3.7/site-packages/hail/hail-all-spark.jar at spark://uger-c006.broadinstitute.org:33671/jars/hail-all-spark.jar with timestamp 1581690287796 2020-02-14 14:24:48 Executor: INFO: Starting executor ID driver on host localhost 2020-02-14 14:24:48 Utils: INFO: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 36093. 2020-02-14 14:24:48 NettyBlockTransferService: INFO: Server created on uger-c006.broadinstitute.org:36093 2020-02-14 14:24:48 BlockManager: INFO: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy 2020-02-14 14:24:48 BlockManagerMaster: INFO: Registering BlockManager BlockManagerId(driver, uger-c006.broadinstitute.org, 36093, None) 2020-02-14 14:24:48 BlockManagerMasterEndpoint: INFO: Registering block manager uger-c006.broadinstitute.org:36093 with 413.9 MB RAM, BlockManagerId(driver, uger-c006.broadinstitute.org, 36093, None) 2020-02-14 14:24:48 BlockManagerMaster: INFO: Registered BlockManager BlockManagerId(driver, uger-c006.broadinstitute.org, 36093, None) 2020-02-14 14:24:48 BlockManager: INFO: Initialized BlockManager: BlockManagerId(driver, uger-c006.broadinstitute.org, 36093, None) 2020-02-14 14:24:48 ContextHandler: INFO: Started o.s.j.s.ServletContextHandler@165d58c8{/metrics/json,null,AVAILABLE,@Spark} 2020-02-14 14:24:48 Hail: INFO: Hail temporary directory: file:/tmp/hail.CIysp3LY0gRC 2020-02-14 14:24:48 Hail: INFO: SparkUI: http://uger-c006.broadinstitute.org:4040 2020-02-14 14:24:48 Hail: INFO: Running Hail version 0.2.20-dd6c996e7db5 2020-02-14 14:24:49 MemoryStore: INFO: Block broadcast_0 stored as values in memory (estimated size 33.5 KB, free 413.9 MB) 2020-02-14 14:24:49 MemoryStore: INFO: Block broadcast_0_piece0 stored as bytes in memory (estimated size 2.9 KB, free 413.9 MB) 2020-02-14 14:24:49 BlockManagerInfo: INFO: Added broadcast_0_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 2.9 KB, free: 413.9 MB) 2020-02-14 14:24:49 SparkContext: INFO: Created broadcast 0 from broadcast at SparkBackend.scala:26 2020-02-14 14:24:51 MemoryStore: INFO: Block broadcast_1 stored as values in memory (estimated size 1643.2 KB, free 412.3 MB) 2020-02-14 14:24:51 MemoryStore: INFO: Block broadcast_1_piece0 stored as bytes in memory (estimated size 108.4 KB, free 412.2 MB) 2020-02-14 14:24:51 BlockManagerInfo: INFO: Added broadcast_1_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 108.4 KB, free: 413.8 MB) 2020-02-14 14:24:51 SparkContext: INFO: Created broadcast 1 from broadcast at SparkBackend.scala:26 2020-02-14 14:24:51 MemoryStore: INFO: Block broadcast_2 stored as values in memory (estimated size 8.7 KB, free 412.2 MB) 2020-02-14 14:24:51 MemoryStore: INFO: Block broadcast_2_piece0 stored as bytes in memory (estimated size 1000.0 B, free 412.2 MB) 2020-02-14 14:24:51 BlockManagerInfo: INFO: Added broadcast_2_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 1000.0 B, free: 413.8 MB) 2020-02-14 14:24:51 SparkContext: INFO: Created broadcast 2 from broadcast at SparkBackend.scala:26 2020-02-14 14:24:51 SparkContext: WARN: Using an existing SparkContext; some configuration may not take effect. 2020-02-14 14:24:53 MemoryStore: INFO: Block broadcast_3 stored as values in memory (estimated size 237.3 KB, free 411.9 MB) 2020-02-14 14:24:53 MemoryStore: INFO: Block broadcast_3_piece0 stored as bytes in memory (estimated size 23.0 KB, free 411.9 MB) 2020-02-14 14:24:53 BlockManagerInfo: INFO: Added broadcast_3_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 23.0 KB, free: 413.8 MB) 2020-02-14 14:24:53 SparkContext: INFO: Created broadcast 3 from broadcast at HailContext.scala:621 2020-02-14 14:24:53 MemoryStore: INFO: Block broadcast_4 stored as values in memory (estimated size 2.5 MB, free 409.5 MB) 2020-02-14 14:24:53 MemoryStore: INFO: Block broadcast_4_piece0 stored as bytes in memory (estimated size 219.5 KB, free 409.2 MB) 2020-02-14 14:24:53 BlockManagerInfo: INFO: Added broadcast_4_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 219.5 KB, free: 413.6 MB) 2020-02-14 14:24:53 SparkContext: INFO: Created broadcast 4 from broadcast at SparkBackend.scala:26 2020-02-14 14:24:54 SparkContext: INFO: Starting job: foreach at LoadVCF.scala:1486 2020-02-14 14:24:54 DAGScheduler: INFO: Got job 0 (foreach at LoadVCF.scala:1486) with 1 output partitions 2020-02-14 14:24:54 DAGScheduler: INFO: Final stage: ResultStage 0 (foreach at LoadVCF.scala:1486) 2020-02-14 14:24:54 DAGScheduler: INFO: Parents of final stage: List() 2020-02-14 14:24:54 DAGScheduler: INFO: Missing parents: List() 2020-02-14 14:24:54 DAGScheduler: INFO: Submitting ResultStage 0 (ParallelCollectionRDD[0] at parallelize at LoadVCF.scala:1486), which has no missing parents 2020-02-14 14:24:54 MemoryStore: INFO: Block broadcast_5 stored as values in memory (estimated size 3.9 KB, free 409.2 MB) 2020-02-14 14:24:54 MemoryStore: INFO: Block broadcast_5_piece0 stored as bytes in memory (estimated size 2.4 KB, free 409.2 MB) 2020-02-14 14:24:54 BlockManagerInfo: INFO: Added broadcast_5_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 2.4 KB, free: 413.6 MB) 2020-02-14 14:24:54 SparkContext: INFO: Created broadcast 5 from broadcast at DAGScheduler.scala:1161 2020-02-14 14:24:54 DAGScheduler: INFO: Submitting 1 missing tasks from ResultStage 0 (ParallelCollectionRDD[0] at parallelize at LoadVCF.scala:1486) (first 15 tasks are for partitions Vector(0)) 2020-02-14 14:24:54 TaskSchedulerImpl: INFO: Adding task set 0.0 with 1 tasks 2020-02-14 14:24:54 TaskSetManager: INFO: Starting task 0.0 in stage 0.0 (TID 0, localhost, executor driver, partition 0, PROCESS_LOCAL, 7721 bytes) 2020-02-14 14:24:54 Executor: INFO: Running task 0.0 in stage 0.0 (TID 0) 2020-02-14 14:24:54 Executor: INFO: Finished task 0.0 in stage 0.0 (TID 0). 666 bytes result sent to driver 2020-02-14 14:24:54 TaskSetManager: INFO: Finished task 0.0 in stage 0.0 (TID 0) in 203 ms on localhost (executor driver) (1/1) 2020-02-14 14:24:54 DAGScheduler: INFO: ResultStage 0 (foreach at LoadVCF.scala:1486) finished in 0.342 s 2020-02-14 14:24:54 TaskSchedulerImpl: INFO: Removed TaskSet 0.0, whose tasks have all completed, from pool 2020-02-14 14:24:54 DAGScheduler: INFO: Job 0 finished: foreach at LoadVCF.scala:1486, took 0.438044 s 2020-02-14 14:24:54 BlockManagerInfo: INFO: Removed broadcast_4_piece0 on uger-c006.broadinstitute.org:36093 in memory (size: 219.5 KB, free: 413.8 MB) 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 15 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 17 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 18 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 23 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 9 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 4 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 11 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 6 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 25 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 21 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 16 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 3 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 2 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 1 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 8 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 22 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 12 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 19 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 14 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 7 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 10 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 5 2020-02-14 14:24:54 ContextCleaner: INFO: Cleaned accumulator 24 2020-02-14 14:24:54 BlockManagerInfo: INFO: Removed broadcast_5_piece0 on uger-c006.broadinstitute.org:36093 in memory (size: 2.4 KB, free: 413.8 MB) 2020-02-14 14:24:55 ContextCleaner: INFO: Cleaned accumulator 20 2020-02-14 14:24:55 ContextCleaner: INFO: Cleaned accumulator 13 2020-02-14 14:24:55 root: INFO: optimize (CompileAndEvaluate: first pass): before: IR size 9: (MatrixWrite "{\"name\":\"MatrixVCFWriter\",\"path\":\"/seq/tng/newCloudJointGenotyping/PO-23593/CCDG_F2_Baylor_BioME_GRU_GATK_v1/CCDG_F2_Baylor_BioME_GRU_GATK_v1.chr1.vcf.bgz\",\"exportType\":0}" (MatrixFilterCols (MatrixRead None False False "{\"name\":\"MatrixVCFReader\",\"files\":[\"1.ccdgf2_qced_main.vcf.bgz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":false,\"gzAsBGZ\":false,\"forceGZ\":true,\"filterAndReplace\":{\"name\":\"TextInputFilterAndReplace\",\"findPattern\":\"nul\",\"replacePattern\":\".\"},\"partitionsJSON\":null}") (Coalesce (ApplyIR contains (Literal Array[String] ) (GetField s (Ref sa))) (False)))) 2020-02-14 14:24:55 root: INFO: optimize (CompileAndEvaluate: first pass): after: IR size 9: (MatrixWrite "{\"name\":\"MatrixVCFWriter\",\"path\":\"/seq/tng/newCloudJointGenotyping/PO-23593/CCDG_F2_Baylor_BioME_GRU_GATK_v1/CCDG_F2_Baylor_BioME_GRU_GATK_v1.chr1.vcf.bgz\",\"exportType\":0}" (MatrixFilterCols (MatrixRead None False False "{\"name\":\"MatrixVCFReader\",\"files\":[\"1.ccdgf2_qced_main.vcf.bgz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":false,\"gzAsBGZ\":false,\"forceGZ\":true,\"filterAndReplace\":{\"name\":\"TextInputFilterAndReplace\",\"findPattern\":\"nul\",\"replacePattern\":\".\"},\"partitionsJSON\":null}") (Coalesce (ApplyIR contains (Literal Set[String] ) (GetField s (Ref sa))) (False)))) 2020-02-14 14:24:55 root: INFO: optimize (CompileAndEvaluate: after Matrix lowering): before: IR size 44: (TableWrite "{\"writer\":{\"path\":\"/seq/tng/newCloudJointGenotyping/PO-23593/CCDG_F2_Baylor_BioME_GRU_GATK_v1/CCDG_F2_Baylor_BioME_GRU_GATK_v1.chr1.vcf.bgz\",\"exportType\":0},\"colsFieldName\":\"__cols\",\"entriesFieldName\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"colKey\":[\"s\"]}" (TableMapGlobals (TableMapRows (TableMapGlobals (TableRead None False "{\"files\":[\"1.ccdgf2_qced_main.vcf.bgz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":false,\"gzAsBGZ\":false,\"forceGZ\":true,\"filterAndReplace\":{\"name\":\"TextInputFilterAndReplace\",\"findPattern\":\"nul\",\"replacePattern\":\".\"},\"partitionsJSON\":null}") (InsertFields (Ref global) None (newColIdx (ArrayFilter i (ArrayRange (I32 0) (ArrayLen (GetField __cols (Ref global))) (I32 1)) (Let sa (ArrayRef (GetField __cols (Ref global)) (Ref i)) (Coalesce (ApplyIR contains (Literal Set[String] ) (GetField s (Ref sa))) (False))))))) (InsertFields (Ref row) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (ArrayMap i (GetField newColIdx (Ref global)) (ArrayRef (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row)) (Ref i)))))) (SelectFields (__cols) (InsertFields (Ref global) None (__cols (ArrayMap i (GetField newColIdx (Ref global)) (ArrayRef (GetField __cols (Ref global)) (Ref i)))))))) 2020-02-14 14:24:55 root: INFO: optimize (CompileAndEvaluate: after Matrix lowering): after: IR size 42: (TableWrite "{\"writer\":{\"path\":\"/seq/tng/newCloudJointGenotyping/PO-23593/CCDG_F2_Baylor_BioME_GRU_GATK_v1/CCDG_F2_Baylor_BioME_GRU_GATK_v1.chr1.vcf.bgz\",\"exportType\":0},\"colsFieldName\":\"__cols\",\"entriesFieldName\":\"the entries! [877f12a8827e18f61222c6c8c5fb04a8]\",\"colKey\":[\"s\"]}" (TableMapGlobals (TableMapRows (TableMapGlobals (TableRead None False "{\"files\":[\"1.ccdgf2_qced_main.vcf.bgz\"],\"callFields\":[\"PGT\"],\"entryFloatTypeName\":\"Float64\",\"rg\":\"GRCh38\",\"contigRecoding\":{},\"arrayElementsRequired\":true,\"skipInvalidLoci\":false,\"gzAsBGZ\":false,\"forceGZ\":true,\"filterAndReplace\":{\"name\":\"TextInputFilterAndReplace\",\"findPattern\":\"nul\",\"replacePattern\":\".\"},\"partitionsJSON\":null}") (InsertFields (Ref global) None (newColIdx (ArrayFilter __iruid_48 (ArrayRange (I32 0) (ArrayLen (GetField __cols (Ref global))) (I32 1)) (Coalesce (ApplyIR contains (Literal Set[String] ) (GetField s (ArrayRef (GetField __cols (Ref global)) (Ref __iruid_48)))) (False)))))) (InsertFields (Ref row) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (ArrayMap __iruid_49 (GetField newColIdx (Ref global)) (ArrayRef (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row)) (Ref __iruid_49)))))) (InsertFields (SelectFields (__cols) (Ref global)) ("__cols") (__cols (ArrayMap __iruid_50 (GetField newColIdx (Ref global)) (ArrayRef (GetField __cols (Ref global)) (Ref __iruid_50))))))) 2020-02-14 14:24:56 MemoryStore: INFO: Block broadcast_6 stored as values in memory (estimated size 558.4 KB, free 411.4 MB) 2020-02-14 14:24:56 MemoryStore: INFO: Block broadcast_6_piece0 stored as bytes in memory (estimated size 253.6 KB, free 411.1 MB) 2020-02-14 14:24:56 BlockManagerInfo: INFO: Added broadcast_6_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 253.6 KB, free: 413.5 MB) 2020-02-14 14:24:56 SparkContext: INFO: Created broadcast 6 from broadcast at SparkBackend.scala:26 2020-02-14 14:24:56 MemoryStore: INFO: Block broadcast_7 stored as values in memory (estimated size 237.4 KB, free 410.9 MB) 2020-02-14 14:24:56 MemoryStore: INFO: Block broadcast_7_piece0 stored as bytes in memory (estimated size 23.0 KB, free 410.9 MB) 2020-02-14 14:24:56 BlockManagerInfo: INFO: Added broadcast_7_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 23.0 KB, free: 413.5 MB) 2020-02-14 14:24:56 SparkContext: INFO: Created broadcast 7 from textFile at RichSparkContext.scala:16 2020-02-14 14:24:56 FileInputFormat: INFO: Total input paths to process : 1 2020-02-14 14:24:56 SparkContext: INFO: Starting job: collect at ContextRDD.scala:222 2020-02-14 14:24:56 DAGScheduler: INFO: Got job 1 (collect at ContextRDD.scala:222) with 882 output partitions 2020-02-14 14:24:56 DAGScheduler: INFO: Final stage: ResultStage 1 (collect at ContextRDD.scala:222) 2020-02-14 14:24:56 DAGScheduler: INFO: Parents of final stage: List() 2020-02-14 14:24:56 DAGScheduler: INFO: Missing parents: List() 2020-02-14 14:24:56 DAGScheduler: INFO: Submitting ResultStage 1 (MapPartitionsRDD[8] at mapPartitions at ContextRDD.scala:216), which has no missing parents 2020-02-14 14:24:56 MemoryStore: INFO: Block broadcast_8 stored as values in memory (estimated size 49.4 KB, free 410.8 MB) 2020-02-14 14:24:56 MemoryStore: INFO: Block broadcast_8_piece0 stored as bytes in memory (estimated size 13.9 KB, free 410.8 MB) 2020-02-14 14:24:56 BlockManagerInfo: INFO: Added broadcast_8_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 13.9 KB, free: 413.5 MB) 2020-02-14 14:24:56 SparkContext: INFO: Created broadcast 8 from broadcast at DAGScheduler.scala:1161 2020-02-14 14:24:56 DAGScheduler: INFO: Submitting 882 missing tasks from ResultStage 1 (MapPartitionsRDD[8] at mapPartitions at ContextRDD.scala:216) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)) 2020-02-14 14:24:56 TaskSchedulerImpl: INFO: Adding task set 1.0 with 882 tasks 2020-02-14 14:24:56 TaskSetManager: INFO: Starting task 0.0 in stage 1.0 (TID 1, localhost, executor driver, partition 0, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:24:56 Executor: INFO: Running task 0.0 in stage 1.0 (TID 1) 2020-02-14 14:24:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:0+33554432 2020-02-14 14:24:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:25:07 Executor: INFO: Finished task 0.0 in stage 1.0 (TID 1). 1639 bytes result sent to driver 2020-02-14 14:25:07 TaskSetManager: INFO: Starting task 1.0 in stage 1.0 (TID 2, localhost, executor driver, partition 1, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:25:07 Executor: INFO: Running task 1.0 in stage 1.0 (TID 2) 2020-02-14 14:25:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:33554432+33554432 2020-02-14 14:25:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:25:07 TaskSetManager: INFO: Finished task 0.0 in stage 1.0 (TID 1) in 10784 ms on localhost (executor driver) (1/882) 2020-02-14 14:25:38 Executor: INFO: Finished task 1.0 in stage 1.0 (TID 2). 1888 bytes result sent to driver 2020-02-14 14:25:38 TaskSetManager: INFO: Starting task 2.0 in stage 1.0 (TID 3, localhost, executor driver, partition 2, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:25:38 Executor: INFO: Running task 2.0 in stage 1.0 (TID 3) 2020-02-14 14:25:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:67108864+33554432 2020-02-14 14:25:38 TaskSetManager: INFO: Finished task 1.0 in stage 1.0 (TID 2) in 31260 ms on localhost (executor driver) (2/882) 2020-02-14 14:25:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:26:19 Executor: INFO: Finished task 2.0 in stage 1.0 (TID 3). 1581 bytes result sent to driver 2020-02-14 14:26:19 TaskSetManager: INFO: Starting task 3.0 in stage 1.0 (TID 4, localhost, executor driver, partition 3, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:26:19 Executor: INFO: Running task 3.0 in stage 1.0 (TID 4) 2020-02-14 14:26:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:100663296+33554432 2020-02-14 14:26:19 TaskSetManager: INFO: Finished task 2.0 in stage 1.0 (TID 3) in 41207 ms on localhost (executor driver) (3/882) 2020-02-14 14:26:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:26:58 Executor: INFO: Finished task 3.0 in stage 1.0 (TID 4). 1764 bytes result sent to driver 2020-02-14 14:26:58 TaskSetManager: INFO: Starting task 4.0 in stage 1.0 (TID 5, localhost, executor driver, partition 4, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:26:58 TaskSetManager: INFO: Finished task 3.0 in stage 1.0 (TID 4) in 38519 ms on localhost (executor driver) (4/882) 2020-02-14 14:26:58 Executor: INFO: Running task 4.0 in stage 1.0 (TID 5) 2020-02-14 14:26:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:134217728+33554432 2020-02-14 14:26:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:27:36 Executor: INFO: Finished task 4.0 in stage 1.0 (TID 5). 1710 bytes result sent to driver 2020-02-14 14:27:36 TaskSetManager: INFO: Starting task 5.0 in stage 1.0 (TID 6, localhost, executor driver, partition 5, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:27:36 TaskSetManager: INFO: Finished task 4.0 in stage 1.0 (TID 5) in 37723 ms on localhost (executor driver) (5/882) 2020-02-14 14:27:36 Executor: INFO: Running task 5.0 in stage 1.0 (TID 6) 2020-02-14 14:27:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:167772160+33554432 2020-02-14 14:27:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:28:19 Executor: INFO: Finished task 5.0 in stage 1.0 (TID 6). 1608 bytes result sent to driver 2020-02-14 14:28:19 TaskSetManager: INFO: Starting task 6.0 in stage 1.0 (TID 7, localhost, executor driver, partition 6, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:28:19 TaskSetManager: INFO: Finished task 5.0 in stage 1.0 (TID 6) in 43087 ms on localhost (executor driver) (6/882) 2020-02-14 14:28:19 Executor: INFO: Running task 6.0 in stage 1.0 (TID 7) 2020-02-14 14:28:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:201326592+33554432 2020-02-14 14:28:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:29:00 Executor: INFO: Finished task 6.0 in stage 1.0 (TID 7). 1644 bytes result sent to driver 2020-02-14 14:29:00 TaskSetManager: INFO: Starting task 7.0 in stage 1.0 (TID 8, localhost, executor driver, partition 7, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:29:00 TaskSetManager: INFO: Finished task 6.0 in stage 1.0 (TID 7) in 41282 ms on localhost (executor driver) (7/882) 2020-02-14 14:29:00 Executor: INFO: Running task 7.0 in stage 1.0 (TID 8) 2020-02-14 14:29:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:234881024+33554432 2020-02-14 14:29:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:29:29 Executor: INFO: Finished task 7.0 in stage 1.0 (TID 8). 1612 bytes result sent to driver 2020-02-14 14:29:29 TaskSetManager: INFO: Starting task 8.0 in stage 1.0 (TID 9, localhost, executor driver, partition 8, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:29:29 TaskSetManager: INFO: Finished task 7.0 in stage 1.0 (TID 8) in 29480 ms on localhost (executor driver) (8/882) 2020-02-14 14:29:29 Executor: INFO: Running task 8.0 in stage 1.0 (TID 9) 2020-02-14 14:29:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:268435456+33554432 2020-02-14 14:29:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:30:07 Executor: INFO: Finished task 8.0 in stage 1.0 (TID 9). 1645 bytes result sent to driver 2020-02-14 14:30:07 TaskSetManager: INFO: Starting task 9.0 in stage 1.0 (TID 10, localhost, executor driver, partition 9, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:30:07 TaskSetManager: INFO: Finished task 8.0 in stage 1.0 (TID 9) in 37093 ms on localhost (executor driver) (9/882) 2020-02-14 14:30:07 Executor: INFO: Running task 9.0 in stage 1.0 (TID 10) 2020-02-14 14:30:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:301989888+33554432 2020-02-14 14:30:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:30:39 Executor: INFO: Finished task 9.0 in stage 1.0 (TID 10). 1602 bytes result sent to driver 2020-02-14 14:30:39 TaskSetManager: INFO: Starting task 10.0 in stage 1.0 (TID 11, localhost, executor driver, partition 10, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:30:39 TaskSetManager: INFO: Finished task 9.0 in stage 1.0 (TID 10) in 32043 ms on localhost (executor driver) (10/882) 2020-02-14 14:30:39 Executor: INFO: Running task 10.0 in stage 1.0 (TID 11) 2020-02-14 14:30:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:335544320+33554432 2020-02-14 14:30:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:31:19 Executor: INFO: Finished task 10.0 in stage 1.0 (TID 11). 1665 bytes result sent to driver 2020-02-14 14:31:19 TaskSetManager: INFO: Starting task 11.0 in stage 1.0 (TID 12, localhost, executor driver, partition 11, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:31:19 TaskSetManager: INFO: Finished task 10.0 in stage 1.0 (TID 11) in 40564 ms on localhost (executor driver) (11/882) 2020-02-14 14:31:19 Executor: INFO: Running task 11.0 in stage 1.0 (TID 12) 2020-02-14 14:31:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:369098752+33554432 2020-02-14 14:31:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:32:01 Executor: INFO: Finished task 11.0 in stage 1.0 (TID 12). 1649 bytes result sent to driver 2020-02-14 14:32:01 TaskSetManager: INFO: Starting task 12.0 in stage 1.0 (TID 13, localhost, executor driver, partition 12, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:32:01 TaskSetManager: INFO: Finished task 11.0 in stage 1.0 (TID 12) in 41899 ms on localhost (executor driver) (12/882) 2020-02-14 14:32:01 Executor: INFO: Running task 12.0 in stage 1.0 (TID 13) 2020-02-14 14:32:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:402653184+33554432 2020-02-14 14:32:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:32:56 Executor: INFO: Finished task 12.0 in stage 1.0 (TID 13). 1687 bytes result sent to driver 2020-02-14 14:32:56 TaskSetManager: INFO: Starting task 13.0 in stage 1.0 (TID 14, localhost, executor driver, partition 13, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:32:56 TaskSetManager: INFO: Finished task 12.0 in stage 1.0 (TID 13) in 54920 ms on localhost (executor driver) (13/882) 2020-02-14 14:32:56 Executor: INFO: Running task 13.0 in stage 1.0 (TID 14) 2020-02-14 14:32:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:436207616+33554432 2020-02-14 14:32:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:33:47 Executor: INFO: Finished task 13.0 in stage 1.0 (TID 14). 1675 bytes result sent to driver 2020-02-14 14:33:47 TaskSetManager: INFO: Starting task 14.0 in stage 1.0 (TID 15, localhost, executor driver, partition 14, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:33:47 TaskSetManager: INFO: Finished task 13.0 in stage 1.0 (TID 14) in 51224 ms on localhost (executor driver) (14/882) 2020-02-14 14:33:47 Executor: INFO: Running task 14.0 in stage 1.0 (TID 15) 2020-02-14 14:33:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:469762048+33554432 2020-02-14 14:33:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:33:54 Executor: INFO: Finished task 14.0 in stage 1.0 (TID 15). 1933 bytes result sent to driver 2020-02-14 14:33:54 TaskSetManager: INFO: Starting task 15.0 in stage 1.0 (TID 16, localhost, executor driver, partition 15, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:33:54 TaskSetManager: INFO: Finished task 14.0 in stage 1.0 (TID 15) in 6509 ms on localhost (executor driver) (15/882) 2020-02-14 14:33:54 Executor: INFO: Running task 15.0 in stage 1.0 (TID 16) 2020-02-14 14:33:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:503316480+33554432 2020-02-14 14:33:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:34:01 Executor: INFO: Finished task 15.0 in stage 1.0 (TID 16). 2350 bytes result sent to driver 2020-02-14 14:34:01 TaskSetManager: INFO: Starting task 16.0 in stage 1.0 (TID 17, localhost, executor driver, partition 16, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:34:01 TaskSetManager: INFO: Finished task 15.0 in stage 1.0 (TID 16) in 7161 ms on localhost (executor driver) (16/882) 2020-02-14 14:34:01 Executor: INFO: Running task 16.0 in stage 1.0 (TID 17) 2020-02-14 14:34:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:536870912+33554432 2020-02-14 14:34:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:34:08 Executor: INFO: Finished task 16.0 in stage 1.0 (TID 17). 2352 bytes result sent to driver 2020-02-14 14:34:08 TaskSetManager: INFO: Starting task 17.0 in stage 1.0 (TID 18, localhost, executor driver, partition 17, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:34:08 TaskSetManager: INFO: Finished task 16.0 in stage 1.0 (TID 17) in 6685 ms on localhost (executor driver) (17/882) 2020-02-14 14:34:08 Executor: INFO: Running task 17.0 in stage 1.0 (TID 18) 2020-02-14 14:34:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:570425344+33554432 2020-02-14 14:34:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:34:14 Executor: INFO: Finished task 17.0 in stage 1.0 (TID 18). 1964 bytes result sent to driver 2020-02-14 14:34:14 TaskSetManager: INFO: Starting task 18.0 in stage 1.0 (TID 19, localhost, executor driver, partition 18, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:34:14 TaskSetManager: INFO: Finished task 17.0 in stage 1.0 (TID 18) in 6677 ms on localhost (executor driver) (18/882) 2020-02-14 14:34:14 Executor: INFO: Running task 18.0 in stage 1.0 (TID 19) 2020-02-14 14:34:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:603979776+33554432 2020-02-14 14:34:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:34:21 Executor: INFO: Finished task 18.0 in stage 1.0 (TID 19). 2189 bytes result sent to driver 2020-02-14 14:34:21 TaskSetManager: INFO: Starting task 19.0 in stage 1.0 (TID 20, localhost, executor driver, partition 19, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:34:21 TaskSetManager: INFO: Finished task 18.0 in stage 1.0 (TID 19) in 6634 ms on localhost (executor driver) (19/882) 2020-02-14 14:34:21 Executor: INFO: Running task 19.0 in stage 1.0 (TID 20) 2020-02-14 14:34:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:637534208+33554432 2020-02-14 14:34:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:35:02 Executor: INFO: Finished task 19.0 in stage 1.0 (TID 20). 1657 bytes result sent to driver 2020-02-14 14:35:02 TaskSetManager: INFO: Starting task 20.0 in stage 1.0 (TID 21, localhost, executor driver, partition 20, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:35:02 TaskSetManager: INFO: Finished task 19.0 in stage 1.0 (TID 20) in 41023 ms on localhost (executor driver) (20/882) 2020-02-14 14:35:02 Executor: INFO: Running task 20.0 in stage 1.0 (TID 21) 2020-02-14 14:35:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:671088640+33554432 2020-02-14 14:35:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:35:50 Executor: INFO: Finished task 20.0 in stage 1.0 (TID 21). 1652 bytes result sent to driver 2020-02-14 14:35:50 TaskSetManager: INFO: Starting task 21.0 in stage 1.0 (TID 22, localhost, executor driver, partition 21, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:35:50 TaskSetManager: INFO: Finished task 20.0 in stage 1.0 (TID 21) in 48144 ms on localhost (executor driver) (21/882) 2020-02-14 14:35:50 Executor: INFO: Running task 21.0 in stage 1.0 (TID 22) 2020-02-14 14:35:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:704643072+33554432 2020-02-14 14:35:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:36:21 Executor: INFO: Finished task 21.0 in stage 1.0 (TID 22). 1772 bytes result sent to driver 2020-02-14 14:36:21 TaskSetManager: INFO: Starting task 22.0 in stage 1.0 (TID 23, localhost, executor driver, partition 22, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:36:21 TaskSetManager: INFO: Finished task 21.0 in stage 1.0 (TID 22) in 31231 ms on localhost (executor driver) (22/882) 2020-02-14 14:36:21 Executor: INFO: Running task 22.0 in stage 1.0 (TID 23) 2020-02-14 14:36:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:738197504+33554432 2020-02-14 14:36:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:37:07 Executor: INFO: Finished task 22.0 in stage 1.0 (TID 23). 1978 bytes result sent to driver 2020-02-14 14:37:07 TaskSetManager: INFO: Starting task 23.0 in stage 1.0 (TID 24, localhost, executor driver, partition 23, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:37:07 TaskSetManager: INFO: Finished task 22.0 in stage 1.0 (TID 23) in 45964 ms on localhost (executor driver) (23/882) 2020-02-14 14:37:07 Executor: INFO: Running task 23.0 in stage 1.0 (TID 24) 2020-02-14 14:37:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:771751936+33554432 2020-02-14 14:37:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:37:56 Executor: INFO: Finished task 23.0 in stage 1.0 (TID 24). 1645 bytes result sent to driver 2020-02-14 14:37:56 TaskSetManager: INFO: Starting task 24.0 in stage 1.0 (TID 25, localhost, executor driver, partition 24, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:37:56 TaskSetManager: INFO: Finished task 23.0 in stage 1.0 (TID 24) in 49073 ms on localhost (executor driver) (24/882) 2020-02-14 14:37:56 Executor: INFO: Running task 24.0 in stage 1.0 (TID 25) 2020-02-14 14:37:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:805306368+33554432 2020-02-14 14:37:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:38:36 Executor: INFO: Finished task 24.0 in stage 1.0 (TID 25). 1601 bytes result sent to driver 2020-02-14 14:38:36 TaskSetManager: INFO: Starting task 25.0 in stage 1.0 (TID 26, localhost, executor driver, partition 25, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:38:36 TaskSetManager: INFO: Finished task 24.0 in stage 1.0 (TID 25) in 40036 ms on localhost (executor driver) (25/882) 2020-02-14 14:38:36 Executor: INFO: Running task 25.0 in stage 1.0 (TID 26) 2020-02-14 14:38:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:838860800+33554432 2020-02-14 14:38:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:39:32 Executor: INFO: Finished task 25.0 in stage 1.0 (TID 26). 1716 bytes result sent to driver 2020-02-14 14:39:32 TaskSetManager: INFO: Starting task 26.0 in stage 1.0 (TID 27, localhost, executor driver, partition 26, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:39:32 TaskSetManager: INFO: Finished task 25.0 in stage 1.0 (TID 26) in 55590 ms on localhost (executor driver) (26/882) 2020-02-14 14:39:32 Executor: INFO: Running task 26.0 in stage 1.0 (TID 27) 2020-02-14 14:39:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:872415232+33554432 2020-02-14 14:39:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:40:18 Executor: INFO: Finished task 26.0 in stage 1.0 (TID 27). 1617 bytes result sent to driver 2020-02-14 14:40:18 TaskSetManager: INFO: Starting task 27.0 in stage 1.0 (TID 28, localhost, executor driver, partition 27, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:40:18 TaskSetManager: INFO: Finished task 26.0 in stage 1.0 (TID 27) in 45709 ms on localhost (executor driver) (27/882) 2020-02-14 14:40:18 Executor: INFO: Running task 27.0 in stage 1.0 (TID 28) 2020-02-14 14:40:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:905969664+33554432 2020-02-14 14:40:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:41:10 Executor: INFO: Finished task 27.0 in stage 1.0 (TID 28). 1676 bytes result sent to driver 2020-02-14 14:41:10 TaskSetManager: INFO: Starting task 28.0 in stage 1.0 (TID 29, localhost, executor driver, partition 28, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:41:10 TaskSetManager: INFO: Finished task 27.0 in stage 1.0 (TID 28) in 52028 ms on localhost (executor driver) (28/882) 2020-02-14 14:41:10 Executor: INFO: Running task 28.0 in stage 1.0 (TID 29) 2020-02-14 14:41:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:939524096+33554432 2020-02-14 14:41:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:42:08 Executor: INFO: Finished task 28.0 in stage 1.0 (TID 29). 1677 bytes result sent to driver 2020-02-14 14:42:08 TaskSetManager: INFO: Starting task 29.0 in stage 1.0 (TID 30, localhost, executor driver, partition 29, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:42:08 TaskSetManager: INFO: Finished task 28.0 in stage 1.0 (TID 29) in 58185 ms on localhost (executor driver) (29/882) 2020-02-14 14:42:08 Executor: INFO: Running task 29.0 in stage 1.0 (TID 30) 2020-02-14 14:42:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:973078528+33554432 2020-02-14 14:42:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:43:03 Executor: INFO: Finished task 29.0 in stage 1.0 (TID 30). 1681 bytes result sent to driver 2020-02-14 14:43:03 TaskSetManager: INFO: Starting task 30.0 in stage 1.0 (TID 31, localhost, executor driver, partition 30, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:43:03 TaskSetManager: INFO: Finished task 29.0 in stage 1.0 (TID 30) in 54957 ms on localhost (executor driver) (30/882) 2020-02-14 14:43:03 Executor: INFO: Running task 30.0 in stage 1.0 (TID 31) 2020-02-14 14:43:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1006632960+33554432 2020-02-14 14:43:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:44:03 Executor: INFO: Finished task 30.0 in stage 1.0 (TID 31). 1675 bytes result sent to driver 2020-02-14 14:44:03 TaskSetManager: INFO: Starting task 31.0 in stage 1.0 (TID 32, localhost, executor driver, partition 31, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:44:03 TaskSetManager: INFO: Finished task 30.0 in stage 1.0 (TID 31) in 59965 ms on localhost (executor driver) (31/882) 2020-02-14 14:44:03 Executor: INFO: Running task 31.0 in stage 1.0 (TID 32) 2020-02-14 14:44:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1040187392+33554432 2020-02-14 14:44:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:45:05 Executor: INFO: Finished task 31.0 in stage 1.0 (TID 32). 1601 bytes result sent to driver 2020-02-14 14:45:05 TaskSetManager: INFO: Starting task 32.0 in stage 1.0 (TID 33, localhost, executor driver, partition 32, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:45:05 TaskSetManager: INFO: Finished task 31.0 in stage 1.0 (TID 32) in 62483 ms on localhost (executor driver) (32/882) 2020-02-14 14:45:05 Executor: INFO: Running task 32.0 in stage 1.0 (TID 33) 2020-02-14 14:45:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1073741824+33554432 2020-02-14 14:45:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:46:07 Executor: INFO: Finished task 32.0 in stage 1.0 (TID 33). 1654 bytes result sent to driver 2020-02-14 14:46:07 TaskSetManager: INFO: Starting task 33.0 in stage 1.0 (TID 34, localhost, executor driver, partition 33, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:46:07 TaskSetManager: INFO: Finished task 32.0 in stage 1.0 (TID 33) in 61429 ms on localhost (executor driver) (33/882) 2020-02-14 14:46:07 Executor: INFO: Running task 33.0 in stage 1.0 (TID 34) 2020-02-14 14:46:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1107296256+33554432 2020-02-14 14:46:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:46:39 Executor: INFO: Finished task 33.0 in stage 1.0 (TID 34). 1667 bytes result sent to driver 2020-02-14 14:46:39 TaskSetManager: INFO: Starting task 34.0 in stage 1.0 (TID 35, localhost, executor driver, partition 34, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:46:39 TaskSetManager: INFO: Finished task 33.0 in stage 1.0 (TID 34) in 32420 ms on localhost (executor driver) (34/882) 2020-02-14 14:46:39 Executor: INFO: Running task 34.0 in stage 1.0 (TID 35) 2020-02-14 14:46:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1140850688+33554432 2020-02-14 14:46:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:47:23 Executor: INFO: Finished task 34.0 in stage 1.0 (TID 35). 1764 bytes result sent to driver 2020-02-14 14:47:23 TaskSetManager: INFO: Starting task 35.0 in stage 1.0 (TID 36, localhost, executor driver, partition 35, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:47:23 TaskSetManager: INFO: Finished task 34.0 in stage 1.0 (TID 35) in 43464 ms on localhost (executor driver) (35/882) 2020-02-14 14:47:23 Executor: INFO: Running task 35.0 in stage 1.0 (TID 36) 2020-02-14 14:47:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1174405120+33554432 2020-02-14 14:47:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:48:00 Executor: INFO: Finished task 35.0 in stage 1.0 (TID 36). 1679 bytes result sent to driver 2020-02-14 14:48:00 TaskSetManager: INFO: Starting task 36.0 in stage 1.0 (TID 37, localhost, executor driver, partition 36, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:48:00 TaskSetManager: INFO: Finished task 35.0 in stage 1.0 (TID 36) in 37760 ms on localhost (executor driver) (36/882) 2020-02-14 14:48:00 Executor: INFO: Running task 36.0 in stage 1.0 (TID 37) 2020-02-14 14:48:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1207959552+33554432 2020-02-14 14:48:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:48:48 Executor: INFO: Finished task 36.0 in stage 1.0 (TID 37). 1638 bytes result sent to driver 2020-02-14 14:48:48 TaskSetManager: INFO: Starting task 37.0 in stage 1.0 (TID 38, localhost, executor driver, partition 37, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:48:48 TaskSetManager: INFO: Finished task 36.0 in stage 1.0 (TID 37) in 48071 ms on localhost (executor driver) (37/882) 2020-02-14 14:48:48 Executor: INFO: Running task 37.0 in stage 1.0 (TID 38) 2020-02-14 14:48:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1241513984+33554432 2020-02-14 14:48:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:49:37 Executor: INFO: Finished task 37.0 in stage 1.0 (TID 38). 1601 bytes result sent to driver 2020-02-14 14:49:37 TaskSetManager: INFO: Starting task 38.0 in stage 1.0 (TID 39, localhost, executor driver, partition 38, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:49:37 TaskSetManager: INFO: Finished task 37.0 in stage 1.0 (TID 38) in 48355 ms on localhost (executor driver) (38/882) 2020-02-14 14:49:37 Executor: INFO: Running task 38.0 in stage 1.0 (TID 39) 2020-02-14 14:49:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1275068416+33554432 2020-02-14 14:49:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:50:23 Executor: INFO: Finished task 38.0 in stage 1.0 (TID 39). 1638 bytes result sent to driver 2020-02-14 14:50:23 TaskSetManager: INFO: Starting task 39.0 in stage 1.0 (TID 40, localhost, executor driver, partition 39, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:50:23 TaskSetManager: INFO: Finished task 38.0 in stage 1.0 (TID 39) in 46761 ms on localhost (executor driver) (39/882) 2020-02-14 14:50:24 Executor: INFO: Running task 39.0 in stage 1.0 (TID 40) 2020-02-14 14:50:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1308622848+33554432 2020-02-14 14:50:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:51:05 Executor: INFO: Finished task 39.0 in stage 1.0 (TID 40). 2788 bytes result sent to driver 2020-02-14 14:51:05 TaskSetManager: INFO: Starting task 40.0 in stage 1.0 (TID 41, localhost, executor driver, partition 40, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:51:05 TaskSetManager: INFO: Finished task 39.0 in stage 1.0 (TID 40) in 41816 ms on localhost (executor driver) (40/882) 2020-02-14 14:51:05 Executor: INFO: Running task 40.0 in stage 1.0 (TID 41) 2020-02-14 14:51:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1342177280+33554432 2020-02-14 14:51:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:52:01 Executor: INFO: Finished task 40.0 in stage 1.0 (TID 41). 1603 bytes result sent to driver 2020-02-14 14:52:01 TaskSetManager: INFO: Starting task 41.0 in stage 1.0 (TID 42, localhost, executor driver, partition 41, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:52:01 TaskSetManager: INFO: Finished task 40.0 in stage 1.0 (TID 41) in 55521 ms on localhost (executor driver) (41/882) 2020-02-14 14:52:01 Executor: INFO: Running task 41.0 in stage 1.0 (TID 42) 2020-02-14 14:52:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1375731712+33554432 2020-02-14 14:52:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:52:59 Executor: INFO: Finished task 41.0 in stage 1.0 (TID 42). 1659 bytes result sent to driver 2020-02-14 14:52:59 TaskSetManager: INFO: Starting task 42.0 in stage 1.0 (TID 43, localhost, executor driver, partition 42, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:52:59 TaskSetManager: INFO: Finished task 41.0 in stage 1.0 (TID 42) in 58230 ms on localhost (executor driver) (42/882) 2020-02-14 14:52:59 Executor: INFO: Running task 42.0 in stage 1.0 (TID 43) 2020-02-14 14:52:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1409286144+33554432 2020-02-14 14:52:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:53:53 Executor: INFO: Finished task 42.0 in stage 1.0 (TID 43). 1643 bytes result sent to driver 2020-02-14 14:53:53 TaskSetManager: INFO: Starting task 43.0 in stage 1.0 (TID 44, localhost, executor driver, partition 43, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:53:53 TaskSetManager: INFO: Finished task 42.0 in stage 1.0 (TID 43) in 53890 ms on localhost (executor driver) (43/882) 2020-02-14 14:53:53 Executor: INFO: Running task 43.0 in stage 1.0 (TID 44) 2020-02-14 14:53:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1442840576+33554432 2020-02-14 14:53:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:54:39 Executor: INFO: Finished task 43.0 in stage 1.0 (TID 44). 1603 bytes result sent to driver 2020-02-14 14:54:39 TaskSetManager: INFO: Starting task 44.0 in stage 1.0 (TID 45, localhost, executor driver, partition 44, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:54:39 TaskSetManager: INFO: Finished task 43.0 in stage 1.0 (TID 44) in 45629 ms on localhost (executor driver) (44/882) 2020-02-14 14:54:39 Executor: INFO: Running task 44.0 in stage 1.0 (TID 45) 2020-02-14 14:54:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1476395008+33554432 2020-02-14 14:54:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:55:13 Executor: INFO: Finished task 44.0 in stage 1.0 (TID 45). 1811 bytes result sent to driver 2020-02-14 14:55:13 TaskSetManager: INFO: Starting task 45.0 in stage 1.0 (TID 46, localhost, executor driver, partition 45, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:55:13 TaskSetManager: INFO: Finished task 44.0 in stage 1.0 (TID 45) in 34270 ms on localhost (executor driver) (45/882) 2020-02-14 14:55:13 Executor: INFO: Running task 45.0 in stage 1.0 (TID 46) 2020-02-14 14:55:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1509949440+33554432 2020-02-14 14:55:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:55:55 Executor: INFO: Finished task 45.0 in stage 1.0 (TID 46). 1602 bytes result sent to driver 2020-02-14 14:55:55 TaskSetManager: INFO: Starting task 46.0 in stage 1.0 (TID 47, localhost, executor driver, partition 46, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:55:55 TaskSetManager: INFO: Finished task 45.0 in stage 1.0 (TID 46) in 42537 ms on localhost (executor driver) (46/882) 2020-02-14 14:55:55 Executor: INFO: Running task 46.0 in stage 1.0 (TID 47) 2020-02-14 14:55:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1543503872+33554432 2020-02-14 14:55:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:56:40 Executor: INFO: Finished task 46.0 in stage 1.0 (TID 47). 1684 bytes result sent to driver 2020-02-14 14:56:40 TaskSetManager: INFO: Starting task 47.0 in stage 1.0 (TID 48, localhost, executor driver, partition 47, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:56:40 TaskSetManager: INFO: Finished task 46.0 in stage 1.0 (TID 47) in 44701 ms on localhost (executor driver) (47/882) 2020-02-14 14:56:40 Executor: INFO: Running task 47.0 in stage 1.0 (TID 48) 2020-02-14 14:56:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1577058304+33554432 2020-02-14 14:56:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:57:27 Executor: INFO: Finished task 47.0 in stage 1.0 (TID 48). 1650 bytes result sent to driver 2020-02-14 14:57:27 TaskSetManager: INFO: Starting task 48.0 in stage 1.0 (TID 49, localhost, executor driver, partition 48, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:57:27 TaskSetManager: INFO: Finished task 47.0 in stage 1.0 (TID 48) in 46492 ms on localhost (executor driver) (48/882) 2020-02-14 14:57:27 Executor: INFO: Running task 48.0 in stage 1.0 (TID 49) 2020-02-14 14:57:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1610612736+33554432 2020-02-14 14:57:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:58:16 Executor: INFO: Finished task 48.0 in stage 1.0 (TID 49). 1612 bytes result sent to driver 2020-02-14 14:58:16 TaskSetManager: INFO: Starting task 49.0 in stage 1.0 (TID 50, localhost, executor driver, partition 49, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:58:16 TaskSetManager: INFO: Finished task 48.0 in stage 1.0 (TID 49) in 48940 ms on localhost (executor driver) (49/882) 2020-02-14 14:58:16 Executor: INFO: Running task 49.0 in stage 1.0 (TID 50) 2020-02-14 14:58:16 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1644167168+33554432 2020-02-14 14:58:16 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:58:56 Executor: INFO: Finished task 49.0 in stage 1.0 (TID 50). 1602 bytes result sent to driver 2020-02-14 14:58:56 TaskSetManager: INFO: Starting task 50.0 in stage 1.0 (TID 51, localhost, executor driver, partition 50, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:58:56 TaskSetManager: INFO: Finished task 49.0 in stage 1.0 (TID 50) in 40033 ms on localhost (executor driver) (50/882) 2020-02-14 14:58:56 Executor: INFO: Running task 50.0 in stage 1.0 (TID 51) 2020-02-14 14:58:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1677721600+33554432 2020-02-14 14:58:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 14:59:48 Executor: INFO: Finished task 50.0 in stage 1.0 (TID 51). 1610 bytes result sent to driver 2020-02-14 14:59:48 TaskSetManager: INFO: Starting task 51.0 in stage 1.0 (TID 52, localhost, executor driver, partition 51, PROCESS_LOCAL, 7933 bytes) 2020-02-14 14:59:48 TaskSetManager: INFO: Finished task 50.0 in stage 1.0 (TID 51) in 52255 ms on localhost (executor driver) (51/882) 2020-02-14 14:59:48 Executor: INFO: Running task 51.0 in stage 1.0 (TID 52) 2020-02-14 14:59:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1711276032+33554432 2020-02-14 14:59:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:00:30 Executor: INFO: Finished task 51.0 in stage 1.0 (TID 52). 1601 bytes result sent to driver 2020-02-14 15:00:30 TaskSetManager: INFO: Starting task 52.0 in stage 1.0 (TID 53, localhost, executor driver, partition 52, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:00:30 TaskSetManager: INFO: Finished task 51.0 in stage 1.0 (TID 52) in 41916 ms on localhost (executor driver) (52/882) 2020-02-14 15:00:30 Executor: INFO: Running task 52.0 in stage 1.0 (TID 53) 2020-02-14 15:00:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1744830464+33554432 2020-02-14 15:00:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:01:17 Executor: INFO: Finished task 52.0 in stage 1.0 (TID 53). 1601 bytes result sent to driver 2020-02-14 15:01:17 TaskSetManager: INFO: Starting task 53.0 in stage 1.0 (TID 54, localhost, executor driver, partition 53, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:01:17 TaskSetManager: INFO: Finished task 52.0 in stage 1.0 (TID 53) in 47771 ms on localhost (executor driver) (53/882) 2020-02-14 15:01:17 Executor: INFO: Running task 53.0 in stage 1.0 (TID 54) 2020-02-14 15:01:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1778384896+33554432 2020-02-14 15:01:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:01:59 Executor: INFO: Finished task 53.0 in stage 1.0 (TID 54). 1601 bytes result sent to driver 2020-02-14 15:01:59 TaskSetManager: INFO: Starting task 54.0 in stage 1.0 (TID 55, localhost, executor driver, partition 54, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:01:59 TaskSetManager: INFO: Finished task 53.0 in stage 1.0 (TID 54) in 41666 ms on localhost (executor driver) (54/882) 2020-02-14 15:01:59 Executor: INFO: Running task 54.0 in stage 1.0 (TID 55) 2020-02-14 15:01:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1811939328+33554432 2020-02-14 15:01:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:02:45 Executor: INFO: Finished task 54.0 in stage 1.0 (TID 55). 1648 bytes result sent to driver 2020-02-14 15:02:45 TaskSetManager: INFO: Starting task 55.0 in stage 1.0 (TID 56, localhost, executor driver, partition 55, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:02:45 TaskSetManager: INFO: Finished task 54.0 in stage 1.0 (TID 55) in 45976 ms on localhost (executor driver) (55/882) 2020-02-14 15:02:45 Executor: INFO: Running task 55.0 in stage 1.0 (TID 56) 2020-02-14 15:02:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1845493760+33554432 2020-02-14 15:02:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:03:28 Executor: INFO: Finished task 55.0 in stage 1.0 (TID 56). 1601 bytes result sent to driver 2020-02-14 15:03:28 TaskSetManager: INFO: Starting task 56.0 in stage 1.0 (TID 57, localhost, executor driver, partition 56, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:03:28 TaskSetManager: INFO: Finished task 55.0 in stage 1.0 (TID 56) in 42729 ms on localhost (executor driver) (56/882) 2020-02-14 15:03:28 Executor: INFO: Running task 56.0 in stage 1.0 (TID 57) 2020-02-14 15:03:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1879048192+33554432 2020-02-14 15:03:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:04:09 Executor: INFO: Finished task 56.0 in stage 1.0 (TID 57). 1606 bytes result sent to driver 2020-02-14 15:04:09 TaskSetManager: INFO: Starting task 57.0 in stage 1.0 (TID 58, localhost, executor driver, partition 57, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:04:09 TaskSetManager: INFO: Finished task 56.0 in stage 1.0 (TID 57) in 41579 ms on localhost (executor driver) (57/882) 2020-02-14 15:04:09 Executor: INFO: Running task 57.0 in stage 1.0 (TID 58) 2020-02-14 15:04:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1912602624+33554432 2020-02-14 15:04:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:05:05 Executor: INFO: Finished task 57.0 in stage 1.0 (TID 58). 1602 bytes result sent to driver 2020-02-14 15:05:05 TaskSetManager: INFO: Starting task 58.0 in stage 1.0 (TID 59, localhost, executor driver, partition 58, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:05:05 TaskSetManager: INFO: Finished task 57.0 in stage 1.0 (TID 58) in 55913 ms on localhost (executor driver) (58/882) 2020-02-14 15:05:05 Executor: INFO: Running task 58.0 in stage 1.0 (TID 59) 2020-02-14 15:05:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1946157056+33554432 2020-02-14 15:05:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:05:52 Executor: INFO: Finished task 58.0 in stage 1.0 (TID 59). 1645 bytes result sent to driver 2020-02-14 15:05:52 TaskSetManager: INFO: Starting task 59.0 in stage 1.0 (TID 60, localhost, executor driver, partition 59, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:05:52 TaskSetManager: INFO: Finished task 58.0 in stage 1.0 (TID 59) in 47113 ms on localhost (executor driver) (59/882) 2020-02-14 15:05:52 Executor: INFO: Running task 59.0 in stage 1.0 (TID 60) 2020-02-14 15:05:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1979711488+33554432 2020-02-14 15:05:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:06:39 Executor: INFO: Finished task 59.0 in stage 1.0 (TID 60). 1644 bytes result sent to driver 2020-02-14 15:06:39 TaskSetManager: INFO: Starting task 60.0 in stage 1.0 (TID 61, localhost, executor driver, partition 60, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:06:39 TaskSetManager: INFO: Finished task 59.0 in stage 1.0 (TID 60) in 46339 ms on localhost (executor driver) (60/882) 2020-02-14 15:06:39 Executor: INFO: Running task 60.0 in stage 1.0 (TID 61) 2020-02-14 15:06:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2013265920+33554432 2020-02-14 15:06:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:07:33 Executor: INFO: Finished task 60.0 in stage 1.0 (TID 61). 1642 bytes result sent to driver 2020-02-14 15:07:33 TaskSetManager: INFO: Starting task 61.0 in stage 1.0 (TID 62, localhost, executor driver, partition 61, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:07:33 TaskSetManager: INFO: Finished task 60.0 in stage 1.0 (TID 61) in 54323 ms on localhost (executor driver) (61/882) 2020-02-14 15:07:33 Executor: INFO: Running task 61.0 in stage 1.0 (TID 62) 2020-02-14 15:07:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2046820352+33554432 2020-02-14 15:07:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:08:25 Executor: INFO: Finished task 61.0 in stage 1.0 (TID 62). 1644 bytes result sent to driver 2020-02-14 15:08:25 TaskSetManager: INFO: Starting task 62.0 in stage 1.0 (TID 63, localhost, executor driver, partition 62, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:08:25 TaskSetManager: INFO: Finished task 61.0 in stage 1.0 (TID 62) in 51819 ms on localhost (executor driver) (62/882) 2020-02-14 15:08:25 Executor: INFO: Running task 62.0 in stage 1.0 (TID 63) 2020-02-14 15:08:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2080374784+33554432 2020-02-14 15:08:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:09:13 Executor: INFO: Finished task 62.0 in stage 1.0 (TID 63). 1601 bytes result sent to driver 2020-02-14 15:09:13 TaskSetManager: INFO: Starting task 63.0 in stage 1.0 (TID 64, localhost, executor driver, partition 63, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:09:13 TaskSetManager: INFO: Finished task 62.0 in stage 1.0 (TID 63) in 48046 ms on localhost (executor driver) (63/882) 2020-02-14 15:09:13 Executor: INFO: Running task 63.0 in stage 1.0 (TID 64) 2020-02-14 15:09:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2113929216+33554432 2020-02-14 15:09:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:10:01 Executor: INFO: Finished task 63.0 in stage 1.0 (TID 64). 1604 bytes result sent to driver 2020-02-14 15:10:01 TaskSetManager: INFO: Starting task 64.0 in stage 1.0 (TID 65, localhost, executor driver, partition 64, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:10:01 TaskSetManager: INFO: Finished task 63.0 in stage 1.0 (TID 64) in 48484 ms on localhost (executor driver) (64/882) 2020-02-14 15:10:01 Executor: INFO: Running task 64.0 in stage 1.0 (TID 65) 2020-02-14 15:10:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2147483648+33554432 2020-02-14 15:10:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:11:00 Executor: INFO: Finished task 64.0 in stage 1.0 (TID 65). 1654 bytes result sent to driver 2020-02-14 15:11:00 TaskSetManager: INFO: Starting task 65.0 in stage 1.0 (TID 66, localhost, executor driver, partition 65, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:11:00 TaskSetManager: INFO: Finished task 64.0 in stage 1.0 (TID 65) in 58693 ms on localhost (executor driver) (65/882) 2020-02-14 15:11:00 Executor: INFO: Running task 65.0 in stage 1.0 (TID 66) 2020-02-14 15:11:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2181038080+33554432 2020-02-14 15:11:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:11:56 Executor: INFO: Finished task 65.0 in stage 1.0 (TID 66). 1645 bytes result sent to driver 2020-02-14 15:11:56 TaskSetManager: INFO: Starting task 66.0 in stage 1.0 (TID 67, localhost, executor driver, partition 66, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:11:56 TaskSetManager: INFO: Finished task 65.0 in stage 1.0 (TID 66) in 55946 ms on localhost (executor driver) (66/882) 2020-02-14 15:11:56 Executor: INFO: Running task 66.0 in stage 1.0 (TID 67) 2020-02-14 15:11:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2214592512+33554432 2020-02-14 15:11:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:12:27 Executor: INFO: Finished task 66.0 in stage 1.0 (TID 67). 1602 bytes result sent to driver 2020-02-14 15:12:27 TaskSetManager: INFO: Starting task 67.0 in stage 1.0 (TID 68, localhost, executor driver, partition 67, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:12:27 TaskSetManager: INFO: Finished task 66.0 in stage 1.0 (TID 67) in 31046 ms on localhost (executor driver) (67/882) 2020-02-14 15:12:27 Executor: INFO: Running task 67.0 in stage 1.0 (TID 68) 2020-02-14 15:12:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2248146944+33554432 2020-02-14 15:12:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:12:55 Executor: INFO: Finished task 67.0 in stage 1.0 (TID 68). 1626 bytes result sent to driver 2020-02-14 15:12:55 TaskSetManager: INFO: Starting task 68.0 in stage 1.0 (TID 69, localhost, executor driver, partition 68, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:12:55 TaskSetManager: INFO: Finished task 67.0 in stage 1.0 (TID 68) in 27395 ms on localhost (executor driver) (68/882) 2020-02-14 15:12:55 Executor: INFO: Running task 68.0 in stage 1.0 (TID 69) 2020-02-14 15:12:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2281701376+33554432 2020-02-14 15:12:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:13:43 Executor: INFO: Finished task 68.0 in stage 1.0 (TID 69). 1614 bytes result sent to driver 2020-02-14 15:13:43 TaskSetManager: INFO: Starting task 69.0 in stage 1.0 (TID 70, localhost, executor driver, partition 69, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:13:43 TaskSetManager: INFO: Finished task 68.0 in stage 1.0 (TID 69) in 48161 ms on localhost (executor driver) (69/882) 2020-02-14 15:13:43 Executor: INFO: Running task 69.0 in stage 1.0 (TID 70) 2020-02-14 15:13:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2315255808+33554432 2020-02-14 15:13:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:14:31 Executor: INFO: Finished task 69.0 in stage 1.0 (TID 70). 1693 bytes result sent to driver 2020-02-14 15:14:31 TaskSetManager: INFO: Starting task 70.0 in stage 1.0 (TID 71, localhost, executor driver, partition 70, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:14:31 TaskSetManager: INFO: Finished task 69.0 in stage 1.0 (TID 70) in 48266 ms on localhost (executor driver) (70/882) 2020-02-14 15:14:31 Executor: INFO: Running task 70.0 in stage 1.0 (TID 71) 2020-02-14 15:14:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2348810240+33554432 2020-02-14 15:14:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:15:25 Executor: INFO: Finished task 70.0 in stage 1.0 (TID 71). 1655 bytes result sent to driver 2020-02-14 15:15:25 TaskSetManager: INFO: Starting task 71.0 in stage 1.0 (TID 72, localhost, executor driver, partition 71, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:15:25 TaskSetManager: INFO: Finished task 70.0 in stage 1.0 (TID 71) in 53964 ms on localhost (executor driver) (71/882) 2020-02-14 15:15:25 Executor: INFO: Running task 71.0 in stage 1.0 (TID 72) 2020-02-14 15:15:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2382364672+33554432 2020-02-14 15:15:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:16:17 Executor: INFO: Finished task 71.0 in stage 1.0 (TID 72). 1650 bytes result sent to driver 2020-02-14 15:16:17 TaskSetManager: INFO: Starting task 72.0 in stage 1.0 (TID 73, localhost, executor driver, partition 72, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:16:17 TaskSetManager: INFO: Finished task 71.0 in stage 1.0 (TID 72) in 51906 ms on localhost (executor driver) (72/882) 2020-02-14 15:16:17 Executor: INFO: Running task 72.0 in stage 1.0 (TID 73) 2020-02-14 15:16:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2415919104+33554432 2020-02-14 15:16:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:17:14 Executor: INFO: Finished task 72.0 in stage 1.0 (TID 73). 1602 bytes result sent to driver 2020-02-14 15:17:14 TaskSetManager: INFO: Starting task 73.0 in stage 1.0 (TID 74, localhost, executor driver, partition 73, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:17:14 TaskSetManager: INFO: Finished task 72.0 in stage 1.0 (TID 73) in 57330 ms on localhost (executor driver) (73/882) 2020-02-14 15:17:14 Executor: INFO: Running task 73.0 in stage 1.0 (TID 74) 2020-02-14 15:17:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2449473536+33554432 2020-02-14 15:17:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:18:02 Executor: INFO: Finished task 73.0 in stage 1.0 (TID 74). 1648 bytes result sent to driver 2020-02-14 15:18:02 TaskSetManager: INFO: Starting task 74.0 in stage 1.0 (TID 75, localhost, executor driver, partition 74, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:18:02 TaskSetManager: INFO: Finished task 73.0 in stage 1.0 (TID 74) in 48165 ms on localhost (executor driver) (74/882) 2020-02-14 15:18:02 Executor: INFO: Running task 74.0 in stage 1.0 (TID 75) 2020-02-14 15:18:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2483027968+33554432 2020-02-14 15:18:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:18:51 Executor: INFO: Finished task 74.0 in stage 1.0 (TID 75). 1647 bytes result sent to driver 2020-02-14 15:18:51 TaskSetManager: INFO: Starting task 75.0 in stage 1.0 (TID 76, localhost, executor driver, partition 75, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:18:51 TaskSetManager: INFO: Finished task 74.0 in stage 1.0 (TID 75) in 48397 ms on localhost (executor driver) (75/882) 2020-02-14 15:18:51 Executor: INFO: Running task 75.0 in stage 1.0 (TID 76) 2020-02-14 15:18:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2516582400+33554432 2020-02-14 15:18:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:19:45 Executor: INFO: Finished task 75.0 in stage 1.0 (TID 76). 1603 bytes result sent to driver 2020-02-14 15:19:45 TaskSetManager: INFO: Starting task 76.0 in stage 1.0 (TID 77, localhost, executor driver, partition 76, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:19:45 TaskSetManager: INFO: Finished task 75.0 in stage 1.0 (TID 76) in 54418 ms on localhost (executor driver) (76/882) 2020-02-14 15:19:45 Executor: INFO: Running task 76.0 in stage 1.0 (TID 77) 2020-02-14 15:19:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2550136832+33554432 2020-02-14 15:19:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:20:33 Executor: INFO: Finished task 76.0 in stage 1.0 (TID 77). 1647 bytes result sent to driver 2020-02-14 15:20:33 TaskSetManager: INFO: Starting task 77.0 in stage 1.0 (TID 78, localhost, executor driver, partition 77, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:20:33 TaskSetManager: INFO: Finished task 76.0 in stage 1.0 (TID 77) in 47809 ms on localhost (executor driver) (77/882) 2020-02-14 15:20:33 Executor: INFO: Running task 77.0 in stage 1.0 (TID 78) 2020-02-14 15:20:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2583691264+33554432 2020-02-14 15:20:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:21:17 Executor: INFO: Finished task 77.0 in stage 1.0 (TID 78). 1602 bytes result sent to driver 2020-02-14 15:21:17 TaskSetManager: INFO: Starting task 78.0 in stage 1.0 (TID 79, localhost, executor driver, partition 78, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:21:17 TaskSetManager: INFO: Finished task 77.0 in stage 1.0 (TID 78) in 44324 ms on localhost (executor driver) (78/882) 2020-02-14 15:21:17 Executor: INFO: Running task 78.0 in stage 1.0 (TID 79) 2020-02-14 15:21:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2617245696+33554432 2020-02-14 15:21:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:21:50 Executor: INFO: Finished task 78.0 in stage 1.0 (TID 79). 1602 bytes result sent to driver 2020-02-14 15:21:50 TaskSetManager: INFO: Starting task 79.0 in stage 1.0 (TID 80, localhost, executor driver, partition 79, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:21:50 TaskSetManager: INFO: Finished task 78.0 in stage 1.0 (TID 79) in 32274 ms on localhost (executor driver) (79/882) 2020-02-14 15:21:50 Executor: INFO: Running task 79.0 in stage 1.0 (TID 80) 2020-02-14 15:21:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2650800128+33554432 2020-02-14 15:21:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:22:45 Executor: INFO: Finished task 79.0 in stage 1.0 (TID 80). 1603 bytes result sent to driver 2020-02-14 15:22:45 TaskSetManager: INFO: Starting task 80.0 in stage 1.0 (TID 81, localhost, executor driver, partition 80, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:22:45 TaskSetManager: INFO: Finished task 79.0 in stage 1.0 (TID 80) in 55955 ms on localhost (executor driver) (80/882) 2020-02-14 15:22:46 Executor: INFO: Running task 80.0 in stage 1.0 (TID 81) 2020-02-14 15:22:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2684354560+33554432 2020-02-14 15:22:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:23:26 Executor: INFO: Finished task 80.0 in stage 1.0 (TID 81). 1613 bytes result sent to driver 2020-02-14 15:23:26 TaskSetManager: INFO: Starting task 81.0 in stage 1.0 (TID 82, localhost, executor driver, partition 81, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:23:26 TaskSetManager: INFO: Finished task 80.0 in stage 1.0 (TID 81) in 40299 ms on localhost (executor driver) (81/882) 2020-02-14 15:23:26 Executor: INFO: Running task 81.0 in stage 1.0 (TID 82) 2020-02-14 15:23:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2717908992+33554432 2020-02-14 15:23:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:24:08 Executor: INFO: Finished task 81.0 in stage 1.0 (TID 82). 1649 bytes result sent to driver 2020-02-14 15:24:08 TaskSetManager: INFO: Starting task 82.0 in stage 1.0 (TID 83, localhost, executor driver, partition 82, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:24:08 TaskSetManager: INFO: Finished task 81.0 in stage 1.0 (TID 82) in 41766 ms on localhost (executor driver) (82/882) 2020-02-14 15:24:08 Executor: INFO: Running task 82.0 in stage 1.0 (TID 83) 2020-02-14 15:24:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2751463424+33554432 2020-02-14 15:24:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:24:54 Executor: INFO: Finished task 82.0 in stage 1.0 (TID 83). 1645 bytes result sent to driver 2020-02-14 15:24:54 TaskSetManager: INFO: Starting task 83.0 in stage 1.0 (TID 84, localhost, executor driver, partition 83, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:24:54 TaskSetManager: INFO: Finished task 82.0 in stage 1.0 (TID 83) in 46553 ms on localhost (executor driver) (83/882) 2020-02-14 15:24:54 Executor: INFO: Running task 83.0 in stage 1.0 (TID 84) 2020-02-14 15:24:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2785017856+33554432 2020-02-14 15:24:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:25:49 Executor: INFO: Finished task 83.0 in stage 1.0 (TID 84). 1639 bytes result sent to driver 2020-02-14 15:25:49 TaskSetManager: INFO: Starting task 84.0 in stage 1.0 (TID 85, localhost, executor driver, partition 84, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:25:49 TaskSetManager: INFO: Finished task 83.0 in stage 1.0 (TID 84) in 55315 ms on localhost (executor driver) (84/882) 2020-02-14 15:25:49 Executor: INFO: Running task 84.0 in stage 1.0 (TID 85) 2020-02-14 15:25:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2818572288+33554432 2020-02-14 15:25:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:26:28 Executor: INFO: Finished task 84.0 in stage 1.0 (TID 85). 1691 bytes result sent to driver 2020-02-14 15:26:28 TaskSetManager: INFO: Starting task 85.0 in stage 1.0 (TID 86, localhost, executor driver, partition 85, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:26:28 TaskSetManager: INFO: Finished task 84.0 in stage 1.0 (TID 85) in 38516 ms on localhost (executor driver) (85/882) 2020-02-14 15:26:28 Executor: INFO: Running task 85.0 in stage 1.0 (TID 86) 2020-02-14 15:26:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2852126720+33554432 2020-02-14 15:26:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:27:17 Executor: INFO: Finished task 85.0 in stage 1.0 (TID 86). 1603 bytes result sent to driver 2020-02-14 15:27:17 TaskSetManager: INFO: Starting task 86.0 in stage 1.0 (TID 87, localhost, executor driver, partition 86, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:27:17 TaskSetManager: INFO: Finished task 85.0 in stage 1.0 (TID 86) in 49126 ms on localhost (executor driver) (86/882) 2020-02-14 15:27:17 Executor: INFO: Running task 86.0 in stage 1.0 (TID 87) 2020-02-14 15:27:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2885681152+33554432 2020-02-14 15:27:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:28:17 Executor: INFO: Finished task 86.0 in stage 1.0 (TID 87). 1602 bytes result sent to driver 2020-02-14 15:28:17 TaskSetManager: INFO: Starting task 87.0 in stage 1.0 (TID 88, localhost, executor driver, partition 87, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:28:17 TaskSetManager: INFO: Finished task 86.0 in stage 1.0 (TID 87) in 59972 ms on localhost (executor driver) (87/882) 2020-02-14 15:28:17 Executor: INFO: Running task 87.0 in stage 1.0 (TID 88) 2020-02-14 15:28:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2919235584+33554432 2020-02-14 15:28:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:29:22 Executor: INFO: Finished task 87.0 in stage 1.0 (TID 88). 1645 bytes result sent to driver 2020-02-14 15:29:22 TaskSetManager: INFO: Starting task 88.0 in stage 1.0 (TID 89, localhost, executor driver, partition 88, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:29:22 TaskSetManager: INFO: Finished task 87.0 in stage 1.0 (TID 88) in 64631 ms on localhost (executor driver) (88/882) 2020-02-14 15:29:22 Executor: INFO: Running task 88.0 in stage 1.0 (TID 89) 2020-02-14 15:29:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2952790016+33554432 2020-02-14 15:29:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:30:27 Executor: INFO: Finished task 88.0 in stage 1.0 (TID 89). 1660 bytes result sent to driver 2020-02-14 15:30:27 TaskSetManager: INFO: Starting task 89.0 in stage 1.0 (TID 90, localhost, executor driver, partition 89, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:30:27 TaskSetManager: INFO: Finished task 88.0 in stage 1.0 (TID 89) in 65468 ms on localhost (executor driver) (89/882) 2020-02-14 15:30:27 Executor: INFO: Running task 89.0 in stage 1.0 (TID 90) 2020-02-14 15:30:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2986344448+33554432 2020-02-14 15:30:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:31:24 Executor: INFO: Finished task 89.0 in stage 1.0 (TID 90). 1603 bytes result sent to driver 2020-02-14 15:31:24 TaskSetManager: INFO: Starting task 90.0 in stage 1.0 (TID 91, localhost, executor driver, partition 90, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:31:24 TaskSetManager: INFO: Finished task 89.0 in stage 1.0 (TID 90) in 56709 ms on localhost (executor driver) (90/882) 2020-02-14 15:31:24 Executor: INFO: Running task 90.0 in stage 1.0 (TID 91) 2020-02-14 15:31:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3019898880+33554432 2020-02-14 15:31:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:32:17 Executor: INFO: Finished task 90.0 in stage 1.0 (TID 91). 1630 bytes result sent to driver 2020-02-14 15:32:17 TaskSetManager: INFO: Starting task 91.0 in stage 1.0 (TID 92, localhost, executor driver, partition 91, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:32:17 TaskSetManager: INFO: Finished task 90.0 in stage 1.0 (TID 91) in 52915 ms on localhost (executor driver) (91/882) 2020-02-14 15:32:17 Executor: INFO: Running task 91.0 in stage 1.0 (TID 92) 2020-02-14 15:32:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3053453312+33554432 2020-02-14 15:32:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:33:06 Executor: INFO: Finished task 91.0 in stage 1.0 (TID 92). 1602 bytes result sent to driver 2020-02-14 15:33:06 TaskSetManager: INFO: Starting task 92.0 in stage 1.0 (TID 93, localhost, executor driver, partition 92, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:33:06 TaskSetManager: INFO: Finished task 91.0 in stage 1.0 (TID 92) in 49517 ms on localhost (executor driver) (92/882) 2020-02-14 15:33:06 Executor: INFO: Running task 92.0 in stage 1.0 (TID 93) 2020-02-14 15:33:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3087007744+33554432 2020-02-14 15:33:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:33:55 Executor: INFO: Finished task 92.0 in stage 1.0 (TID 93). 1662 bytes result sent to driver 2020-02-14 15:33:55 TaskSetManager: INFO: Starting task 93.0 in stage 1.0 (TID 94, localhost, executor driver, partition 93, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:33:55 TaskSetManager: INFO: Finished task 92.0 in stage 1.0 (TID 93) in 48615 ms on localhost (executor driver) (93/882) 2020-02-14 15:33:55 Executor: INFO: Running task 93.0 in stage 1.0 (TID 94) 2020-02-14 15:33:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3120562176+33554432 2020-02-14 15:33:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:34:40 Executor: INFO: Finished task 93.0 in stage 1.0 (TID 94). 1602 bytes result sent to driver 2020-02-14 15:34:40 TaskSetManager: INFO: Starting task 94.0 in stage 1.0 (TID 95, localhost, executor driver, partition 94, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:34:40 TaskSetManager: INFO: Finished task 93.0 in stage 1.0 (TID 94) in 45294 ms on localhost (executor driver) (94/882) 2020-02-14 15:34:40 Executor: INFO: Running task 94.0 in stage 1.0 (TID 95) 2020-02-14 15:34:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3154116608+33554432 2020-02-14 15:34:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:35:33 Executor: INFO: Finished task 94.0 in stage 1.0 (TID 95). 1607 bytes result sent to driver 2020-02-14 15:35:33 TaskSetManager: INFO: Starting task 95.0 in stage 1.0 (TID 96, localhost, executor driver, partition 95, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:35:33 TaskSetManager: INFO: Finished task 94.0 in stage 1.0 (TID 95) in 52803 ms on localhost (executor driver) (95/882) 2020-02-14 15:35:33 Executor: INFO: Running task 95.0 in stage 1.0 (TID 96) 2020-02-14 15:35:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3187671040+33554432 2020-02-14 15:35:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:36:34 Executor: INFO: Finished task 95.0 in stage 1.0 (TID 96). 1614 bytes result sent to driver 2020-02-14 15:36:34 TaskSetManager: INFO: Starting task 96.0 in stage 1.0 (TID 97, localhost, executor driver, partition 96, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:36:34 TaskSetManager: INFO: Finished task 95.0 in stage 1.0 (TID 96) in 61339 ms on localhost (executor driver) (96/882) 2020-02-14 15:36:34 Executor: INFO: Running task 96.0 in stage 1.0 (TID 97) 2020-02-14 15:36:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3221225472+33554432 2020-02-14 15:36:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:37:28 Executor: INFO: Finished task 96.0 in stage 1.0 (TID 97). 1667 bytes result sent to driver 2020-02-14 15:37:28 TaskSetManager: INFO: Starting task 97.0 in stage 1.0 (TID 98, localhost, executor driver, partition 97, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:37:28 TaskSetManager: INFO: Finished task 96.0 in stage 1.0 (TID 97) in 53312 ms on localhost (executor driver) (97/882) 2020-02-14 15:37:28 Executor: INFO: Running task 97.0 in stage 1.0 (TID 98) 2020-02-14 15:37:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3254779904+33554432 2020-02-14 15:37:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:38:17 Executor: INFO: Finished task 97.0 in stage 1.0 (TID 98). 1679 bytes result sent to driver 2020-02-14 15:38:17 TaskSetManager: INFO: Starting task 98.0 in stage 1.0 (TID 99, localhost, executor driver, partition 98, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:38:17 TaskSetManager: INFO: Finished task 97.0 in stage 1.0 (TID 98) in 49081 ms on localhost (executor driver) (98/882) 2020-02-14 15:38:17 Executor: INFO: Running task 98.0 in stage 1.0 (TID 99) 2020-02-14 15:38:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3288334336+33554432 2020-02-14 15:38:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:38:59 Executor: INFO: Finished task 98.0 in stage 1.0 (TID 99). 1637 bytes result sent to driver 2020-02-14 15:38:59 TaskSetManager: INFO: Starting task 99.0 in stage 1.0 (TID 100, localhost, executor driver, partition 99, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:38:59 TaskSetManager: INFO: Finished task 98.0 in stage 1.0 (TID 99) in 42216 ms on localhost (executor driver) (99/882) 2020-02-14 15:38:59 Executor: INFO: Running task 99.0 in stage 1.0 (TID 100) 2020-02-14 15:38:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3321888768+33554432 2020-02-14 15:38:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:39:37 Executor: INFO: Finished task 99.0 in stage 1.0 (TID 100). 1675 bytes result sent to driver 2020-02-14 15:39:37 TaskSetManager: INFO: Starting task 100.0 in stage 1.0 (TID 101, localhost, executor driver, partition 100, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:39:37 TaskSetManager: INFO: Finished task 99.0 in stage 1.0 (TID 100) in 38113 ms on localhost (executor driver) (100/882) 2020-02-14 15:39:37 Executor: INFO: Running task 100.0 in stage 1.0 (TID 101) 2020-02-14 15:39:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3355443200+33554432 2020-02-14 15:39:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:40:22 Executor: INFO: Finished task 100.0 in stage 1.0 (TID 101). 1624 bytes result sent to driver 2020-02-14 15:40:22 TaskSetManager: INFO: Starting task 101.0 in stage 1.0 (TID 102, localhost, executor driver, partition 101, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:40:22 TaskSetManager: INFO: Finished task 100.0 in stage 1.0 (TID 101) in 45179 ms on localhost (executor driver) (101/882) 2020-02-14 15:40:22 Executor: INFO: Running task 101.0 in stage 1.0 (TID 102) 2020-02-14 15:40:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3388997632+33554432 2020-02-14 15:40:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:41:05 Executor: INFO: Finished task 101.0 in stage 1.0 (TID 102). 1701 bytes result sent to driver 2020-02-14 15:41:05 TaskSetManager: INFO: Starting task 102.0 in stage 1.0 (TID 103, localhost, executor driver, partition 102, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:41:05 TaskSetManager: INFO: Finished task 101.0 in stage 1.0 (TID 102) in 43158 ms on localhost (executor driver) (102/882) 2020-02-14 15:41:05 Executor: INFO: Running task 102.0 in stage 1.0 (TID 103) 2020-02-14 15:41:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3422552064+33554432 2020-02-14 15:41:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:41:33 Executor: INFO: Finished task 102.0 in stage 1.0 (TID 103). 1648 bytes result sent to driver 2020-02-14 15:41:33 TaskSetManager: INFO: Starting task 103.0 in stage 1.0 (TID 104, localhost, executor driver, partition 103, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:41:33 TaskSetManager: INFO: Finished task 102.0 in stage 1.0 (TID 103) in 27226 ms on localhost (executor driver) (103/882) 2020-02-14 15:41:33 Executor: INFO: Running task 103.0 in stage 1.0 (TID 104) 2020-02-14 15:41:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3456106496+33554432 2020-02-14 15:41:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:42:26 Executor: INFO: Finished task 103.0 in stage 1.0 (TID 104). 1645 bytes result sent to driver 2020-02-14 15:42:26 TaskSetManager: INFO: Starting task 104.0 in stage 1.0 (TID 105, localhost, executor driver, partition 104, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:42:26 TaskSetManager: INFO: Finished task 103.0 in stage 1.0 (TID 104) in 53099 ms on localhost (executor driver) (104/882) 2020-02-14 15:42:26 Executor: INFO: Running task 104.0 in stage 1.0 (TID 105) 2020-02-14 15:42:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3489660928+33554432 2020-02-14 15:42:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:42:59 Executor: INFO: Finished task 104.0 in stage 1.0 (TID 105). 1648 bytes result sent to driver 2020-02-14 15:42:59 TaskSetManager: INFO: Starting task 105.0 in stage 1.0 (TID 106, localhost, executor driver, partition 105, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:42:59 TaskSetManager: INFO: Finished task 104.0 in stage 1.0 (TID 105) in 33662 ms on localhost (executor driver) (105/882) 2020-02-14 15:42:59 Executor: INFO: Running task 105.0 in stage 1.0 (TID 106) 2020-02-14 15:42:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3523215360+33554432 2020-02-14 15:42:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:44:01 Executor: INFO: Finished task 105.0 in stage 1.0 (TID 106). 1604 bytes result sent to driver 2020-02-14 15:44:01 TaskSetManager: INFO: Starting task 106.0 in stage 1.0 (TID 107, localhost, executor driver, partition 106, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:44:01 TaskSetManager: INFO: Finished task 105.0 in stage 1.0 (TID 106) in 61728 ms on localhost (executor driver) (106/882) 2020-02-14 15:44:01 Executor: INFO: Running task 106.0 in stage 1.0 (TID 107) 2020-02-14 15:44:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3556769792+33554432 2020-02-14 15:44:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:44:56 Executor: INFO: Finished task 106.0 in stage 1.0 (TID 107). 1602 bytes result sent to driver 2020-02-14 15:44:56 TaskSetManager: INFO: Starting task 107.0 in stage 1.0 (TID 108, localhost, executor driver, partition 107, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:44:56 TaskSetManager: INFO: Finished task 106.0 in stage 1.0 (TID 107) in 54599 ms on localhost (executor driver) (107/882) 2020-02-14 15:44:56 Executor: INFO: Running task 107.0 in stage 1.0 (TID 108) 2020-02-14 15:44:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3590324224+33554432 2020-02-14 15:44:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:45:59 Executor: INFO: Finished task 107.0 in stage 1.0 (TID 108). 1617 bytes result sent to driver 2020-02-14 15:45:59 TaskSetManager: INFO: Starting task 108.0 in stage 1.0 (TID 109, localhost, executor driver, partition 108, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:45:59 TaskSetManager: INFO: Finished task 107.0 in stage 1.0 (TID 108) in 62876 ms on localhost (executor driver) (108/882) 2020-02-14 15:45:59 Executor: INFO: Running task 108.0 in stage 1.0 (TID 109) 2020-02-14 15:45:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3623878656+33554432 2020-02-14 15:45:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:46:42 Executor: INFO: Finished task 108.0 in stage 1.0 (TID 109). 1632 bytes result sent to driver 2020-02-14 15:46:42 TaskSetManager: INFO: Starting task 109.0 in stage 1.0 (TID 110, localhost, executor driver, partition 109, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:46:42 TaskSetManager: INFO: Finished task 108.0 in stage 1.0 (TID 109) in 43235 ms on localhost (executor driver) (109/882) 2020-02-14 15:46:42 Executor: INFO: Running task 109.0 in stage 1.0 (TID 110) 2020-02-14 15:46:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3657433088+33554432 2020-02-14 15:46:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:47:32 Executor: INFO: Finished task 109.0 in stage 1.0 (TID 110). 1617 bytes result sent to driver 2020-02-14 15:47:32 TaskSetManager: INFO: Starting task 110.0 in stage 1.0 (TID 111, localhost, executor driver, partition 110, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:47:32 TaskSetManager: INFO: Finished task 109.0 in stage 1.0 (TID 110) in 50675 ms on localhost (executor driver) (110/882) 2020-02-14 15:47:32 Executor: INFO: Running task 110.0 in stage 1.0 (TID 111) 2020-02-14 15:47:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3690987520+33554432 2020-02-14 15:47:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:48:19 Executor: INFO: Finished task 110.0 in stage 1.0 (TID 111). 1602 bytes result sent to driver 2020-02-14 15:48:19 TaskSetManager: INFO: Starting task 111.0 in stage 1.0 (TID 112, localhost, executor driver, partition 111, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:48:19 TaskSetManager: INFO: Finished task 110.0 in stage 1.0 (TID 111) in 46114 ms on localhost (executor driver) (111/882) 2020-02-14 15:48:19 Executor: INFO: Running task 111.0 in stage 1.0 (TID 112) 2020-02-14 15:48:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3724541952+33554432 2020-02-14 15:48:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:48:55 Executor: INFO: Finished task 111.0 in stage 1.0 (TID 112). 1614 bytes result sent to driver 2020-02-14 15:48:55 TaskSetManager: INFO: Starting task 112.0 in stage 1.0 (TID 113, localhost, executor driver, partition 112, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:48:55 TaskSetManager: INFO: Finished task 111.0 in stage 1.0 (TID 112) in 36191 ms on localhost (executor driver) (112/882) 2020-02-14 15:48:55 Executor: INFO: Running task 112.0 in stage 1.0 (TID 113) 2020-02-14 15:48:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3758096384+33554432 2020-02-14 15:48:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:49:33 Executor: INFO: Finished task 112.0 in stage 1.0 (TID 113). 1753 bytes result sent to driver 2020-02-14 15:49:33 TaskSetManager: INFO: Starting task 113.0 in stage 1.0 (TID 114, localhost, executor driver, partition 113, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:49:33 TaskSetManager: INFO: Finished task 112.0 in stage 1.0 (TID 113) in 38515 ms on localhost (executor driver) (113/882) 2020-02-14 15:49:33 Executor: INFO: Running task 113.0 in stage 1.0 (TID 114) 2020-02-14 15:49:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3791650816+33554432 2020-02-14 15:49:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:50:22 Executor: INFO: Finished task 113.0 in stage 1.0 (TID 114). 1729 bytes result sent to driver 2020-02-14 15:50:22 TaskSetManager: INFO: Starting task 114.0 in stage 1.0 (TID 115, localhost, executor driver, partition 114, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:50:22 TaskSetManager: INFO: Finished task 113.0 in stage 1.0 (TID 114) in 48648 ms on localhost (executor driver) (114/882) 2020-02-14 15:50:22 Executor: INFO: Running task 114.0 in stage 1.0 (TID 115) 2020-02-14 15:50:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3825205248+33554432 2020-02-14 15:50:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:51:15 Executor: INFO: Finished task 114.0 in stage 1.0 (TID 115). 1606 bytes result sent to driver 2020-02-14 15:51:15 TaskSetManager: INFO: Starting task 115.0 in stage 1.0 (TID 116, localhost, executor driver, partition 115, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:51:15 TaskSetManager: INFO: Finished task 114.0 in stage 1.0 (TID 115) in 53516 ms on localhost (executor driver) (115/882) 2020-02-14 15:51:15 Executor: INFO: Running task 115.0 in stage 1.0 (TID 116) 2020-02-14 15:51:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3858759680+33554432 2020-02-14 15:51:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:51:54 Executor: INFO: Finished task 115.0 in stage 1.0 (TID 116). 1607 bytes result sent to driver 2020-02-14 15:51:54 TaskSetManager: INFO: Starting task 116.0 in stage 1.0 (TID 117, localhost, executor driver, partition 116, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:51:54 TaskSetManager: INFO: Finished task 115.0 in stage 1.0 (TID 116) in 38324 ms on localhost (executor driver) (116/882) 2020-02-14 15:51:54 Executor: INFO: Running task 116.0 in stage 1.0 (TID 117) 2020-02-14 15:51:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3892314112+33554432 2020-02-14 15:51:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:52:30 Executor: INFO: Finished task 116.0 in stage 1.0 (TID 117). 1624 bytes result sent to driver 2020-02-14 15:52:30 TaskSetManager: INFO: Starting task 117.0 in stage 1.0 (TID 118, localhost, executor driver, partition 117, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:52:30 TaskSetManager: INFO: Finished task 116.0 in stage 1.0 (TID 117) in 36067 ms on localhost (executor driver) (117/882) 2020-02-14 15:52:30 Executor: INFO: Running task 117.0 in stage 1.0 (TID 118) 2020-02-14 15:52:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3925868544+33554432 2020-02-14 15:52:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:53:32 Executor: INFO: Finished task 117.0 in stage 1.0 (TID 118). 1740 bytes result sent to driver 2020-02-14 15:53:32 TaskSetManager: INFO: Starting task 118.0 in stage 1.0 (TID 119, localhost, executor driver, partition 118, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:53:32 TaskSetManager: INFO: Finished task 117.0 in stage 1.0 (TID 118) in 62030 ms on localhost (executor driver) (118/882) 2020-02-14 15:53:32 Executor: INFO: Running task 118.0 in stage 1.0 (TID 119) 2020-02-14 15:53:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3959422976+33554432 2020-02-14 15:53:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:53:58 Executor: INFO: Finished task 118.0 in stage 1.0 (TID 119). 1603 bytes result sent to driver 2020-02-14 15:53:58 TaskSetManager: INFO: Starting task 119.0 in stage 1.0 (TID 120, localhost, executor driver, partition 119, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:53:58 TaskSetManager: INFO: Finished task 118.0 in stage 1.0 (TID 119) in 26596 ms on localhost (executor driver) (119/882) 2020-02-14 15:53:58 Executor: INFO: Running task 119.0 in stage 1.0 (TID 120) 2020-02-14 15:53:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3992977408+33554432 2020-02-14 15:53:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:54:14 Executor: INFO: Finished task 119.0 in stage 1.0 (TID 120). 1615 bytes result sent to driver 2020-02-14 15:54:14 TaskSetManager: INFO: Starting task 120.0 in stage 1.0 (TID 121, localhost, executor driver, partition 120, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:54:14 TaskSetManager: INFO: Finished task 119.0 in stage 1.0 (TID 120) in 15119 ms on localhost (executor driver) (120/882) 2020-02-14 15:54:14 Executor: INFO: Running task 120.0 in stage 1.0 (TID 121) 2020-02-14 15:54:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4026531840+33554432 2020-02-14 15:54:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:55:02 Executor: INFO: Finished task 120.0 in stage 1.0 (TID 121). 1616 bytes result sent to driver 2020-02-14 15:55:02 TaskSetManager: INFO: Starting task 121.0 in stage 1.0 (TID 122, localhost, executor driver, partition 121, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:55:02 TaskSetManager: INFO: Finished task 120.0 in stage 1.0 (TID 121) in 48107 ms on localhost (executor driver) (121/882) 2020-02-14 15:55:02 Executor: INFO: Running task 121.0 in stage 1.0 (TID 122) 2020-02-14 15:55:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4060086272+33554432 2020-02-14 15:55:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:55:51 Executor: INFO: Finished task 121.0 in stage 1.0 (TID 122). 1680 bytes result sent to driver 2020-02-14 15:55:51 TaskSetManager: INFO: Starting task 122.0 in stage 1.0 (TID 123, localhost, executor driver, partition 122, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:55:51 TaskSetManager: INFO: Finished task 121.0 in stage 1.0 (TID 122) in 49532 ms on localhost (executor driver) (122/882) 2020-02-14 15:55:51 Executor: INFO: Running task 122.0 in stage 1.0 (TID 123) 2020-02-14 15:55:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4093640704+33554432 2020-02-14 15:55:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:56:41 Executor: INFO: Finished task 122.0 in stage 1.0 (TID 123). 1619 bytes result sent to driver 2020-02-14 15:56:41 TaskSetManager: INFO: Starting task 123.0 in stage 1.0 (TID 124, localhost, executor driver, partition 123, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:56:41 TaskSetManager: INFO: Finished task 122.0 in stage 1.0 (TID 123) in 49295 ms on localhost (executor driver) (123/882) 2020-02-14 15:56:41 Executor: INFO: Running task 123.0 in stage 1.0 (TID 124) 2020-02-14 15:56:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4127195136+33554432 2020-02-14 15:56:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:57:20 Executor: INFO: Finished task 123.0 in stage 1.0 (TID 124). 1637 bytes result sent to driver 2020-02-14 15:57:20 TaskSetManager: INFO: Starting task 124.0 in stage 1.0 (TID 125, localhost, executor driver, partition 124, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:57:20 TaskSetManager: INFO: Finished task 123.0 in stage 1.0 (TID 124) in 39670 ms on localhost (executor driver) (124/882) 2020-02-14 15:57:20 Executor: INFO: Running task 124.0 in stage 1.0 (TID 125) 2020-02-14 15:57:20 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4160749568+33554432 2020-02-14 15:57:20 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:58:04 Executor: INFO: Finished task 124.0 in stage 1.0 (TID 125). 1602 bytes result sent to driver 2020-02-14 15:58:04 TaskSetManager: INFO: Starting task 125.0 in stage 1.0 (TID 126, localhost, executor driver, partition 125, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:58:04 TaskSetManager: INFO: Finished task 124.0 in stage 1.0 (TID 125) in 43320 ms on localhost (executor driver) (125/882) 2020-02-14 15:58:04 Executor: INFO: Running task 125.0 in stage 1.0 (TID 126) 2020-02-14 15:58:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4194304000+33554432 2020-02-14 15:58:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:58:46 Executor: INFO: Finished task 125.0 in stage 1.0 (TID 126). 1602 bytes result sent to driver 2020-02-14 15:58:46 TaskSetManager: INFO: Starting task 126.0 in stage 1.0 (TID 127, localhost, executor driver, partition 126, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:58:46 TaskSetManager: INFO: Finished task 125.0 in stage 1.0 (TID 126) in 42855 ms on localhost (executor driver) (126/882) 2020-02-14 15:58:46 Executor: INFO: Running task 126.0 in stage 1.0 (TID 127) 2020-02-14 15:58:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4227858432+33554432 2020-02-14 15:58:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 15:59:33 Executor: INFO: Finished task 126.0 in stage 1.0 (TID 127). 1653 bytes result sent to driver 2020-02-14 15:59:33 TaskSetManager: INFO: Starting task 127.0 in stage 1.0 (TID 128, localhost, executor driver, partition 127, PROCESS_LOCAL, 7933 bytes) 2020-02-14 15:59:33 TaskSetManager: INFO: Finished task 126.0 in stage 1.0 (TID 127) in 47072 ms on localhost (executor driver) (127/882) 2020-02-14 15:59:33 Executor: INFO: Running task 127.0 in stage 1.0 (TID 128) 2020-02-14 15:59:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4261412864+33554432 2020-02-14 15:59:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:00:13 Executor: INFO: Finished task 127.0 in stage 1.0 (TID 128). 1645 bytes result sent to driver 2020-02-14 16:00:13 TaskSetManager: INFO: Starting task 128.0 in stage 1.0 (TID 129, localhost, executor driver, partition 128, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:00:13 TaskSetManager: INFO: Finished task 127.0 in stage 1.0 (TID 128) in 39936 ms on localhost (executor driver) (128/882) 2020-02-14 16:00:13 Executor: INFO: Running task 128.0 in stage 1.0 (TID 129) 2020-02-14 16:00:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4294967296+33554432 2020-02-14 16:00:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:00:55 Executor: INFO: Finished task 128.0 in stage 1.0 (TID 129). 1639 bytes result sent to driver 2020-02-14 16:00:55 TaskSetManager: INFO: Starting task 129.0 in stage 1.0 (TID 130, localhost, executor driver, partition 129, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:00:55 TaskSetManager: INFO: Finished task 128.0 in stage 1.0 (TID 129) in 41631 ms on localhost (executor driver) (129/882) 2020-02-14 16:00:55 Executor: INFO: Running task 129.0 in stage 1.0 (TID 130) 2020-02-14 16:00:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4328521728+33554432 2020-02-14 16:00:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:01:43 Executor: INFO: Finished task 129.0 in stage 1.0 (TID 130). 1647 bytes result sent to driver 2020-02-14 16:01:43 TaskSetManager: INFO: Starting task 130.0 in stage 1.0 (TID 131, localhost, executor driver, partition 130, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:01:43 TaskSetManager: INFO: Finished task 129.0 in stage 1.0 (TID 130) in 47757 ms on localhost (executor driver) (130/882) 2020-02-14 16:01:43 Executor: INFO: Running task 130.0 in stage 1.0 (TID 131) 2020-02-14 16:01:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4362076160+33554432 2020-02-14 16:01:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:02:27 Executor: INFO: Finished task 130.0 in stage 1.0 (TID 131). 1623 bytes result sent to driver 2020-02-14 16:02:27 TaskSetManager: INFO: Starting task 131.0 in stage 1.0 (TID 132, localhost, executor driver, partition 131, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:02:27 TaskSetManager: INFO: Finished task 130.0 in stage 1.0 (TID 131) in 44737 ms on localhost (executor driver) (131/882) 2020-02-14 16:02:27 Executor: INFO: Running task 131.0 in stage 1.0 (TID 132) 2020-02-14 16:02:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4395630592+33554432 2020-02-14 16:02:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:03:12 Executor: INFO: Finished task 131.0 in stage 1.0 (TID 132). 1675 bytes result sent to driver 2020-02-14 16:03:12 TaskSetManager: INFO: Starting task 132.0 in stage 1.0 (TID 133, localhost, executor driver, partition 132, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:03:12 TaskSetManager: INFO: Finished task 131.0 in stage 1.0 (TID 132) in 44676 ms on localhost (executor driver) (132/882) 2020-02-14 16:03:12 Executor: INFO: Running task 132.0 in stage 1.0 (TID 133) 2020-02-14 16:03:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4429185024+33554432 2020-02-14 16:03:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:03:57 Executor: INFO: Finished task 132.0 in stage 1.0 (TID 133). 1614 bytes result sent to driver 2020-02-14 16:03:57 TaskSetManager: INFO: Starting task 133.0 in stage 1.0 (TID 134, localhost, executor driver, partition 133, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:03:57 TaskSetManager: INFO: Finished task 132.0 in stage 1.0 (TID 133) in 44976 ms on localhost (executor driver) (133/882) 2020-02-14 16:03:57 Executor: INFO: Running task 133.0 in stage 1.0 (TID 134) 2020-02-14 16:03:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4462739456+33554432 2020-02-14 16:03:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:04:36 Executor: INFO: Finished task 133.0 in stage 1.0 (TID 134). 1648 bytes result sent to driver 2020-02-14 16:04:36 TaskSetManager: INFO: Starting task 134.0 in stage 1.0 (TID 135, localhost, executor driver, partition 134, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:04:36 TaskSetManager: INFO: Finished task 133.0 in stage 1.0 (TID 134) in 39268 ms on localhost (executor driver) (134/882) 2020-02-14 16:04:36 Executor: INFO: Running task 134.0 in stage 1.0 (TID 135) 2020-02-14 16:04:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4496293888+33554432 2020-02-14 16:04:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:05:12 Executor: INFO: Finished task 134.0 in stage 1.0 (TID 135). 1617 bytes result sent to driver 2020-02-14 16:05:12 TaskSetManager: INFO: Starting task 135.0 in stage 1.0 (TID 136, localhost, executor driver, partition 135, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:05:12 TaskSetManager: INFO: Finished task 134.0 in stage 1.0 (TID 135) in 35382 ms on localhost (executor driver) (135/882) 2020-02-14 16:05:12 Executor: INFO: Running task 135.0 in stage 1.0 (TID 136) 2020-02-14 16:05:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4529848320+33554432 2020-02-14 16:05:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:05:50 Executor: INFO: Finished task 135.0 in stage 1.0 (TID 136). 1606 bytes result sent to driver 2020-02-14 16:05:50 TaskSetManager: INFO: Starting task 136.0 in stage 1.0 (TID 137, localhost, executor driver, partition 136, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:05:50 TaskSetManager: INFO: Finished task 135.0 in stage 1.0 (TID 136) in 38329 ms on localhost (executor driver) (136/882) 2020-02-14 16:05:50 Executor: INFO: Running task 136.0 in stage 1.0 (TID 137) 2020-02-14 16:05:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4563402752+33554432 2020-02-14 16:05:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:06:35 Executor: INFO: Finished task 136.0 in stage 1.0 (TID 137). 1611 bytes result sent to driver 2020-02-14 16:06:35 TaskSetManager: INFO: Starting task 137.0 in stage 1.0 (TID 138, localhost, executor driver, partition 137, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:06:35 TaskSetManager: INFO: Finished task 136.0 in stage 1.0 (TID 137) in 44823 ms on localhost (executor driver) (137/882) 2020-02-14 16:06:35 Executor: INFO: Running task 137.0 in stage 1.0 (TID 138) 2020-02-14 16:06:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4596957184+33554432 2020-02-14 16:06:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:07:20 Executor: INFO: Finished task 137.0 in stage 1.0 (TID 138). 1627 bytes result sent to driver 2020-02-14 16:07:20 TaskSetManager: INFO: Starting task 138.0 in stage 1.0 (TID 139, localhost, executor driver, partition 138, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:07:20 TaskSetManager: INFO: Finished task 137.0 in stage 1.0 (TID 138) in 44879 ms on localhost (executor driver) (138/882) 2020-02-14 16:07:20 Executor: INFO: Running task 138.0 in stage 1.0 (TID 139) 2020-02-14 16:07:20 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4630511616+33554432 2020-02-14 16:07:20 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:08:23 Executor: INFO: Finished task 138.0 in stage 1.0 (TID 139). 1604 bytes result sent to driver 2020-02-14 16:08:23 TaskSetManager: INFO: Starting task 139.0 in stage 1.0 (TID 140, localhost, executor driver, partition 139, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:08:23 TaskSetManager: INFO: Finished task 138.0 in stage 1.0 (TID 139) in 63652 ms on localhost (executor driver) (139/882) 2020-02-14 16:08:23 Executor: INFO: Running task 139.0 in stage 1.0 (TID 140) 2020-02-14 16:08:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4664066048+33554432 2020-02-14 16:08:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:09:30 Executor: INFO: Finished task 139.0 in stage 1.0 (TID 140). 1645 bytes result sent to driver 2020-02-14 16:09:30 TaskSetManager: INFO: Starting task 140.0 in stage 1.0 (TID 141, localhost, executor driver, partition 140, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:09:30 TaskSetManager: INFO: Finished task 139.0 in stage 1.0 (TID 140) in 66753 ms on localhost (executor driver) (140/882) 2020-02-14 16:09:30 Executor: INFO: Running task 140.0 in stage 1.0 (TID 141) 2020-02-14 16:09:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4697620480+33554432 2020-02-14 16:09:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:10:43 Executor: INFO: Finished task 140.0 in stage 1.0 (TID 141). 1602 bytes result sent to driver 2020-02-14 16:10:43 TaskSetManager: INFO: Starting task 141.0 in stage 1.0 (TID 142, localhost, executor driver, partition 141, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:10:43 TaskSetManager: INFO: Finished task 140.0 in stage 1.0 (TID 141) in 72717 ms on localhost (executor driver) (141/882) 2020-02-14 16:10:43 Executor: INFO: Running task 141.0 in stage 1.0 (TID 142) 2020-02-14 16:10:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4731174912+33554432 2020-02-14 16:10:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:11:48 Executor: INFO: Finished task 141.0 in stage 1.0 (TID 142). 1686 bytes result sent to driver 2020-02-14 16:11:48 TaskSetManager: INFO: Starting task 142.0 in stage 1.0 (TID 143, localhost, executor driver, partition 142, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:11:48 TaskSetManager: INFO: Finished task 141.0 in stage 1.0 (TID 142) in 65065 ms on localhost (executor driver) (142/882) 2020-02-14 16:11:48 Executor: INFO: Running task 142.0 in stage 1.0 (TID 143) 2020-02-14 16:11:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4764729344+33554432 2020-02-14 16:11:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:12:51 Executor: INFO: Finished task 142.0 in stage 1.0 (TID 143). 1602 bytes result sent to driver 2020-02-14 16:12:51 TaskSetManager: INFO: Starting task 143.0 in stage 1.0 (TID 144, localhost, executor driver, partition 143, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:12:51 TaskSetManager: INFO: Finished task 142.0 in stage 1.0 (TID 143) in 62810 ms on localhost (executor driver) (143/882) 2020-02-14 16:12:51 Executor: INFO: Running task 143.0 in stage 1.0 (TID 144) 2020-02-14 16:12:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4798283776+33554432 2020-02-14 16:12:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:13:40 Executor: INFO: Finished task 143.0 in stage 1.0 (TID 144). 1602 bytes result sent to driver 2020-02-14 16:13:40 TaskSetManager: INFO: Starting task 144.0 in stage 1.0 (TID 145, localhost, executor driver, partition 144, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:13:40 TaskSetManager: INFO: Finished task 143.0 in stage 1.0 (TID 144) in 49071 ms on localhost (executor driver) (144/882) 2020-02-14 16:13:40 Executor: INFO: Running task 144.0 in stage 1.0 (TID 145) 2020-02-14 16:13:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4831838208+33554432 2020-02-14 16:13:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:14:13 Executor: INFO: Finished task 144.0 in stage 1.0 (TID 145). 1610 bytes result sent to driver 2020-02-14 16:14:13 TaskSetManager: INFO: Starting task 145.0 in stage 1.0 (TID 146, localhost, executor driver, partition 145, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:14:13 TaskSetManager: INFO: Finished task 144.0 in stage 1.0 (TID 145) in 32904 ms on localhost (executor driver) (145/882) 2020-02-14 16:14:13 Executor: INFO: Running task 145.0 in stage 1.0 (TID 146) 2020-02-14 16:14:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4865392640+33554432 2020-02-14 16:14:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:14:58 Executor: INFO: Finished task 145.0 in stage 1.0 (TID 146). 1659 bytes result sent to driver 2020-02-14 16:14:58 TaskSetManager: INFO: Starting task 146.0 in stage 1.0 (TID 147, localhost, executor driver, partition 146, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:14:58 TaskSetManager: INFO: Finished task 145.0 in stage 1.0 (TID 146) in 45709 ms on localhost (executor driver) (146/882) 2020-02-14 16:14:58 Executor: INFO: Running task 146.0 in stage 1.0 (TID 147) 2020-02-14 16:14:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4898947072+33554432 2020-02-14 16:14:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:15:41 Executor: INFO: Finished task 146.0 in stage 1.0 (TID 147). 1619 bytes result sent to driver 2020-02-14 16:15:41 TaskSetManager: INFO: Starting task 147.0 in stage 1.0 (TID 148, localhost, executor driver, partition 147, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:15:41 TaskSetManager: INFO: Finished task 146.0 in stage 1.0 (TID 147) in 42331 ms on localhost (executor driver) (147/882) 2020-02-14 16:15:41 Executor: INFO: Running task 147.0 in stage 1.0 (TID 148) 2020-02-14 16:15:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4932501504+33554432 2020-02-14 16:15:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:16:37 Executor: INFO: Finished task 147.0 in stage 1.0 (TID 148). 1611 bytes result sent to driver 2020-02-14 16:16:37 TaskSetManager: INFO: Starting task 148.0 in stage 1.0 (TID 149, localhost, executor driver, partition 148, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:16:37 TaskSetManager: INFO: Finished task 147.0 in stage 1.0 (TID 148) in 56500 ms on localhost (executor driver) (148/882) 2020-02-14 16:16:37 Executor: INFO: Running task 148.0 in stage 1.0 (TID 149) 2020-02-14 16:16:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4966055936+33554432 2020-02-14 16:16:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:17:21 Executor: INFO: Finished task 148.0 in stage 1.0 (TID 149). 1602 bytes result sent to driver 2020-02-14 16:17:21 TaskSetManager: INFO: Starting task 149.0 in stage 1.0 (TID 150, localhost, executor driver, partition 149, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:17:21 TaskSetManager: INFO: Finished task 148.0 in stage 1.0 (TID 149) in 43478 ms on localhost (executor driver) (149/882) 2020-02-14 16:17:21 Executor: INFO: Running task 149.0 in stage 1.0 (TID 150) 2020-02-14 16:17:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4999610368+33554432 2020-02-14 16:17:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:18:03 Executor: INFO: Finished task 149.0 in stage 1.0 (TID 150). 1602 bytes result sent to driver 2020-02-14 16:18:03 TaskSetManager: INFO: Starting task 150.0 in stage 1.0 (TID 151, localhost, executor driver, partition 150, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:18:03 TaskSetManager: INFO: Finished task 149.0 in stage 1.0 (TID 150) in 42385 ms on localhost (executor driver) (150/882) 2020-02-14 16:18:03 Executor: INFO: Running task 150.0 in stage 1.0 (TID 151) 2020-02-14 16:18:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5033164800+33554432 2020-02-14 16:18:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:18:54 Executor: INFO: Finished task 150.0 in stage 1.0 (TID 151). 1604 bytes result sent to driver 2020-02-14 16:18:54 TaskSetManager: INFO: Starting task 151.0 in stage 1.0 (TID 152, localhost, executor driver, partition 151, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:18:54 TaskSetManager: INFO: Finished task 150.0 in stage 1.0 (TID 151) in 51185 ms on localhost (executor driver) (151/882) 2020-02-14 16:18:54 Executor: INFO: Running task 151.0 in stage 1.0 (TID 152) 2020-02-14 16:18:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5066719232+33554432 2020-02-14 16:18:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:19:36 Executor: INFO: Finished task 151.0 in stage 1.0 (TID 152). 1602 bytes result sent to driver 2020-02-14 16:19:36 TaskSetManager: INFO: Starting task 152.0 in stage 1.0 (TID 153, localhost, executor driver, partition 152, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:19:36 TaskSetManager: INFO: Finished task 151.0 in stage 1.0 (TID 152) in 41702 ms on localhost (executor driver) (152/882) 2020-02-14 16:19:36 Executor: INFO: Running task 152.0 in stage 1.0 (TID 153) 2020-02-14 16:19:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5100273664+33554432 2020-02-14 16:19:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:20:25 Executor: INFO: Finished task 152.0 in stage 1.0 (TID 153). 1607 bytes result sent to driver 2020-02-14 16:20:25 TaskSetManager: INFO: Starting task 153.0 in stage 1.0 (TID 154, localhost, executor driver, partition 153, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:20:25 TaskSetManager: INFO: Finished task 152.0 in stage 1.0 (TID 153) in 49051 ms on localhost (executor driver) (153/882) 2020-02-14 16:20:25 Executor: INFO: Running task 153.0 in stage 1.0 (TID 154) 2020-02-14 16:20:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5133828096+33554432 2020-02-14 16:20:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:21:18 Executor: INFO: Finished task 153.0 in stage 1.0 (TID 154). 1613 bytes result sent to driver 2020-02-14 16:21:18 TaskSetManager: INFO: Starting task 154.0 in stage 1.0 (TID 155, localhost, executor driver, partition 154, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:21:18 TaskSetManager: INFO: Finished task 153.0 in stage 1.0 (TID 154) in 52632 ms on localhost (executor driver) (154/882) 2020-02-14 16:21:18 Executor: INFO: Running task 154.0 in stage 1.0 (TID 155) 2020-02-14 16:21:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5167382528+33554432 2020-02-14 16:21:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:22:14 Executor: INFO: Finished task 154.0 in stage 1.0 (TID 155). 1602 bytes result sent to driver 2020-02-14 16:22:14 TaskSetManager: INFO: Starting task 155.0 in stage 1.0 (TID 156, localhost, executor driver, partition 155, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:22:14 TaskSetManager: INFO: Finished task 154.0 in stage 1.0 (TID 155) in 55904 ms on localhost (executor driver) (155/882) 2020-02-14 16:22:14 Executor: INFO: Running task 155.0 in stage 1.0 (TID 156) 2020-02-14 16:22:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5200936960+33554432 2020-02-14 16:22:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:23:23 Executor: INFO: Finished task 155.0 in stage 1.0 (TID 156). 1602 bytes result sent to driver 2020-02-14 16:23:23 TaskSetManager: INFO: Starting task 156.0 in stage 1.0 (TID 157, localhost, executor driver, partition 156, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:23:23 TaskSetManager: INFO: Finished task 155.0 in stage 1.0 (TID 156) in 69072 ms on localhost (executor driver) (156/882) 2020-02-14 16:23:23 Executor: INFO: Running task 156.0 in stage 1.0 (TID 157) 2020-02-14 16:23:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5234491392+33554432 2020-02-14 16:23:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:24:20 Executor: INFO: Finished task 156.0 in stage 1.0 (TID 157). 1602 bytes result sent to driver 2020-02-14 16:24:20 TaskSetManager: INFO: Starting task 157.0 in stage 1.0 (TID 158, localhost, executor driver, partition 157, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:24:20 TaskSetManager: INFO: Finished task 156.0 in stage 1.0 (TID 157) in 56792 ms on localhost (executor driver) (157/882) 2020-02-14 16:24:20 Executor: INFO: Running task 157.0 in stage 1.0 (TID 158) 2020-02-14 16:24:20 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5268045824+33554432 2020-02-14 16:24:20 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:25:29 Executor: INFO: Finished task 157.0 in stage 1.0 (TID 158). 1602 bytes result sent to driver 2020-02-14 16:25:29 TaskSetManager: INFO: Starting task 158.0 in stage 1.0 (TID 159, localhost, executor driver, partition 158, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:25:29 TaskSetManager: INFO: Finished task 157.0 in stage 1.0 (TID 158) in 69125 ms on localhost (executor driver) (158/882) 2020-02-14 16:25:29 Executor: INFO: Running task 158.0 in stage 1.0 (TID 159) 2020-02-14 16:25:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5301600256+33554432 2020-02-14 16:25:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:26:26 Executor: INFO: Finished task 158.0 in stage 1.0 (TID 159). 1602 bytes result sent to driver 2020-02-14 16:26:26 TaskSetManager: INFO: Starting task 159.0 in stage 1.0 (TID 160, localhost, executor driver, partition 159, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:26:26 TaskSetManager: INFO: Finished task 158.0 in stage 1.0 (TID 159) in 56882 ms on localhost (executor driver) (159/882) 2020-02-14 16:26:26 Executor: INFO: Running task 159.0 in stage 1.0 (TID 160) 2020-02-14 16:26:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5335154688+33554432 2020-02-14 16:26:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:27:15 Executor: INFO: Finished task 159.0 in stage 1.0 (TID 160). 1606 bytes result sent to driver 2020-02-14 16:27:15 TaskSetManager: INFO: Starting task 160.0 in stage 1.0 (TID 161, localhost, executor driver, partition 160, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:27:15 TaskSetManager: INFO: Finished task 159.0 in stage 1.0 (TID 160) in 49117 ms on localhost (executor driver) (160/882) 2020-02-14 16:27:15 Executor: INFO: Running task 160.0 in stage 1.0 (TID 161) 2020-02-14 16:27:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5368709120+33554432 2020-02-14 16:27:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:27:56 Executor: INFO: Finished task 160.0 in stage 1.0 (TID 161). 1604 bytes result sent to driver 2020-02-14 16:27:56 TaskSetManager: INFO: Starting task 161.0 in stage 1.0 (TID 162, localhost, executor driver, partition 161, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:27:56 TaskSetManager: INFO: Finished task 160.0 in stage 1.0 (TID 161) in 41455 ms on localhost (executor driver) (161/882) 2020-02-14 16:27:56 Executor: INFO: Running task 161.0 in stage 1.0 (TID 162) 2020-02-14 16:27:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5402263552+33554432 2020-02-14 16:27:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:28:39 Executor: INFO: Finished task 161.0 in stage 1.0 (TID 162). 1677 bytes result sent to driver 2020-02-14 16:28:39 TaskSetManager: INFO: Starting task 162.0 in stage 1.0 (TID 163, localhost, executor driver, partition 162, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:28:39 TaskSetManager: INFO: Finished task 161.0 in stage 1.0 (TID 162) in 42515 ms on localhost (executor driver) (162/882) 2020-02-14 16:28:39 Executor: INFO: Running task 162.0 in stage 1.0 (TID 163) 2020-02-14 16:28:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5435817984+33554432 2020-02-14 16:28:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:29:28 Executor: INFO: Finished task 162.0 in stage 1.0 (TID 163). 1652 bytes result sent to driver 2020-02-14 16:29:28 TaskSetManager: INFO: Starting task 163.0 in stage 1.0 (TID 164, localhost, executor driver, partition 163, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:29:28 TaskSetManager: INFO: Finished task 162.0 in stage 1.0 (TID 163) in 49874 ms on localhost (executor driver) (163/882) 2020-02-14 16:29:28 Executor: INFO: Running task 163.0 in stage 1.0 (TID 164) 2020-02-14 16:29:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5469372416+33554432 2020-02-14 16:29:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:30:12 Executor: INFO: Finished task 163.0 in stage 1.0 (TID 164). 1609 bytes result sent to driver 2020-02-14 16:30:12 TaskSetManager: INFO: Starting task 164.0 in stage 1.0 (TID 165, localhost, executor driver, partition 164, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:30:12 TaskSetManager: INFO: Finished task 163.0 in stage 1.0 (TID 164) in 43609 ms on localhost (executor driver) (164/882) 2020-02-14 16:30:12 Executor: INFO: Running task 164.0 in stage 1.0 (TID 165) 2020-02-14 16:30:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5502926848+33554432 2020-02-14 16:30:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:31:01 Executor: INFO: Finished task 164.0 in stage 1.0 (TID 165). 1602 bytes result sent to driver 2020-02-14 16:31:01 TaskSetManager: INFO: Starting task 165.0 in stage 1.0 (TID 166, localhost, executor driver, partition 165, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:31:01 TaskSetManager: INFO: Finished task 164.0 in stage 1.0 (TID 165) in 48618 ms on localhost (executor driver) (165/882) 2020-02-14 16:31:01 Executor: INFO: Running task 165.0 in stage 1.0 (TID 166) 2020-02-14 16:31:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5536481280+33554432 2020-02-14 16:31:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:31:39 Executor: INFO: Finished task 165.0 in stage 1.0 (TID 166). 1657 bytes result sent to driver 2020-02-14 16:31:39 TaskSetManager: INFO: Starting task 166.0 in stage 1.0 (TID 167, localhost, executor driver, partition 166, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:31:39 TaskSetManager: INFO: Finished task 165.0 in stage 1.0 (TID 166) in 37936 ms on localhost (executor driver) (166/882) 2020-02-14 16:31:39 Executor: INFO: Running task 166.0 in stage 1.0 (TID 167) 2020-02-14 16:31:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5570035712+33554432 2020-02-14 16:31:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:32:30 Executor: INFO: Finished task 166.0 in stage 1.0 (TID 167). 1602 bytes result sent to driver 2020-02-14 16:32:30 TaskSetManager: INFO: Starting task 167.0 in stage 1.0 (TID 168, localhost, executor driver, partition 167, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:32:30 TaskSetManager: INFO: Finished task 166.0 in stage 1.0 (TID 167) in 51027 ms on localhost (executor driver) (167/882) 2020-02-14 16:32:30 Executor: INFO: Running task 167.0 in stage 1.0 (TID 168) 2020-02-14 16:32:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5603590144+33554432 2020-02-14 16:32:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:33:27 Executor: INFO: Finished task 167.0 in stage 1.0 (TID 168). 1646 bytes result sent to driver 2020-02-14 16:33:27 TaskSetManager: INFO: Starting task 168.0 in stage 1.0 (TID 169, localhost, executor driver, partition 168, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:33:27 TaskSetManager: INFO: Finished task 167.0 in stage 1.0 (TID 168) in 57805 ms on localhost (executor driver) (168/882) 2020-02-14 16:33:27 Executor: INFO: Running task 168.0 in stage 1.0 (TID 169) 2020-02-14 16:33:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5637144576+33554432 2020-02-14 16:33:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:34:03 Executor: INFO: Finished task 168.0 in stage 1.0 (TID 169). 1618 bytes result sent to driver 2020-02-14 16:34:03 TaskSetManager: INFO: Starting task 169.0 in stage 1.0 (TID 170, localhost, executor driver, partition 169, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:34:03 TaskSetManager: INFO: Finished task 168.0 in stage 1.0 (TID 169) in 35776 ms on localhost (executor driver) (169/882) 2020-02-14 16:34:03 Executor: INFO: Running task 169.0 in stage 1.0 (TID 170) 2020-02-14 16:34:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5670699008+33554432 2020-02-14 16:34:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:35:02 Executor: INFO: Finished task 169.0 in stage 1.0 (TID 170). 1650 bytes result sent to driver 2020-02-14 16:35:02 TaskSetManager: INFO: Starting task 170.0 in stage 1.0 (TID 171, localhost, executor driver, partition 170, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:35:02 TaskSetManager: INFO: Finished task 169.0 in stage 1.0 (TID 170) in 58300 ms on localhost (executor driver) (170/882) 2020-02-14 16:35:02 Executor: INFO: Running task 170.0 in stage 1.0 (TID 171) 2020-02-14 16:35:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5704253440+33554432 2020-02-14 16:35:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:35:56 Executor: INFO: Finished task 170.0 in stage 1.0 (TID 171). 1626 bytes result sent to driver 2020-02-14 16:35:56 TaskSetManager: INFO: Starting task 171.0 in stage 1.0 (TID 172, localhost, executor driver, partition 171, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:35:56 TaskSetManager: INFO: Finished task 170.0 in stage 1.0 (TID 171) in 54483 ms on localhost (executor driver) (171/882) 2020-02-14 16:35:56 Executor: INFO: Running task 171.0 in stage 1.0 (TID 172) 2020-02-14 16:35:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5737807872+33554432 2020-02-14 16:35:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:36:43 Executor: INFO: Finished task 171.0 in stage 1.0 (TID 172). 1671 bytes result sent to driver 2020-02-14 16:36:43 TaskSetManager: INFO: Starting task 172.0 in stage 1.0 (TID 173, localhost, executor driver, partition 172, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:36:43 TaskSetManager: INFO: Finished task 171.0 in stage 1.0 (TID 172) in 46838 ms on localhost (executor driver) (172/882) 2020-02-14 16:36:43 Executor: INFO: Running task 172.0 in stage 1.0 (TID 173) 2020-02-14 16:36:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5771362304+33554432 2020-02-14 16:36:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:37:28 Executor: INFO: Finished task 172.0 in stage 1.0 (TID 173). 1658 bytes result sent to driver 2020-02-14 16:37:28 TaskSetManager: INFO: Starting task 173.0 in stage 1.0 (TID 174, localhost, executor driver, partition 173, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:37:28 TaskSetManager: INFO: Finished task 172.0 in stage 1.0 (TID 173) in 45534 ms on localhost (executor driver) (173/882) 2020-02-14 16:37:28 Executor: INFO: Running task 173.0 in stage 1.0 (TID 174) 2020-02-14 16:37:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5804916736+33554432 2020-02-14 16:37:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:38:28 Executor: INFO: Finished task 173.0 in stage 1.0 (TID 174). 1680 bytes result sent to driver 2020-02-14 16:38:28 TaskSetManager: INFO: Starting task 174.0 in stage 1.0 (TID 175, localhost, executor driver, partition 174, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:38:28 TaskSetManager: INFO: Finished task 173.0 in stage 1.0 (TID 174) in 59746 ms on localhost (executor driver) (174/882) 2020-02-14 16:38:28 Executor: INFO: Running task 174.0 in stage 1.0 (TID 175) 2020-02-14 16:38:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5838471168+33554432 2020-02-14 16:38:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:39:32 Executor: INFO: Finished task 174.0 in stage 1.0 (TID 175). 1607 bytes result sent to driver 2020-02-14 16:39:32 TaskSetManager: INFO: Starting task 175.0 in stage 1.0 (TID 176, localhost, executor driver, partition 175, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:39:32 TaskSetManager: INFO: Finished task 174.0 in stage 1.0 (TID 175) in 63706 ms on localhost (executor driver) (175/882) 2020-02-14 16:39:32 Executor: INFO: Running task 175.0 in stage 1.0 (TID 176) 2020-02-14 16:39:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5872025600+33554432 2020-02-14 16:39:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:40:26 Executor: INFO: Finished task 175.0 in stage 1.0 (TID 176). 1632 bytes result sent to driver 2020-02-14 16:40:26 TaskSetManager: INFO: Starting task 176.0 in stage 1.0 (TID 177, localhost, executor driver, partition 176, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:40:26 TaskSetManager: INFO: Finished task 175.0 in stage 1.0 (TID 176) in 53954 ms on localhost (executor driver) (176/882) 2020-02-14 16:40:26 Executor: INFO: Running task 176.0 in stage 1.0 (TID 177) 2020-02-14 16:40:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5905580032+33554432 2020-02-14 16:40:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:41:03 Executor: INFO: Finished task 176.0 in stage 1.0 (TID 177). 1740 bytes result sent to driver 2020-02-14 16:41:03 TaskSetManager: INFO: Starting task 177.0 in stage 1.0 (TID 178, localhost, executor driver, partition 177, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:41:03 TaskSetManager: INFO: Finished task 176.0 in stage 1.0 (TID 177) in 37145 ms on localhost (executor driver) (177/882) 2020-02-14 16:41:03 Executor: INFO: Running task 177.0 in stage 1.0 (TID 178) 2020-02-14 16:41:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5939134464+33554432 2020-02-14 16:41:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:41:44 Executor: INFO: Finished task 177.0 in stage 1.0 (TID 178). 1614 bytes result sent to driver 2020-02-14 16:41:44 TaskSetManager: INFO: Starting task 178.0 in stage 1.0 (TID 179, localhost, executor driver, partition 178, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:41:44 TaskSetManager: INFO: Finished task 177.0 in stage 1.0 (TID 178) in 40833 ms on localhost (executor driver) (178/882) 2020-02-14 16:41:44 Executor: INFO: Running task 178.0 in stage 1.0 (TID 179) 2020-02-14 16:41:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5972688896+33554432 2020-02-14 16:41:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:42:31 Executor: INFO: Finished task 178.0 in stage 1.0 (TID 179). 1615 bytes result sent to driver 2020-02-14 16:42:31 TaskSetManager: INFO: Starting task 179.0 in stage 1.0 (TID 180, localhost, executor driver, partition 179, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:42:31 TaskSetManager: INFO: Finished task 178.0 in stage 1.0 (TID 179) in 47017 ms on localhost (executor driver) (179/882) 2020-02-14 16:42:31 Executor: INFO: Running task 179.0 in stage 1.0 (TID 180) 2020-02-14 16:42:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6006243328+33554432 2020-02-14 16:42:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:43:17 Executor: INFO: Finished task 179.0 in stage 1.0 (TID 180). 1602 bytes result sent to driver 2020-02-14 16:43:17 TaskSetManager: INFO: Starting task 180.0 in stage 1.0 (TID 181, localhost, executor driver, partition 180, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:43:17 TaskSetManager: INFO: Finished task 179.0 in stage 1.0 (TID 180) in 45889 ms on localhost (executor driver) (180/882) 2020-02-14 16:43:17 Executor: INFO: Running task 180.0 in stage 1.0 (TID 181) 2020-02-14 16:43:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6039797760+33554432 2020-02-14 16:43:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:44:04 Executor: INFO: Finished task 180.0 in stage 1.0 (TID 181). 1609 bytes result sent to driver 2020-02-14 16:44:04 TaskSetManager: INFO: Starting task 181.0 in stage 1.0 (TID 182, localhost, executor driver, partition 181, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:44:04 TaskSetManager: INFO: Finished task 180.0 in stage 1.0 (TID 181) in 47447 ms on localhost (executor driver) (181/882) 2020-02-14 16:44:04 Executor: INFO: Running task 181.0 in stage 1.0 (TID 182) 2020-02-14 16:44:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6073352192+33554432 2020-02-14 16:44:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:44:49 Executor: INFO: Finished task 181.0 in stage 1.0 (TID 182). 1603 bytes result sent to driver 2020-02-14 16:44:49 TaskSetManager: INFO: Starting task 182.0 in stage 1.0 (TID 183, localhost, executor driver, partition 182, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:44:49 TaskSetManager: INFO: Finished task 181.0 in stage 1.0 (TID 182) in 44521 ms on localhost (executor driver) (182/882) 2020-02-14 16:44:49 Executor: INFO: Running task 182.0 in stage 1.0 (TID 183) 2020-02-14 16:44:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6106906624+33554432 2020-02-14 16:44:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:45:35 Executor: INFO: Finished task 182.0 in stage 1.0 (TID 183). 1645 bytes result sent to driver 2020-02-14 16:45:35 TaskSetManager: INFO: Starting task 183.0 in stage 1.0 (TID 184, localhost, executor driver, partition 183, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:45:35 TaskSetManager: INFO: Finished task 182.0 in stage 1.0 (TID 183) in 45929 ms on localhost (executor driver) (183/882) 2020-02-14 16:45:35 Executor: INFO: Running task 183.0 in stage 1.0 (TID 184) 2020-02-14 16:45:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6140461056+33554432 2020-02-14 16:45:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:46:15 Executor: INFO: Finished task 183.0 in stage 1.0 (TID 184). 1635 bytes result sent to driver 2020-02-14 16:46:15 TaskSetManager: INFO: Starting task 184.0 in stage 1.0 (TID 185, localhost, executor driver, partition 184, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:46:15 TaskSetManager: INFO: Finished task 183.0 in stage 1.0 (TID 184) in 39976 ms on localhost (executor driver) (184/882) 2020-02-14 16:46:15 Executor: INFO: Running task 184.0 in stage 1.0 (TID 185) 2020-02-14 16:46:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6174015488+33554432 2020-02-14 16:46:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:47:10 Executor: INFO: Finished task 184.0 in stage 1.0 (TID 185). 1638 bytes result sent to driver 2020-02-14 16:47:10 TaskSetManager: INFO: Starting task 185.0 in stage 1.0 (TID 186, localhost, executor driver, partition 185, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:47:10 TaskSetManager: INFO: Finished task 184.0 in stage 1.0 (TID 185) in 55621 ms on localhost (executor driver) (185/882) 2020-02-14 16:47:10 Executor: INFO: Running task 185.0 in stage 1.0 (TID 186) 2020-02-14 16:47:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6207569920+33554432 2020-02-14 16:47:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:48:05 Executor: INFO: Finished task 185.0 in stage 1.0 (TID 186). 1659 bytes result sent to driver 2020-02-14 16:48:05 TaskSetManager: INFO: Starting task 186.0 in stage 1.0 (TID 187, localhost, executor driver, partition 186, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:48:05 TaskSetManager: INFO: Finished task 185.0 in stage 1.0 (TID 186) in 54880 ms on localhost (executor driver) (186/882) 2020-02-14 16:48:05 Executor: INFO: Running task 186.0 in stage 1.0 (TID 187) 2020-02-14 16:48:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6241124352+33554432 2020-02-14 16:48:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:49:04 Executor: INFO: Finished task 186.0 in stage 1.0 (TID 187). 1603 bytes result sent to driver 2020-02-14 16:49:04 TaskSetManager: INFO: Starting task 187.0 in stage 1.0 (TID 188, localhost, executor driver, partition 187, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:49:04 TaskSetManager: INFO: Finished task 186.0 in stage 1.0 (TID 187) in 58559 ms on localhost (executor driver) (187/882) 2020-02-14 16:49:04 Executor: INFO: Running task 187.0 in stage 1.0 (TID 188) 2020-02-14 16:49:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6274678784+33554432 2020-02-14 16:49:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:49:44 Executor: INFO: Finished task 187.0 in stage 1.0 (TID 188). 1671 bytes result sent to driver 2020-02-14 16:49:44 TaskSetManager: INFO: Starting task 188.0 in stage 1.0 (TID 189, localhost, executor driver, partition 188, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:49:44 TaskSetManager: INFO: Finished task 187.0 in stage 1.0 (TID 188) in 40204 ms on localhost (executor driver) (188/882) 2020-02-14 16:49:44 Executor: INFO: Running task 188.0 in stage 1.0 (TID 189) 2020-02-14 16:49:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6308233216+33554432 2020-02-14 16:49:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:50:51 Executor: INFO: Finished task 188.0 in stage 1.0 (TID 189). 1619 bytes result sent to driver 2020-02-14 16:50:51 TaskSetManager: INFO: Starting task 189.0 in stage 1.0 (TID 190, localhost, executor driver, partition 189, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:50:51 TaskSetManager: INFO: Finished task 188.0 in stage 1.0 (TID 189) in 67467 ms on localhost (executor driver) (189/882) 2020-02-14 16:50:51 Executor: INFO: Running task 189.0 in stage 1.0 (TID 190) 2020-02-14 16:50:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6341787648+33554432 2020-02-14 16:50:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:51:48 Executor: INFO: Finished task 189.0 in stage 1.0 (TID 190). 1613 bytes result sent to driver 2020-02-14 16:51:48 TaskSetManager: INFO: Starting task 190.0 in stage 1.0 (TID 191, localhost, executor driver, partition 190, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:51:48 TaskSetManager: INFO: Finished task 189.0 in stage 1.0 (TID 190) in 56560 ms on localhost (executor driver) (190/882) 2020-02-14 16:51:48 Executor: INFO: Running task 190.0 in stage 1.0 (TID 191) 2020-02-14 16:51:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6375342080+33554432 2020-02-14 16:51:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:52:43 Executor: INFO: Finished task 190.0 in stage 1.0 (TID 191). 1616 bytes result sent to driver 2020-02-14 16:52:43 TaskSetManager: INFO: Starting task 191.0 in stage 1.0 (TID 192, localhost, executor driver, partition 191, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:52:43 TaskSetManager: INFO: Finished task 190.0 in stage 1.0 (TID 191) in 55169 ms on localhost (executor driver) (191/882) 2020-02-14 16:52:43 Executor: INFO: Running task 191.0 in stage 1.0 (TID 192) 2020-02-14 16:52:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6408896512+33554432 2020-02-14 16:52:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:53:34 Executor: INFO: Finished task 191.0 in stage 1.0 (TID 192). 1602 bytes result sent to driver 2020-02-14 16:53:34 TaskSetManager: INFO: Starting task 192.0 in stage 1.0 (TID 193, localhost, executor driver, partition 192, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:53:34 TaskSetManager: INFO: Finished task 191.0 in stage 1.0 (TID 192) in 50764 ms on localhost (executor driver) (192/882) 2020-02-14 16:53:34 Executor: INFO: Running task 192.0 in stage 1.0 (TID 193) 2020-02-14 16:53:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6442450944+33554432 2020-02-14 16:53:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:54:30 Executor: INFO: Finished task 192.0 in stage 1.0 (TID 193). 1611 bytes result sent to driver 2020-02-14 16:54:30 TaskSetManager: INFO: Starting task 193.0 in stage 1.0 (TID 194, localhost, executor driver, partition 193, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:54:30 TaskSetManager: INFO: Finished task 192.0 in stage 1.0 (TID 193) in 56105 ms on localhost (executor driver) (193/882) 2020-02-14 16:54:30 Executor: INFO: Running task 193.0 in stage 1.0 (TID 194) 2020-02-14 16:54:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6476005376+33554432 2020-02-14 16:54:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:55:25 Executor: INFO: Finished task 193.0 in stage 1.0 (TID 194). 1610 bytes result sent to driver 2020-02-14 16:55:25 TaskSetManager: INFO: Starting task 194.0 in stage 1.0 (TID 195, localhost, executor driver, partition 194, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:55:25 TaskSetManager: INFO: Finished task 193.0 in stage 1.0 (TID 194) in 55042 ms on localhost (executor driver) (194/882) 2020-02-14 16:55:25 Executor: INFO: Running task 194.0 in stage 1.0 (TID 195) 2020-02-14 16:55:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6509559808+33554432 2020-02-14 16:55:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:56:17 Executor: INFO: Finished task 194.0 in stage 1.0 (TID 195). 1622 bytes result sent to driver 2020-02-14 16:56:17 TaskSetManager: INFO: Starting task 195.0 in stage 1.0 (TID 196, localhost, executor driver, partition 195, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:56:17 TaskSetManager: INFO: Finished task 194.0 in stage 1.0 (TID 195) in 52216 ms on localhost (executor driver) (195/882) 2020-02-14 16:56:17 Executor: INFO: Running task 195.0 in stage 1.0 (TID 196) 2020-02-14 16:56:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6543114240+33554432 2020-02-14 16:56:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:57:04 Executor: INFO: Finished task 195.0 in stage 1.0 (TID 196). 1602 bytes result sent to driver 2020-02-14 16:57:04 TaskSetManager: INFO: Starting task 196.0 in stage 1.0 (TID 197, localhost, executor driver, partition 196, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:57:04 TaskSetManager: INFO: Finished task 195.0 in stage 1.0 (TID 196) in 46809 ms on localhost (executor driver) (196/882) 2020-02-14 16:57:04 Executor: INFO: Running task 196.0 in stage 1.0 (TID 197) 2020-02-14 16:57:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6576668672+33554432 2020-02-14 16:57:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:57:47 Executor: INFO: Finished task 196.0 in stage 1.0 (TID 197). 1602 bytes result sent to driver 2020-02-14 16:57:47 TaskSetManager: INFO: Starting task 197.0 in stage 1.0 (TID 198, localhost, executor driver, partition 197, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:57:47 TaskSetManager: INFO: Finished task 196.0 in stage 1.0 (TID 197) in 43358 ms on localhost (executor driver) (197/882) 2020-02-14 16:57:47 Executor: INFO: Running task 197.0 in stage 1.0 (TID 198) 2020-02-14 16:57:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6610223104+33554432 2020-02-14 16:57:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:58:39 Executor: INFO: Finished task 197.0 in stage 1.0 (TID 198). 1617 bytes result sent to driver 2020-02-14 16:58:39 TaskSetManager: INFO: Starting task 198.0 in stage 1.0 (TID 199, localhost, executor driver, partition 198, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:58:39 TaskSetManager: INFO: Finished task 197.0 in stage 1.0 (TID 198) in 51739 ms on localhost (executor driver) (198/882) 2020-02-14 16:58:39 Executor: INFO: Running task 198.0 in stage 1.0 (TID 199) 2020-02-14 16:58:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6643777536+33554432 2020-02-14 16:58:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 16:59:33 Executor: INFO: Finished task 198.0 in stage 1.0 (TID 199). 1738 bytes result sent to driver 2020-02-14 16:59:33 TaskSetManager: INFO: Starting task 199.0 in stage 1.0 (TID 200, localhost, executor driver, partition 199, PROCESS_LOCAL, 7933 bytes) 2020-02-14 16:59:33 TaskSetManager: INFO: Finished task 198.0 in stage 1.0 (TID 199) in 53791 ms on localhost (executor driver) (199/882) 2020-02-14 16:59:33 Executor: INFO: Running task 199.0 in stage 1.0 (TID 200) 2020-02-14 16:59:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6677331968+33554432 2020-02-14 16:59:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:00:18 Executor: INFO: Finished task 199.0 in stage 1.0 (TID 200). 1602 bytes result sent to driver 2020-02-14 17:00:18 TaskSetManager: INFO: Starting task 200.0 in stage 1.0 (TID 201, localhost, executor driver, partition 200, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:00:18 TaskSetManager: INFO: Finished task 199.0 in stage 1.0 (TID 200) in 44771 ms on localhost (executor driver) (200/882) 2020-02-14 17:00:18 Executor: INFO: Running task 200.0 in stage 1.0 (TID 201) 2020-02-14 17:00:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6710886400+33554432 2020-02-14 17:00:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:00:59 Executor: INFO: Finished task 200.0 in stage 1.0 (TID 201). 1645 bytes result sent to driver 2020-02-14 17:00:59 TaskSetManager: INFO: Starting task 201.0 in stage 1.0 (TID 202, localhost, executor driver, partition 201, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:00:59 TaskSetManager: INFO: Finished task 200.0 in stage 1.0 (TID 201) in 41373 ms on localhost (executor driver) (201/882) 2020-02-14 17:00:59 Executor: INFO: Running task 201.0 in stage 1.0 (TID 202) 2020-02-14 17:00:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6744440832+33554432 2020-02-14 17:00:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:01:47 Executor: INFO: Finished task 201.0 in stage 1.0 (TID 202). 1611 bytes result sent to driver 2020-02-14 17:01:47 TaskSetManager: INFO: Starting task 202.0 in stage 1.0 (TID 203, localhost, executor driver, partition 202, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:01:47 TaskSetManager: INFO: Finished task 201.0 in stage 1.0 (TID 202) in 47903 ms on localhost (executor driver) (202/882) 2020-02-14 17:01:47 Executor: INFO: Running task 202.0 in stage 1.0 (TID 203) 2020-02-14 17:01:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6777995264+33554432 2020-02-14 17:01:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:02:28 Executor: INFO: Finished task 202.0 in stage 1.0 (TID 203). 1607 bytes result sent to driver 2020-02-14 17:02:28 TaskSetManager: INFO: Starting task 203.0 in stage 1.0 (TID 204, localhost, executor driver, partition 203, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:02:28 TaskSetManager: INFO: Finished task 202.0 in stage 1.0 (TID 203) in 41041 ms on localhost (executor driver) (203/882) 2020-02-14 17:02:28 Executor: INFO: Running task 203.0 in stage 1.0 (TID 204) 2020-02-14 17:02:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6811549696+33554432 2020-02-14 17:02:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:03:12 Executor: INFO: Finished task 203.0 in stage 1.0 (TID 204). 1602 bytes result sent to driver 2020-02-14 17:03:12 TaskSetManager: INFO: Starting task 204.0 in stage 1.0 (TID 205, localhost, executor driver, partition 204, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:03:12 TaskSetManager: INFO: Finished task 203.0 in stage 1.0 (TID 204) in 43641 ms on localhost (executor driver) (204/882) 2020-02-14 17:03:12 Executor: INFO: Running task 204.0 in stage 1.0 (TID 205) 2020-02-14 17:03:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6845104128+33554432 2020-02-14 17:03:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:03:50 Executor: INFO: Finished task 204.0 in stage 1.0 (TID 205). 1645 bytes result sent to driver 2020-02-14 17:03:50 TaskSetManager: INFO: Starting task 205.0 in stage 1.0 (TID 206, localhost, executor driver, partition 205, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:03:50 TaskSetManager: INFO: Finished task 204.0 in stage 1.0 (TID 205) in 38323 ms on localhost (executor driver) (205/882) 2020-02-14 17:03:50 Executor: INFO: Running task 205.0 in stage 1.0 (TID 206) 2020-02-14 17:03:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6878658560+33554432 2020-02-14 17:03:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:04:36 Executor: INFO: Finished task 205.0 in stage 1.0 (TID 206). 1645 bytes result sent to driver 2020-02-14 17:04:36 TaskSetManager: INFO: Starting task 206.0 in stage 1.0 (TID 207, localhost, executor driver, partition 206, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:04:36 TaskSetManager: INFO: Finished task 205.0 in stage 1.0 (TID 206) in 45823 ms on localhost (executor driver) (206/882) 2020-02-14 17:04:36 Executor: INFO: Running task 206.0 in stage 1.0 (TID 207) 2020-02-14 17:04:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6912212992+33554432 2020-02-14 17:04:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:05:17 Executor: INFO: Finished task 206.0 in stage 1.0 (TID 207). 1618 bytes result sent to driver 2020-02-14 17:05:17 TaskSetManager: INFO: Starting task 207.0 in stage 1.0 (TID 208, localhost, executor driver, partition 207, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:05:17 TaskSetManager: INFO: Finished task 206.0 in stage 1.0 (TID 207) in 41228 ms on localhost (executor driver) (207/882) 2020-02-14 17:05:17 Executor: INFO: Running task 207.0 in stage 1.0 (TID 208) 2020-02-14 17:05:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6945767424+33554432 2020-02-14 17:05:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:06:06 Executor: INFO: Finished task 207.0 in stage 1.0 (TID 208). 1604 bytes result sent to driver 2020-02-14 17:06:06 TaskSetManager: INFO: Starting task 208.0 in stage 1.0 (TID 209, localhost, executor driver, partition 208, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:06:06 TaskSetManager: INFO: Finished task 207.0 in stage 1.0 (TID 208) in 48769 ms on localhost (executor driver) (208/882) 2020-02-14 17:06:06 Executor: INFO: Running task 208.0 in stage 1.0 (TID 209) 2020-02-14 17:06:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6979321856+33554432 2020-02-14 17:06:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:07:09 Executor: INFO: Finished task 208.0 in stage 1.0 (TID 209). 1645 bytes result sent to driver 2020-02-14 17:07:09 TaskSetManager: INFO: Starting task 209.0 in stage 1.0 (TID 210, localhost, executor driver, partition 209, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:07:09 TaskSetManager: INFO: Finished task 208.0 in stage 1.0 (TID 209) in 63137 ms on localhost (executor driver) (209/882) 2020-02-14 17:07:09 Executor: INFO: Running task 209.0 in stage 1.0 (TID 210) 2020-02-14 17:07:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7012876288+33554432 2020-02-14 17:07:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:08:04 Executor: INFO: Finished task 209.0 in stage 1.0 (TID 210). 1641 bytes result sent to driver 2020-02-14 17:08:04 TaskSetManager: INFO: Starting task 210.0 in stage 1.0 (TID 211, localhost, executor driver, partition 210, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:08:04 TaskSetManager: INFO: Finished task 209.0 in stage 1.0 (TID 210) in 55358 ms on localhost (executor driver) (210/882) 2020-02-14 17:08:04 Executor: INFO: Running task 210.0 in stage 1.0 (TID 211) 2020-02-14 17:08:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7046430720+33554432 2020-02-14 17:08:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:08:48 Executor: INFO: Finished task 210.0 in stage 1.0 (TID 211). 1602 bytes result sent to driver 2020-02-14 17:08:48 TaskSetManager: INFO: Starting task 211.0 in stage 1.0 (TID 212, localhost, executor driver, partition 211, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:08:48 TaskSetManager: INFO: Finished task 210.0 in stage 1.0 (TID 211) in 43693 ms on localhost (executor driver) (211/882) 2020-02-14 17:08:48 Executor: INFO: Running task 211.0 in stage 1.0 (TID 212) 2020-02-14 17:08:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7079985152+33554432 2020-02-14 17:08:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:09:54 Executor: INFO: Finished task 211.0 in stage 1.0 (TID 212). 1602 bytes result sent to driver 2020-02-14 17:09:54 TaskSetManager: INFO: Starting task 212.0 in stage 1.0 (TID 213, localhost, executor driver, partition 212, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:09:54 TaskSetManager: INFO: Finished task 211.0 in stage 1.0 (TID 212) in 65999 ms on localhost (executor driver) (212/882) 2020-02-14 17:09:54 Executor: INFO: Running task 212.0 in stage 1.0 (TID 213) 2020-02-14 17:09:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7113539584+33554432 2020-02-14 17:09:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:11:05 Executor: INFO: Finished task 212.0 in stage 1.0 (TID 213). 1670 bytes result sent to driver 2020-02-14 17:11:05 TaskSetManager: INFO: Starting task 213.0 in stage 1.0 (TID 214, localhost, executor driver, partition 213, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:11:05 TaskSetManager: INFO: Finished task 212.0 in stage 1.0 (TID 213) in 71133 ms on localhost (executor driver) (213/882) 2020-02-14 17:11:05 Executor: INFO: Running task 213.0 in stage 1.0 (TID 214) 2020-02-14 17:11:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7147094016+33554432 2020-02-14 17:11:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:12:03 Executor: INFO: Finished task 213.0 in stage 1.0 (TID 214). 1645 bytes result sent to driver 2020-02-14 17:12:03 TaskSetManager: INFO: Starting task 214.0 in stage 1.0 (TID 215, localhost, executor driver, partition 214, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:12:03 TaskSetManager: INFO: Finished task 213.0 in stage 1.0 (TID 214) in 57902 ms on localhost (executor driver) (214/882) 2020-02-14 17:12:03 Executor: INFO: Running task 214.0 in stage 1.0 (TID 215) 2020-02-14 17:12:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7180648448+33554432 2020-02-14 17:12:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:13:05 Executor: INFO: Finished task 214.0 in stage 1.0 (TID 215). 1614 bytes result sent to driver 2020-02-14 17:13:05 TaskSetManager: INFO: Starting task 215.0 in stage 1.0 (TID 216, localhost, executor driver, partition 215, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:13:05 TaskSetManager: INFO: Finished task 214.0 in stage 1.0 (TID 215) in 62081 ms on localhost (executor driver) (215/882) 2020-02-14 17:13:05 Executor: INFO: Running task 215.0 in stage 1.0 (TID 216) 2020-02-14 17:13:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7214202880+33554432 2020-02-14 17:13:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:14:18 Executor: INFO: Finished task 215.0 in stage 1.0 (TID 216). 1605 bytes result sent to driver 2020-02-14 17:14:18 TaskSetManager: INFO: Starting task 216.0 in stage 1.0 (TID 217, localhost, executor driver, partition 216, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:14:18 TaskSetManager: INFO: Finished task 215.0 in stage 1.0 (TID 216) in 72650 ms on localhost (executor driver) (216/882) 2020-02-14 17:14:18 Executor: INFO: Running task 216.0 in stage 1.0 (TID 217) 2020-02-14 17:14:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7247757312+33554432 2020-02-14 17:14:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:15:28 Executor: INFO: Finished task 216.0 in stage 1.0 (TID 217). 1625 bytes result sent to driver 2020-02-14 17:15:28 TaskSetManager: INFO: Starting task 217.0 in stage 1.0 (TID 218, localhost, executor driver, partition 217, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:15:28 TaskSetManager: INFO: Finished task 216.0 in stage 1.0 (TID 217) in 70050 ms on localhost (executor driver) (217/882) 2020-02-14 17:15:28 Executor: INFO: Running task 217.0 in stage 1.0 (TID 218) 2020-02-14 17:15:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7281311744+33554432 2020-02-14 17:15:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:16:33 Executor: INFO: Finished task 217.0 in stage 1.0 (TID 218). 1602 bytes result sent to driver 2020-02-14 17:16:33 TaskSetManager: INFO: Starting task 218.0 in stage 1.0 (TID 219, localhost, executor driver, partition 218, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:16:33 TaskSetManager: INFO: Finished task 217.0 in stage 1.0 (TID 218) in 65484 ms on localhost (executor driver) (218/882) 2020-02-14 17:16:33 Executor: INFO: Running task 218.0 in stage 1.0 (TID 219) 2020-02-14 17:16:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7314866176+33554432 2020-02-14 17:16:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:17:40 Executor: INFO: Finished task 218.0 in stage 1.0 (TID 219). 1602 bytes result sent to driver 2020-02-14 17:17:40 TaskSetManager: INFO: Starting task 219.0 in stage 1.0 (TID 220, localhost, executor driver, partition 219, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:17:40 TaskSetManager: INFO: Finished task 218.0 in stage 1.0 (TID 219) in 66758 ms on localhost (executor driver) (219/882) 2020-02-14 17:17:40 Executor: INFO: Running task 219.0 in stage 1.0 (TID 220) 2020-02-14 17:17:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7348420608+33554432 2020-02-14 17:17:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:18:44 Executor: INFO: Finished task 219.0 in stage 1.0 (TID 220). 1609 bytes result sent to driver 2020-02-14 17:18:44 TaskSetManager: INFO: Starting task 220.0 in stage 1.0 (TID 221, localhost, executor driver, partition 220, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:18:44 TaskSetManager: INFO: Finished task 219.0 in stage 1.0 (TID 220) in 63612 ms on localhost (executor driver) (220/882) 2020-02-14 17:18:44 Executor: INFO: Running task 220.0 in stage 1.0 (TID 221) 2020-02-14 17:18:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7381975040+33554432 2020-02-14 17:18:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:19:33 Executor: INFO: Finished task 220.0 in stage 1.0 (TID 221). 1655 bytes result sent to driver 2020-02-14 17:19:33 TaskSetManager: INFO: Starting task 221.0 in stage 1.0 (TID 222, localhost, executor driver, partition 221, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:19:33 TaskSetManager: INFO: Finished task 220.0 in stage 1.0 (TID 221) in 49503 ms on localhost (executor driver) (221/882) 2020-02-14 17:19:33 Executor: INFO: Running task 221.0 in stage 1.0 (TID 222) 2020-02-14 17:19:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7415529472+33554432 2020-02-14 17:19:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:20:32 Executor: INFO: Finished task 221.0 in stage 1.0 (TID 222). 1645 bytes result sent to driver 2020-02-14 17:20:32 TaskSetManager: INFO: Starting task 222.0 in stage 1.0 (TID 223, localhost, executor driver, partition 222, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:20:32 TaskSetManager: INFO: Finished task 221.0 in stage 1.0 (TID 222) in 58768 ms on localhost (executor driver) (222/882) 2020-02-14 17:20:32 Executor: INFO: Running task 222.0 in stage 1.0 (TID 223) 2020-02-14 17:20:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7449083904+33554432 2020-02-14 17:20:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:21:22 Executor: INFO: Finished task 222.0 in stage 1.0 (TID 223). 1626 bytes result sent to driver 2020-02-14 17:21:22 TaskSetManager: INFO: Starting task 223.0 in stage 1.0 (TID 224, localhost, executor driver, partition 223, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:21:22 TaskSetManager: INFO: Finished task 222.0 in stage 1.0 (TID 223) in 50695 ms on localhost (executor driver) (223/882) 2020-02-14 17:21:22 Executor: INFO: Running task 223.0 in stage 1.0 (TID 224) 2020-02-14 17:21:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7482638336+33554432 2020-02-14 17:21:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:22:14 Executor: INFO: Finished task 223.0 in stage 1.0 (TID 224). 1602 bytes result sent to driver 2020-02-14 17:22:14 TaskSetManager: INFO: Starting task 224.0 in stage 1.0 (TID 225, localhost, executor driver, partition 224, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:22:14 TaskSetManager: INFO: Finished task 223.0 in stage 1.0 (TID 224) in 51717 ms on localhost (executor driver) (224/882) 2020-02-14 17:22:14 Executor: INFO: Running task 224.0 in stage 1.0 (TID 225) 2020-02-14 17:22:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7516192768+33554432 2020-02-14 17:22:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:23:09 Executor: INFO: Finished task 224.0 in stage 1.0 (TID 225). 1606 bytes result sent to driver 2020-02-14 17:23:09 TaskSetManager: INFO: Starting task 225.0 in stage 1.0 (TID 226, localhost, executor driver, partition 225, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:23:09 TaskSetManager: INFO: Finished task 224.0 in stage 1.0 (TID 225) in 54580 ms on localhost (executor driver) (225/882) 2020-02-14 17:23:09 Executor: INFO: Running task 225.0 in stage 1.0 (TID 226) 2020-02-14 17:23:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7549747200+33554432 2020-02-14 17:23:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:23:57 Executor: INFO: Finished task 225.0 in stage 1.0 (TID 226). 1607 bytes result sent to driver 2020-02-14 17:23:57 TaskSetManager: INFO: Starting task 226.0 in stage 1.0 (TID 227, localhost, executor driver, partition 226, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:23:57 TaskSetManager: INFO: Finished task 225.0 in stage 1.0 (TID 226) in 48057 ms on localhost (executor driver) (226/882) 2020-02-14 17:23:57 Executor: INFO: Running task 226.0 in stage 1.0 (TID 227) 2020-02-14 17:23:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7583301632+33554432 2020-02-14 17:23:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:24:44 Executor: INFO: Finished task 226.0 in stage 1.0 (TID 227). 1605 bytes result sent to driver 2020-02-14 17:24:44 TaskSetManager: INFO: Starting task 227.0 in stage 1.0 (TID 228, localhost, executor driver, partition 227, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:24:44 TaskSetManager: INFO: Finished task 226.0 in stage 1.0 (TID 227) in 47562 ms on localhost (executor driver) (227/882) 2020-02-14 17:24:44 Executor: INFO: Running task 227.0 in stage 1.0 (TID 228) 2020-02-14 17:24:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7616856064+33554432 2020-02-14 17:24:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:25:34 Executor: INFO: Finished task 227.0 in stage 1.0 (TID 228). 1609 bytes result sent to driver 2020-02-14 17:25:34 TaskSetManager: INFO: Starting task 228.0 in stage 1.0 (TID 229, localhost, executor driver, partition 228, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:25:34 TaskSetManager: INFO: Finished task 227.0 in stage 1.0 (TID 228) in 49297 ms on localhost (executor driver) (228/882) 2020-02-14 17:25:34 Executor: INFO: Running task 228.0 in stage 1.0 (TID 229) 2020-02-14 17:25:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7650410496+33554432 2020-02-14 17:25:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:26:15 Executor: INFO: Finished task 228.0 in stage 1.0 (TID 229). 1624 bytes result sent to driver 2020-02-14 17:26:15 TaskSetManager: INFO: Starting task 229.0 in stage 1.0 (TID 230, localhost, executor driver, partition 229, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:26:15 TaskSetManager: INFO: Finished task 228.0 in stage 1.0 (TID 229) in 40889 ms on localhost (executor driver) (229/882) 2020-02-14 17:26:15 Executor: INFO: Running task 229.0 in stage 1.0 (TID 230) 2020-02-14 17:26:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7683964928+33554432 2020-02-14 17:26:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:26:51 Executor: INFO: Finished task 229.0 in stage 1.0 (TID 230). 1624 bytes result sent to driver 2020-02-14 17:26:51 TaskSetManager: INFO: Starting task 230.0 in stage 1.0 (TID 231, localhost, executor driver, partition 230, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:26:51 TaskSetManager: INFO: Finished task 229.0 in stage 1.0 (TID 230) in 36352 ms on localhost (executor driver) (230/882) 2020-02-14 17:26:51 Executor: INFO: Running task 230.0 in stage 1.0 (TID 231) 2020-02-14 17:26:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7717519360+33554432 2020-02-14 17:26:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:27:34 Executor: INFO: Finished task 230.0 in stage 1.0 (TID 231). 1602 bytes result sent to driver 2020-02-14 17:27:34 TaskSetManager: INFO: Starting task 231.0 in stage 1.0 (TID 232, localhost, executor driver, partition 231, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:27:34 TaskSetManager: INFO: Finished task 230.0 in stage 1.0 (TID 231) in 42686 ms on localhost (executor driver) (231/882) 2020-02-14 17:27:34 Executor: INFO: Running task 231.0 in stage 1.0 (TID 232) 2020-02-14 17:27:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7751073792+33554432 2020-02-14 17:27:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:28:31 Executor: INFO: Finished task 231.0 in stage 1.0 (TID 232). 1617 bytes result sent to driver 2020-02-14 17:28:31 TaskSetManager: INFO: Starting task 232.0 in stage 1.0 (TID 233, localhost, executor driver, partition 232, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:28:31 TaskSetManager: INFO: Finished task 231.0 in stage 1.0 (TID 232) in 57164 ms on localhost (executor driver) (232/882) 2020-02-14 17:28:31 Executor: INFO: Running task 232.0 in stage 1.0 (TID 233) 2020-02-14 17:28:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7784628224+33554432 2020-02-14 17:28:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:29:26 Executor: INFO: Finished task 232.0 in stage 1.0 (TID 233). 1602 bytes result sent to driver 2020-02-14 17:29:26 TaskSetManager: INFO: Starting task 233.0 in stage 1.0 (TID 234, localhost, executor driver, partition 233, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:29:26 TaskSetManager: INFO: Finished task 232.0 in stage 1.0 (TID 233) in 54826 ms on localhost (executor driver) (233/882) 2020-02-14 17:29:26 Executor: INFO: Running task 233.0 in stage 1.0 (TID 234) 2020-02-14 17:29:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7818182656+33554432 2020-02-14 17:29:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:30:22 Executor: INFO: Finished task 233.0 in stage 1.0 (TID 234). 1602 bytes result sent to driver 2020-02-14 17:30:22 TaskSetManager: INFO: Starting task 234.0 in stage 1.0 (TID 235, localhost, executor driver, partition 234, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:30:22 TaskSetManager: INFO: Finished task 233.0 in stage 1.0 (TID 234) in 56048 ms on localhost (executor driver) (234/882) 2020-02-14 17:30:22 Executor: INFO: Running task 234.0 in stage 1.0 (TID 235) 2020-02-14 17:30:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7851737088+33554432 2020-02-14 17:30:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:31:22 Executor: INFO: Finished task 234.0 in stage 1.0 (TID 235). 1628 bytes result sent to driver 2020-02-14 17:31:22 TaskSetManager: INFO: Starting task 235.0 in stage 1.0 (TID 236, localhost, executor driver, partition 235, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:31:22 TaskSetManager: INFO: Finished task 234.0 in stage 1.0 (TID 235) in 60080 ms on localhost (executor driver) (235/882) 2020-02-14 17:31:22 Executor: INFO: Running task 235.0 in stage 1.0 (TID 236) 2020-02-14 17:31:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7885291520+33554432 2020-02-14 17:31:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:32:06 Executor: INFO: Finished task 235.0 in stage 1.0 (TID 236). 1639 bytes result sent to driver 2020-02-14 17:32:06 TaskSetManager: INFO: Starting task 236.0 in stage 1.0 (TID 237, localhost, executor driver, partition 236, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:32:06 TaskSetManager: INFO: Finished task 235.0 in stage 1.0 (TID 236) in 44356 ms on localhost (executor driver) (236/882) 2020-02-14 17:32:06 Executor: INFO: Running task 236.0 in stage 1.0 (TID 237) 2020-02-14 17:32:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7918845952+33554432 2020-02-14 17:32:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:32:45 Executor: INFO: Finished task 236.0 in stage 1.0 (TID 237). 1612 bytes result sent to driver 2020-02-14 17:32:45 TaskSetManager: INFO: Starting task 237.0 in stage 1.0 (TID 238, localhost, executor driver, partition 237, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:32:45 TaskSetManager: INFO: Finished task 236.0 in stage 1.0 (TID 237) in 38569 ms on localhost (executor driver) (237/882) 2020-02-14 17:32:45 Executor: INFO: Running task 237.0 in stage 1.0 (TID 238) 2020-02-14 17:32:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7952400384+33554432 2020-02-14 17:32:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:33:41 Executor: INFO: Finished task 237.0 in stage 1.0 (TID 238). 1603 bytes result sent to driver 2020-02-14 17:33:41 TaskSetManager: INFO: Starting task 238.0 in stage 1.0 (TID 239, localhost, executor driver, partition 238, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:33:41 TaskSetManager: INFO: Finished task 237.0 in stage 1.0 (TID 238) in 56294 ms on localhost (executor driver) (238/882) 2020-02-14 17:33:41 Executor: INFO: Running task 238.0 in stage 1.0 (TID 239) 2020-02-14 17:33:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7985954816+33554432 2020-02-14 17:33:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:34:42 Executor: INFO: Finished task 238.0 in stage 1.0 (TID 239). 1605 bytes result sent to driver 2020-02-14 17:34:42 TaskSetManager: INFO: Starting task 239.0 in stage 1.0 (TID 240, localhost, executor driver, partition 239, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:34:42 TaskSetManager: INFO: Finished task 238.0 in stage 1.0 (TID 239) in 60688 ms on localhost (executor driver) (239/882) 2020-02-14 17:34:42 Executor: INFO: Running task 239.0 in stage 1.0 (TID 240) 2020-02-14 17:34:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8019509248+33554432 2020-02-14 17:34:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:35:50 Executor: INFO: Finished task 239.0 in stage 1.0 (TID 240). 1602 bytes result sent to driver 2020-02-14 17:35:50 TaskSetManager: INFO: Starting task 240.0 in stage 1.0 (TID 241, localhost, executor driver, partition 240, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:35:50 TaskSetManager: INFO: Finished task 239.0 in stage 1.0 (TID 240) in 67885 ms on localhost (executor driver) (240/882) 2020-02-14 17:35:50 Executor: INFO: Running task 240.0 in stage 1.0 (TID 241) 2020-02-14 17:35:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8053063680+33554432 2020-02-14 17:35:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:36:45 Executor: INFO: Finished task 240.0 in stage 1.0 (TID 241). 1645 bytes result sent to driver 2020-02-14 17:36:45 TaskSetManager: INFO: Starting task 241.0 in stage 1.0 (TID 242, localhost, executor driver, partition 241, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:36:45 TaskSetManager: INFO: Finished task 240.0 in stage 1.0 (TID 241) in 55258 ms on localhost (executor driver) (241/882) 2020-02-14 17:36:45 Executor: INFO: Running task 241.0 in stage 1.0 (TID 242) 2020-02-14 17:36:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8086618112+33554432 2020-02-14 17:36:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:37:51 Executor: INFO: Finished task 241.0 in stage 1.0 (TID 242). 1602 bytes result sent to driver 2020-02-14 17:37:51 TaskSetManager: INFO: Starting task 242.0 in stage 1.0 (TID 243, localhost, executor driver, partition 242, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:37:51 TaskSetManager: INFO: Finished task 241.0 in stage 1.0 (TID 242) in 66373 ms on localhost (executor driver) (242/882) 2020-02-14 17:37:51 Executor: INFO: Running task 242.0 in stage 1.0 (TID 243) 2020-02-14 17:37:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8120172544+33554432 2020-02-14 17:37:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:38:54 Executor: INFO: Finished task 242.0 in stage 1.0 (TID 243). 1607 bytes result sent to driver 2020-02-14 17:38:54 TaskSetManager: INFO: Starting task 243.0 in stage 1.0 (TID 244, localhost, executor driver, partition 243, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:38:54 TaskSetManager: INFO: Finished task 242.0 in stage 1.0 (TID 243) in 62453 ms on localhost (executor driver) (243/882) 2020-02-14 17:38:54 Executor: INFO: Running task 243.0 in stage 1.0 (TID 244) 2020-02-14 17:38:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8153726976+33554432 2020-02-14 17:38:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:39:48 Executor: INFO: Finished task 243.0 in stage 1.0 (TID 244). 1645 bytes result sent to driver 2020-02-14 17:39:48 TaskSetManager: INFO: Starting task 244.0 in stage 1.0 (TID 245, localhost, executor driver, partition 244, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:39:48 TaskSetManager: INFO: Finished task 243.0 in stage 1.0 (TID 244) in 54645 ms on localhost (executor driver) (244/882) 2020-02-14 17:39:48 Executor: INFO: Running task 244.0 in stage 1.0 (TID 245) 2020-02-14 17:39:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8187281408+33554432 2020-02-14 17:39:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:40:56 Executor: INFO: Finished task 244.0 in stage 1.0 (TID 245). 1602 bytes result sent to driver 2020-02-14 17:40:56 TaskSetManager: INFO: Starting task 245.0 in stage 1.0 (TID 246, localhost, executor driver, partition 245, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:40:56 TaskSetManager: INFO: Finished task 244.0 in stage 1.0 (TID 245) in 67729 ms on localhost (executor driver) (245/882) 2020-02-14 17:40:56 Executor: INFO: Running task 245.0 in stage 1.0 (TID 246) 2020-02-14 17:40:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8220835840+33554432 2020-02-14 17:40:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:41:59 Executor: INFO: Finished task 245.0 in stage 1.0 (TID 246). 1622 bytes result sent to driver 2020-02-14 17:41:59 TaskSetManager: INFO: Starting task 246.0 in stage 1.0 (TID 247, localhost, executor driver, partition 246, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:41:59 TaskSetManager: INFO: Finished task 245.0 in stage 1.0 (TID 246) in 63220 ms on localhost (executor driver) (246/882) 2020-02-14 17:41:59 Executor: INFO: Running task 246.0 in stage 1.0 (TID 247) 2020-02-14 17:41:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8254390272+33554432 2020-02-14 17:41:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:42:57 Executor: INFO: Finished task 246.0 in stage 1.0 (TID 247). 1603 bytes result sent to driver 2020-02-14 17:42:57 TaskSetManager: INFO: Starting task 247.0 in stage 1.0 (TID 248, localhost, executor driver, partition 247, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:42:57 TaskSetManager: INFO: Finished task 246.0 in stage 1.0 (TID 247) in 57967 ms on localhost (executor driver) (247/882) 2020-02-14 17:42:57 Executor: INFO: Running task 247.0 in stage 1.0 (TID 248) 2020-02-14 17:42:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8287944704+33554432 2020-02-14 17:42:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:43:56 Executor: INFO: Finished task 247.0 in stage 1.0 (TID 248). 1605 bytes result sent to driver 2020-02-14 17:43:56 TaskSetManager: INFO: Starting task 248.0 in stage 1.0 (TID 249, localhost, executor driver, partition 248, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:43:56 TaskSetManager: INFO: Finished task 247.0 in stage 1.0 (TID 248) in 58864 ms on localhost (executor driver) (248/882) 2020-02-14 17:43:56 Executor: INFO: Running task 248.0 in stage 1.0 (TID 249) 2020-02-14 17:43:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8321499136+33554432 2020-02-14 17:43:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:45:01 Executor: INFO: Finished task 248.0 in stage 1.0 (TID 249). 1602 bytes result sent to driver 2020-02-14 17:45:01 TaskSetManager: INFO: Starting task 249.0 in stage 1.0 (TID 250, localhost, executor driver, partition 249, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:45:01 TaskSetManager: INFO: Finished task 248.0 in stage 1.0 (TID 249) in 65048 ms on localhost (executor driver) (249/882) 2020-02-14 17:45:01 Executor: INFO: Running task 249.0 in stage 1.0 (TID 250) 2020-02-14 17:45:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8355053568+33554432 2020-02-14 17:45:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:46:06 Executor: INFO: Finished task 249.0 in stage 1.0 (TID 250). 1622 bytes result sent to driver 2020-02-14 17:46:06 TaskSetManager: INFO: Starting task 250.0 in stage 1.0 (TID 251, localhost, executor driver, partition 250, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:46:06 TaskSetManager: INFO: Finished task 249.0 in stage 1.0 (TID 250) in 65244 ms on localhost (executor driver) (250/882) 2020-02-14 17:46:06 Executor: INFO: Running task 250.0 in stage 1.0 (TID 251) 2020-02-14 17:46:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8388608000+33554432 2020-02-14 17:46:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:47:05 Executor: INFO: Finished task 250.0 in stage 1.0 (TID 251). 1678 bytes result sent to driver 2020-02-14 17:47:05 TaskSetManager: INFO: Starting task 251.0 in stage 1.0 (TID 252, localhost, executor driver, partition 251, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:47:05 TaskSetManager: INFO: Finished task 250.0 in stage 1.0 (TID 251) in 59168 ms on localhost (executor driver) (251/882) 2020-02-14 17:47:06 Executor: INFO: Running task 251.0 in stage 1.0 (TID 252) 2020-02-14 17:47:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8422162432+33554432 2020-02-14 17:47:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:48:12 Executor: INFO: Finished task 251.0 in stage 1.0 (TID 252). 1602 bytes result sent to driver 2020-02-14 17:48:12 TaskSetManager: INFO: Starting task 252.0 in stage 1.0 (TID 253, localhost, executor driver, partition 252, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:48:12 TaskSetManager: INFO: Finished task 251.0 in stage 1.0 (TID 252) in 66326 ms on localhost (executor driver) (252/882) 2020-02-14 17:48:12 Executor: INFO: Running task 252.0 in stage 1.0 (TID 253) 2020-02-14 17:48:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8455716864+33554432 2020-02-14 17:48:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:49:18 Executor: INFO: Finished task 252.0 in stage 1.0 (TID 253). 1622 bytes result sent to driver 2020-02-14 17:49:18 TaskSetManager: INFO: Starting task 253.0 in stage 1.0 (TID 254, localhost, executor driver, partition 253, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:49:18 TaskSetManager: INFO: Finished task 252.0 in stage 1.0 (TID 253) in 65913 ms on localhost (executor driver) (253/882) 2020-02-14 17:49:18 Executor: INFO: Running task 253.0 in stage 1.0 (TID 254) 2020-02-14 17:49:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8489271296+33554432 2020-02-14 17:49:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:50:19 Executor: INFO: Finished task 253.0 in stage 1.0 (TID 254). 1602 bytes result sent to driver 2020-02-14 17:50:19 TaskSetManager: INFO: Starting task 254.0 in stage 1.0 (TID 255, localhost, executor driver, partition 254, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:50:19 TaskSetManager: INFO: Finished task 253.0 in stage 1.0 (TID 254) in 61423 ms on localhost (executor driver) (254/882) 2020-02-14 17:50:19 Executor: INFO: Running task 254.0 in stage 1.0 (TID 255) 2020-02-14 17:50:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8522825728+33554432 2020-02-14 17:50:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:51:27 Executor: INFO: Finished task 254.0 in stage 1.0 (TID 255). 1611 bytes result sent to driver 2020-02-14 17:51:27 TaskSetManager: INFO: Starting task 255.0 in stage 1.0 (TID 256, localhost, executor driver, partition 255, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:51:27 TaskSetManager: INFO: Finished task 254.0 in stage 1.0 (TID 255) in 67364 ms on localhost (executor driver) (255/882) 2020-02-14 17:51:27 Executor: INFO: Running task 255.0 in stage 1.0 (TID 256) 2020-02-14 17:51:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8556380160+33554432 2020-02-14 17:51:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:52:30 Executor: INFO: Finished task 255.0 in stage 1.0 (TID 256). 1603 bytes result sent to driver 2020-02-14 17:52:30 TaskSetManager: INFO: Starting task 256.0 in stage 1.0 (TID 257, localhost, executor driver, partition 256, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:52:30 TaskSetManager: INFO: Finished task 255.0 in stage 1.0 (TID 256) in 63606 ms on localhost (executor driver) (256/882) 2020-02-14 17:52:30 Executor: INFO: Running task 256.0 in stage 1.0 (TID 257) 2020-02-14 17:52:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8589934592+33554432 2020-02-14 17:52:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:53:33 Executor: INFO: Finished task 256.0 in stage 1.0 (TID 257). 1631 bytes result sent to driver 2020-02-14 17:53:33 TaskSetManager: INFO: Starting task 257.0 in stage 1.0 (TID 258, localhost, executor driver, partition 257, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:53:33 TaskSetManager: INFO: Finished task 256.0 in stage 1.0 (TID 257) in 63170 ms on localhost (executor driver) (257/882) 2020-02-14 17:53:33 Executor: INFO: Running task 257.0 in stage 1.0 (TID 258) 2020-02-14 17:53:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8623489024+33554432 2020-02-14 17:53:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:54:26 Executor: INFO: Finished task 257.0 in stage 1.0 (TID 258). 1649 bytes result sent to driver 2020-02-14 17:54:26 TaskSetManager: INFO: Starting task 258.0 in stage 1.0 (TID 259, localhost, executor driver, partition 258, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:54:26 TaskSetManager: INFO: Finished task 257.0 in stage 1.0 (TID 258) in 52233 ms on localhost (executor driver) (258/882) 2020-02-14 17:54:26 Executor: INFO: Running task 258.0 in stage 1.0 (TID 259) 2020-02-14 17:54:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8657043456+33554432 2020-02-14 17:54:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:55:23 Executor: INFO: Finished task 258.0 in stage 1.0 (TID 259). 1604 bytes result sent to driver 2020-02-14 17:55:23 TaskSetManager: INFO: Starting task 259.0 in stage 1.0 (TID 260, localhost, executor driver, partition 259, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:55:23 TaskSetManager: INFO: Finished task 258.0 in stage 1.0 (TID 259) in 57700 ms on localhost (executor driver) (259/882) 2020-02-14 17:55:23 Executor: INFO: Running task 259.0 in stage 1.0 (TID 260) 2020-02-14 17:55:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8690597888+33554432 2020-02-14 17:55:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:56:10 Executor: INFO: Finished task 259.0 in stage 1.0 (TID 260). 1616 bytes result sent to driver 2020-02-14 17:56:10 TaskSetManager: INFO: Starting task 260.0 in stage 1.0 (TID 261, localhost, executor driver, partition 260, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:56:10 TaskSetManager: INFO: Finished task 259.0 in stage 1.0 (TID 260) in 46616 ms on localhost (executor driver) (260/882) 2020-02-14 17:56:10 Executor: INFO: Running task 260.0 in stage 1.0 (TID 261) 2020-02-14 17:56:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8724152320+33554432 2020-02-14 17:56:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:56:53 Executor: INFO: Finished task 260.0 in stage 1.0 (TID 261). 1604 bytes result sent to driver 2020-02-14 17:56:53 TaskSetManager: INFO: Starting task 261.0 in stage 1.0 (TID 262, localhost, executor driver, partition 261, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:56:53 TaskSetManager: INFO: Finished task 260.0 in stage 1.0 (TID 261) in 42803 ms on localhost (executor driver) (261/882) 2020-02-14 17:56:53 Executor: INFO: Running task 261.0 in stage 1.0 (TID 262) 2020-02-14 17:56:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8757706752+33554432 2020-02-14 17:56:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:57:37 Executor: INFO: Finished task 261.0 in stage 1.0 (TID 262). 1617 bytes result sent to driver 2020-02-14 17:57:37 TaskSetManager: INFO: Starting task 262.0 in stage 1.0 (TID 263, localhost, executor driver, partition 262, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:57:37 TaskSetManager: INFO: Finished task 261.0 in stage 1.0 (TID 262) in 44288 ms on localhost (executor driver) (262/882) 2020-02-14 17:57:37 Executor: INFO: Running task 262.0 in stage 1.0 (TID 263) 2020-02-14 17:57:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8791261184+33554432 2020-02-14 17:57:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:58:11 Executor: INFO: Finished task 262.0 in stage 1.0 (TID 263). 1920 bytes result sent to driver 2020-02-14 17:58:11 TaskSetManager: INFO: Starting task 263.0 in stage 1.0 (TID 264, localhost, executor driver, partition 263, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:58:11 TaskSetManager: INFO: Finished task 262.0 in stage 1.0 (TID 263) in 33985 ms on localhost (executor driver) (263/882) 2020-02-14 17:58:11 Executor: INFO: Running task 263.0 in stage 1.0 (TID 264) 2020-02-14 17:58:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8824815616+33554432 2020-02-14 17:58:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:59:07 Executor: INFO: Finished task 263.0 in stage 1.0 (TID 264). 1606 bytes result sent to driver 2020-02-14 17:59:07 TaskSetManager: INFO: Starting task 264.0 in stage 1.0 (TID 265, localhost, executor driver, partition 264, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:59:07 TaskSetManager: INFO: Finished task 263.0 in stage 1.0 (TID 264) in 56140 ms on localhost (executor driver) (264/882) 2020-02-14 17:59:07 Executor: INFO: Running task 264.0 in stage 1.0 (TID 265) 2020-02-14 17:59:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8858370048+33554432 2020-02-14 17:59:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 17:59:58 Executor: INFO: Finished task 264.0 in stage 1.0 (TID 265). 1602 bytes result sent to driver 2020-02-14 17:59:58 TaskSetManager: INFO: Starting task 265.0 in stage 1.0 (TID 266, localhost, executor driver, partition 265, PROCESS_LOCAL, 7933 bytes) 2020-02-14 17:59:58 TaskSetManager: INFO: Finished task 264.0 in stage 1.0 (TID 265) in 50669 ms on localhost (executor driver) (265/882) 2020-02-14 17:59:58 Executor: INFO: Running task 265.0 in stage 1.0 (TID 266) 2020-02-14 17:59:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8891924480+33554432 2020-02-14 17:59:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:00:49 Executor: INFO: Finished task 265.0 in stage 1.0 (TID 266). 1634 bytes result sent to driver 2020-02-14 18:00:49 TaskSetManager: INFO: Starting task 266.0 in stage 1.0 (TID 267, localhost, executor driver, partition 266, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:00:49 TaskSetManager: INFO: Finished task 265.0 in stage 1.0 (TID 266) in 51582 ms on localhost (executor driver) (266/882) 2020-02-14 18:00:49 Executor: INFO: Running task 266.0 in stage 1.0 (TID 267) 2020-02-14 18:00:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8925478912+33554432 2020-02-14 18:00:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:01:47 Executor: INFO: Finished task 266.0 in stage 1.0 (TID 267). 1602 bytes result sent to driver 2020-02-14 18:01:47 TaskSetManager: INFO: Starting task 267.0 in stage 1.0 (TID 268, localhost, executor driver, partition 267, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:01:47 TaskSetManager: INFO: Finished task 266.0 in stage 1.0 (TID 267) in 57756 ms on localhost (executor driver) (267/882) 2020-02-14 18:01:47 Executor: INFO: Running task 267.0 in stage 1.0 (TID 268) 2020-02-14 18:01:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8959033344+33554432 2020-02-14 18:01:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:02:36 Executor: INFO: Finished task 267.0 in stage 1.0 (TID 268). 1602 bytes result sent to driver 2020-02-14 18:02:36 TaskSetManager: INFO: Starting task 268.0 in stage 1.0 (TID 269, localhost, executor driver, partition 268, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:02:36 TaskSetManager: INFO: Finished task 267.0 in stage 1.0 (TID 268) in 48527 ms on localhost (executor driver) (268/882) 2020-02-14 18:02:36 Executor: INFO: Running task 268.0 in stage 1.0 (TID 269) 2020-02-14 18:02:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8992587776+33554432 2020-02-14 18:02:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:03:34 Executor: INFO: Finished task 268.0 in stage 1.0 (TID 269). 1622 bytes result sent to driver 2020-02-14 18:03:34 TaskSetManager: INFO: Starting task 269.0 in stage 1.0 (TID 270, localhost, executor driver, partition 269, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:03:34 TaskSetManager: INFO: Finished task 268.0 in stage 1.0 (TID 269) in 58538 ms on localhost (executor driver) (269/882) 2020-02-14 18:03:34 Executor: INFO: Running task 269.0 in stage 1.0 (TID 270) 2020-02-14 18:03:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9026142208+33554432 2020-02-14 18:03:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:04:36 Executor: INFO: Finished task 269.0 in stage 1.0 (TID 270). 1604 bytes result sent to driver 2020-02-14 18:04:36 TaskSetManager: INFO: Starting task 270.0 in stage 1.0 (TID 271, localhost, executor driver, partition 270, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:04:36 TaskSetManager: INFO: Finished task 269.0 in stage 1.0 (TID 270) in 61771 ms on localhost (executor driver) (270/882) 2020-02-14 18:04:36 Executor: INFO: Running task 270.0 in stage 1.0 (TID 271) 2020-02-14 18:04:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9059696640+33554432 2020-02-14 18:04:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:05:30 Executor: INFO: Finished task 270.0 in stage 1.0 (TID 271). 1607 bytes result sent to driver 2020-02-14 18:05:30 TaskSetManager: INFO: Starting task 271.0 in stage 1.0 (TID 272, localhost, executor driver, partition 271, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:05:30 TaskSetManager: INFO: Finished task 270.0 in stage 1.0 (TID 271) in 54446 ms on localhost (executor driver) (271/882) 2020-02-14 18:05:30 Executor: INFO: Running task 271.0 in stage 1.0 (TID 272) 2020-02-14 18:05:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9093251072+33554432 2020-02-14 18:05:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:06:27 Executor: INFO: Finished task 271.0 in stage 1.0 (TID 272). 1647 bytes result sent to driver 2020-02-14 18:06:27 TaskSetManager: INFO: Starting task 272.0 in stage 1.0 (TID 273, localhost, executor driver, partition 272, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:06:27 TaskSetManager: INFO: Finished task 271.0 in stage 1.0 (TID 272) in 56977 ms on localhost (executor driver) (272/882) 2020-02-14 18:06:27 Executor: INFO: Running task 272.0 in stage 1.0 (TID 273) 2020-02-14 18:06:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9126805504+33554432 2020-02-14 18:06:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:07:22 Executor: INFO: Finished task 272.0 in stage 1.0 (TID 273). 1602 bytes result sent to driver 2020-02-14 18:07:22 TaskSetManager: INFO: Starting task 273.0 in stage 1.0 (TID 274, localhost, executor driver, partition 273, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:07:22 TaskSetManager: INFO: Finished task 272.0 in stage 1.0 (TID 273) in 54923 ms on localhost (executor driver) (273/882) 2020-02-14 18:07:22 Executor: INFO: Running task 273.0 in stage 1.0 (TID 274) 2020-02-14 18:07:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9160359936+33554432 2020-02-14 18:07:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:08:12 Executor: INFO: Finished task 273.0 in stage 1.0 (TID 274). 1602 bytes result sent to driver 2020-02-14 18:08:12 TaskSetManager: INFO: Starting task 274.0 in stage 1.0 (TID 275, localhost, executor driver, partition 274, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:08:12 TaskSetManager: INFO: Finished task 273.0 in stage 1.0 (TID 274) in 49755 ms on localhost (executor driver) (274/882) 2020-02-14 18:08:12 Executor: INFO: Running task 274.0 in stage 1.0 (TID 275) 2020-02-14 18:08:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9193914368+33554432 2020-02-14 18:08:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:09:08 Executor: INFO: Finished task 274.0 in stage 1.0 (TID 275). 1639 bytes result sent to driver 2020-02-14 18:09:08 TaskSetManager: INFO: Starting task 275.0 in stage 1.0 (TID 276, localhost, executor driver, partition 275, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:09:08 TaskSetManager: INFO: Finished task 274.0 in stage 1.0 (TID 275) in 56079 ms on localhost (executor driver) (275/882) 2020-02-14 18:09:08 Executor: INFO: Running task 275.0 in stage 1.0 (TID 276) 2020-02-14 18:09:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9227468800+33554432 2020-02-14 18:09:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:10:10 Executor: INFO: Finished task 275.0 in stage 1.0 (TID 276). 1645 bytes result sent to driver 2020-02-14 18:10:10 TaskSetManager: INFO: Starting task 276.0 in stage 1.0 (TID 277, localhost, executor driver, partition 276, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:10:10 TaskSetManager: INFO: Finished task 275.0 in stage 1.0 (TID 276) in 61499 ms on localhost (executor driver) (276/882) 2020-02-14 18:10:10 Executor: INFO: Running task 276.0 in stage 1.0 (TID 277) 2020-02-14 18:10:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9261023232+33554432 2020-02-14 18:10:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:11:11 Executor: INFO: Finished task 276.0 in stage 1.0 (TID 277). 1604 bytes result sent to driver 2020-02-14 18:11:11 TaskSetManager: INFO: Starting task 277.0 in stage 1.0 (TID 278, localhost, executor driver, partition 277, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:11:11 TaskSetManager: INFO: Finished task 276.0 in stage 1.0 (TID 277) in 61304 ms on localhost (executor driver) (277/882) 2020-02-14 18:11:11 Executor: INFO: Running task 277.0 in stage 1.0 (TID 278) 2020-02-14 18:11:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9294577664+33554432 2020-02-14 18:11:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:12:17 Executor: INFO: Finished task 277.0 in stage 1.0 (TID 278). 1663 bytes result sent to driver 2020-02-14 18:12:17 TaskSetManager: INFO: Starting task 278.0 in stage 1.0 (TID 279, localhost, executor driver, partition 278, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:12:17 TaskSetManager: INFO: Finished task 277.0 in stage 1.0 (TID 278) in 65701 ms on localhost (executor driver) (278/882) 2020-02-14 18:12:17 Executor: INFO: Running task 278.0 in stage 1.0 (TID 279) 2020-02-14 18:12:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9328132096+33554432 2020-02-14 18:12:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:13:14 Executor: INFO: Finished task 278.0 in stage 1.0 (TID 279). 1710 bytes result sent to driver 2020-02-14 18:13:14 TaskSetManager: INFO: Starting task 279.0 in stage 1.0 (TID 280, localhost, executor driver, partition 279, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:13:14 TaskSetManager: INFO: Finished task 278.0 in stage 1.0 (TID 279) in 57351 ms on localhost (executor driver) (279/882) 2020-02-14 18:13:14 Executor: INFO: Running task 279.0 in stage 1.0 (TID 280) 2020-02-14 18:13:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9361686528+33554432 2020-02-14 18:13:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:13:52 Executor: INFO: Finished task 279.0 in stage 1.0 (TID 280). 1661 bytes result sent to driver 2020-02-14 18:13:52 TaskSetManager: INFO: Starting task 280.0 in stage 1.0 (TID 281, localhost, executor driver, partition 280, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:13:52 TaskSetManager: INFO: Finished task 279.0 in stage 1.0 (TID 280) in 38389 ms on localhost (executor driver) (280/882) 2020-02-14 18:13:52 Executor: INFO: Running task 280.0 in stage 1.0 (TID 281) 2020-02-14 18:13:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9395240960+33554432 2020-02-14 18:13:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:14:48 Executor: INFO: Finished task 280.0 in stage 1.0 (TID 281). 1645 bytes result sent to driver 2020-02-14 18:14:48 TaskSetManager: INFO: Starting task 281.0 in stage 1.0 (TID 282, localhost, executor driver, partition 281, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:14:48 TaskSetManager: INFO: Finished task 280.0 in stage 1.0 (TID 281) in 55540 ms on localhost (executor driver) (281/882) 2020-02-14 18:14:48 Executor: INFO: Running task 281.0 in stage 1.0 (TID 282) 2020-02-14 18:14:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9428795392+33554432 2020-02-14 18:14:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:15:34 Executor: INFO: Finished task 281.0 in stage 1.0 (TID 282). 1645 bytes result sent to driver 2020-02-14 18:15:34 TaskSetManager: INFO: Starting task 282.0 in stage 1.0 (TID 283, localhost, executor driver, partition 282, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:15:34 TaskSetManager: INFO: Finished task 281.0 in stage 1.0 (TID 282) in 45708 ms on localhost (executor driver) (282/882) 2020-02-14 18:15:34 Executor: INFO: Running task 282.0 in stage 1.0 (TID 283) 2020-02-14 18:15:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9462349824+33554432 2020-02-14 18:15:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:16:34 Executor: INFO: Finished task 282.0 in stage 1.0 (TID 283). 1630 bytes result sent to driver 2020-02-14 18:16:34 TaskSetManager: INFO: Starting task 283.0 in stage 1.0 (TID 284, localhost, executor driver, partition 283, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:16:34 TaskSetManager: INFO: Finished task 282.0 in stage 1.0 (TID 283) in 60138 ms on localhost (executor driver) (283/882) 2020-02-14 18:16:34 Executor: INFO: Running task 283.0 in stage 1.0 (TID 284) 2020-02-14 18:16:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9495904256+33554432 2020-02-14 18:16:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:17:33 Executor: INFO: Finished task 283.0 in stage 1.0 (TID 284). 1673 bytes result sent to driver 2020-02-14 18:17:33 TaskSetManager: INFO: Starting task 284.0 in stage 1.0 (TID 285, localhost, executor driver, partition 284, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:17:33 TaskSetManager: INFO: Finished task 283.0 in stage 1.0 (TID 284) in 58955 ms on localhost (executor driver) (284/882) 2020-02-14 18:17:33 Executor: INFO: Running task 284.0 in stage 1.0 (TID 285) 2020-02-14 18:17:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9529458688+33554432 2020-02-14 18:17:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:18:26 Executor: INFO: Finished task 284.0 in stage 1.0 (TID 285). 1604 bytes result sent to driver 2020-02-14 18:18:26 TaskSetManager: INFO: Starting task 285.0 in stage 1.0 (TID 286, localhost, executor driver, partition 285, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:18:26 TaskSetManager: INFO: Finished task 284.0 in stage 1.0 (TID 285) in 53343 ms on localhost (executor driver) (285/882) 2020-02-14 18:18:26 Executor: INFO: Running task 285.0 in stage 1.0 (TID 286) 2020-02-14 18:18:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9563013120+33554432 2020-02-14 18:18:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:19:25 Executor: INFO: Finished task 285.0 in stage 1.0 (TID 286). 1621 bytes result sent to driver 2020-02-14 18:19:25 TaskSetManager: INFO: Starting task 286.0 in stage 1.0 (TID 287, localhost, executor driver, partition 286, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:19:25 TaskSetManager: INFO: Finished task 285.0 in stage 1.0 (TID 286) in 58860 ms on localhost (executor driver) (286/882) 2020-02-14 18:19:25 Executor: INFO: Running task 286.0 in stage 1.0 (TID 287) 2020-02-14 18:19:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9596567552+33554432 2020-02-14 18:19:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:20:27 Executor: INFO: Finished task 286.0 in stage 1.0 (TID 287). 1650 bytes result sent to driver 2020-02-14 18:20:27 TaskSetManager: INFO: Starting task 287.0 in stage 1.0 (TID 288, localhost, executor driver, partition 287, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:20:27 TaskSetManager: INFO: Finished task 286.0 in stage 1.0 (TID 287) in 61932 ms on localhost (executor driver) (287/882) 2020-02-14 18:20:27 Executor: INFO: Running task 287.0 in stage 1.0 (TID 288) 2020-02-14 18:20:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9630121984+33554432 2020-02-14 18:20:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:21:34 Executor: INFO: Finished task 287.0 in stage 1.0 (TID 288). 1602 bytes result sent to driver 2020-02-14 18:21:34 TaskSetManager: INFO: Starting task 288.0 in stage 1.0 (TID 289, localhost, executor driver, partition 288, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:21:34 TaskSetManager: INFO: Finished task 287.0 in stage 1.0 (TID 288) in 66810 ms on localhost (executor driver) (288/882) 2020-02-14 18:21:34 Executor: INFO: Running task 288.0 in stage 1.0 (TID 289) 2020-02-14 18:21:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9663676416+33554432 2020-02-14 18:21:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:22:33 Executor: INFO: Finished task 288.0 in stage 1.0 (TID 289). 1678 bytes result sent to driver 2020-02-14 18:22:33 TaskSetManager: INFO: Starting task 289.0 in stage 1.0 (TID 290, localhost, executor driver, partition 289, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:22:33 TaskSetManager: INFO: Finished task 288.0 in stage 1.0 (TID 289) in 59507 ms on localhost (executor driver) (289/882) 2020-02-14 18:22:33 Executor: INFO: Running task 289.0 in stage 1.0 (TID 290) 2020-02-14 18:22:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9697230848+33554432 2020-02-14 18:22:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:23:36 Executor: INFO: Finished task 289.0 in stage 1.0 (TID 290). 1615 bytes result sent to driver 2020-02-14 18:23:36 TaskSetManager: INFO: Starting task 290.0 in stage 1.0 (TID 291, localhost, executor driver, partition 290, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:23:36 TaskSetManager: INFO: Finished task 289.0 in stage 1.0 (TID 290) in 62872 ms on localhost (executor driver) (290/882) 2020-02-14 18:23:36 Executor: INFO: Running task 290.0 in stage 1.0 (TID 291) 2020-02-14 18:23:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9730785280+33554432 2020-02-14 18:23:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:24:33 Executor: INFO: Finished task 290.0 in stage 1.0 (TID 291). 1602 bytes result sent to driver 2020-02-14 18:24:33 TaskSetManager: INFO: Starting task 291.0 in stage 1.0 (TID 292, localhost, executor driver, partition 291, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:24:33 TaskSetManager: INFO: Finished task 290.0 in stage 1.0 (TID 291) in 56893 ms on localhost (executor driver) (291/882) 2020-02-14 18:24:33 Executor: INFO: Running task 291.0 in stage 1.0 (TID 292) 2020-02-14 18:24:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9764339712+33554432 2020-02-14 18:24:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:25:27 Executor: INFO: Finished task 291.0 in stage 1.0 (TID 292). 1602 bytes result sent to driver 2020-02-14 18:25:27 TaskSetManager: INFO: Starting task 292.0 in stage 1.0 (TID 293, localhost, executor driver, partition 292, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:25:27 TaskSetManager: INFO: Finished task 291.0 in stage 1.0 (TID 292) in 54278 ms on localhost (executor driver) (292/882) 2020-02-14 18:25:27 Executor: INFO: Running task 292.0 in stage 1.0 (TID 293) 2020-02-14 18:25:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9797894144+33554432 2020-02-14 18:25:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:26:28 Executor: INFO: Finished task 292.0 in stage 1.0 (TID 293). 1647 bytes result sent to driver 2020-02-14 18:26:28 TaskSetManager: INFO: Starting task 293.0 in stage 1.0 (TID 294, localhost, executor driver, partition 293, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:26:28 TaskSetManager: INFO: Finished task 292.0 in stage 1.0 (TID 293) in 61266 ms on localhost (executor driver) (293/882) 2020-02-14 18:26:28 Executor: INFO: Running task 293.0 in stage 1.0 (TID 294) 2020-02-14 18:26:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9831448576+33554432 2020-02-14 18:26:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:27:35 Executor: INFO: Finished task 293.0 in stage 1.0 (TID 294). 1603 bytes result sent to driver 2020-02-14 18:27:35 TaskSetManager: INFO: Starting task 294.0 in stage 1.0 (TID 295, localhost, executor driver, partition 294, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:27:35 TaskSetManager: INFO: Finished task 293.0 in stage 1.0 (TID 294) in 66592 ms on localhost (executor driver) (294/882) 2020-02-14 18:27:35 Executor: INFO: Running task 294.0 in stage 1.0 (TID 295) 2020-02-14 18:27:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9865003008+33554432 2020-02-14 18:27:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:28:39 Executor: INFO: Finished task 294.0 in stage 1.0 (TID 295). 1602 bytes result sent to driver 2020-02-14 18:28:39 TaskSetManager: INFO: Starting task 295.0 in stage 1.0 (TID 296, localhost, executor driver, partition 295, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:28:39 TaskSetManager: INFO: Finished task 294.0 in stage 1.0 (TID 295) in 63837 ms on localhost (executor driver) (295/882) 2020-02-14 18:28:39 Executor: INFO: Running task 295.0 in stage 1.0 (TID 296) 2020-02-14 18:28:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9898557440+33554432 2020-02-14 18:28:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:29:36 Executor: INFO: Finished task 295.0 in stage 1.0 (TID 296). 1602 bytes result sent to driver 2020-02-14 18:29:36 TaskSetManager: INFO: Starting task 296.0 in stage 1.0 (TID 297, localhost, executor driver, partition 296, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:29:36 TaskSetManager: INFO: Finished task 295.0 in stage 1.0 (TID 296) in 57024 ms on localhost (executor driver) (296/882) 2020-02-14 18:29:36 Executor: INFO: Running task 296.0 in stage 1.0 (TID 297) 2020-02-14 18:29:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9932111872+33554432 2020-02-14 18:29:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:30:28 Executor: INFO: Finished task 296.0 in stage 1.0 (TID 297). 1625 bytes result sent to driver 2020-02-14 18:30:28 TaskSetManager: INFO: Starting task 297.0 in stage 1.0 (TID 298, localhost, executor driver, partition 297, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:30:28 TaskSetManager: INFO: Finished task 296.0 in stage 1.0 (TID 297) in 51992 ms on localhost (executor driver) (297/882) 2020-02-14 18:30:28 Executor: INFO: Running task 297.0 in stage 1.0 (TID 298) 2020-02-14 18:30:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9965666304+33554432 2020-02-14 18:30:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:31:23 Executor: INFO: Finished task 297.0 in stage 1.0 (TID 298). 1602 bytes result sent to driver 2020-02-14 18:31:23 TaskSetManager: INFO: Starting task 298.0 in stage 1.0 (TID 299, localhost, executor driver, partition 298, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:31:23 TaskSetManager: INFO: Finished task 297.0 in stage 1.0 (TID 298) in 55133 ms on localhost (executor driver) (298/882) 2020-02-14 18:31:23 Executor: INFO: Running task 298.0 in stage 1.0 (TID 299) 2020-02-14 18:31:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9999220736+33554432 2020-02-14 18:31:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:31:30 Executor: INFO: Finished task 298.0 in stage 1.0 (TID 299). 1687 bytes result sent to driver 2020-02-14 18:31:30 TaskSetManager: INFO: Starting task 299.0 in stage 1.0 (TID 300, localhost, executor driver, partition 299, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:31:30 TaskSetManager: INFO: Finished task 298.0 in stage 1.0 (TID 299) in 7284 ms on localhost (executor driver) (299/882) 2020-02-14 18:31:30 Executor: INFO: Running task 299.0 in stage 1.0 (TID 300) 2020-02-14 18:31:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10032775168+33554432 2020-02-14 18:31:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:32:17 Executor: INFO: Finished task 299.0 in stage 1.0 (TID 300). 1602 bytes result sent to driver 2020-02-14 18:32:17 TaskSetManager: INFO: Starting task 300.0 in stage 1.0 (TID 301, localhost, executor driver, partition 300, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:32:17 TaskSetManager: INFO: Finished task 299.0 in stage 1.0 (TID 300) in 47187 ms on localhost (executor driver) (300/882) 2020-02-14 18:32:17 Executor: INFO: Running task 300.0 in stage 1.0 (TID 301) 2020-02-14 18:32:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10066329600+33554432 2020-02-14 18:32:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:33:18 Executor: INFO: Finished task 300.0 in stage 1.0 (TID 301). 1602 bytes result sent to driver 2020-02-14 18:33:18 TaskSetManager: INFO: Starting task 301.0 in stage 1.0 (TID 302, localhost, executor driver, partition 301, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:33:18 TaskSetManager: INFO: Finished task 300.0 in stage 1.0 (TID 301) in 60853 ms on localhost (executor driver) (301/882) 2020-02-14 18:33:18 Executor: INFO: Running task 301.0 in stage 1.0 (TID 302) 2020-02-14 18:33:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10099884032+33554432 2020-02-14 18:33:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:34:16 Executor: INFO: Finished task 301.0 in stage 1.0 (TID 302). 1659 bytes result sent to driver 2020-02-14 18:34:16 TaskSetManager: INFO: Starting task 302.0 in stage 1.0 (TID 303, localhost, executor driver, partition 302, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:34:16 TaskSetManager: INFO: Finished task 301.0 in stage 1.0 (TID 302) in 58189 ms on localhost (executor driver) (302/882) 2020-02-14 18:34:16 Executor: INFO: Running task 302.0 in stage 1.0 (TID 303) 2020-02-14 18:34:16 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10133438464+33554432 2020-02-14 18:34:16 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:35:15 Executor: INFO: Finished task 302.0 in stage 1.0 (TID 303). 1657 bytes result sent to driver 2020-02-14 18:35:15 TaskSetManager: INFO: Starting task 303.0 in stage 1.0 (TID 304, localhost, executor driver, partition 303, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:35:15 TaskSetManager: INFO: Finished task 302.0 in stage 1.0 (TID 303) in 58958 ms on localhost (executor driver) (303/882) 2020-02-14 18:35:15 Executor: INFO: Running task 303.0 in stage 1.0 (TID 304) 2020-02-14 18:35:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10166992896+33554432 2020-02-14 18:35:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:36:13 Executor: INFO: Finished task 303.0 in stage 1.0 (TID 304). 1604 bytes result sent to driver 2020-02-14 18:36:13 TaskSetManager: INFO: Starting task 304.0 in stage 1.0 (TID 305, localhost, executor driver, partition 304, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:36:13 TaskSetManager: INFO: Finished task 303.0 in stage 1.0 (TID 304) in 57923 ms on localhost (executor driver) (304/882) 2020-02-14 18:36:13 Executor: INFO: Running task 304.0 in stage 1.0 (TID 305) 2020-02-14 18:36:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10200547328+33554432 2020-02-14 18:36:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:37:15 Executor: INFO: Finished task 304.0 in stage 1.0 (TID 305). 1602 bytes result sent to driver 2020-02-14 18:37:15 TaskSetManager: INFO: Starting task 305.0 in stage 1.0 (TID 306, localhost, executor driver, partition 305, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:37:15 TaskSetManager: INFO: Finished task 304.0 in stage 1.0 (TID 305) in 61755 ms on localhost (executor driver) (305/882) 2020-02-14 18:37:15 Executor: INFO: Running task 305.0 in stage 1.0 (TID 306) 2020-02-14 18:37:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10234101760+33554432 2020-02-14 18:37:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:38:14 Executor: INFO: Finished task 305.0 in stage 1.0 (TID 306). 1602 bytes result sent to driver 2020-02-14 18:38:14 TaskSetManager: INFO: Starting task 306.0 in stage 1.0 (TID 307, localhost, executor driver, partition 306, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:38:14 TaskSetManager: INFO: Finished task 305.0 in stage 1.0 (TID 306) in 59240 ms on localhost (executor driver) (306/882) 2020-02-14 18:38:14 Executor: INFO: Running task 306.0 in stage 1.0 (TID 307) 2020-02-14 18:38:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10267656192+33554432 2020-02-14 18:38:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:39:14 Executor: INFO: Finished task 306.0 in stage 1.0 (TID 307). 1602 bytes result sent to driver 2020-02-14 18:39:14 TaskSetManager: INFO: Starting task 307.0 in stage 1.0 (TID 308, localhost, executor driver, partition 307, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:39:14 TaskSetManager: INFO: Finished task 306.0 in stage 1.0 (TID 307) in 59711 ms on localhost (executor driver) (307/882) 2020-02-14 18:39:14 Executor: INFO: Running task 307.0 in stage 1.0 (TID 308) 2020-02-14 18:39:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10301210624+33554432 2020-02-14 18:39:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:40:18 Executor: INFO: Finished task 307.0 in stage 1.0 (TID 308). 1609 bytes result sent to driver 2020-02-14 18:40:18 TaskSetManager: INFO: Starting task 308.0 in stage 1.0 (TID 309, localhost, executor driver, partition 308, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:40:18 TaskSetManager: INFO: Finished task 307.0 in stage 1.0 (TID 308) in 64371 ms on localhost (executor driver) (308/882) 2020-02-14 18:40:18 Executor: INFO: Running task 308.0 in stage 1.0 (TID 309) 2020-02-14 18:40:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10334765056+33554432 2020-02-14 18:40:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:41:20 Executor: INFO: Finished task 308.0 in stage 1.0 (TID 309). 1602 bytes result sent to driver 2020-02-14 18:41:20 TaskSetManager: INFO: Starting task 309.0 in stage 1.0 (TID 310, localhost, executor driver, partition 309, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:41:20 TaskSetManager: INFO: Finished task 308.0 in stage 1.0 (TID 309) in 61332 ms on localhost (executor driver) (309/882) 2020-02-14 18:41:20 Executor: INFO: Running task 309.0 in stage 1.0 (TID 310) 2020-02-14 18:41:20 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10368319488+33554432 2020-02-14 18:41:20 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:42:21 Executor: INFO: Finished task 309.0 in stage 1.0 (TID 310). 1641 bytes result sent to driver 2020-02-14 18:42:21 TaskSetManager: INFO: Starting task 310.0 in stage 1.0 (TID 311, localhost, executor driver, partition 310, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:42:21 TaskSetManager: INFO: Finished task 309.0 in stage 1.0 (TID 310) in 60945 ms on localhost (executor driver) (310/882) 2020-02-14 18:42:21 Executor: INFO: Running task 310.0 in stage 1.0 (TID 311) 2020-02-14 18:42:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10401873920+33554432 2020-02-14 18:42:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:43:14 Executor: INFO: Finished task 310.0 in stage 1.0 (TID 311). 1678 bytes result sent to driver 2020-02-14 18:43:14 TaskSetManager: INFO: Starting task 311.0 in stage 1.0 (TID 312, localhost, executor driver, partition 311, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:43:14 TaskSetManager: INFO: Finished task 310.0 in stage 1.0 (TID 311) in 53301 ms on localhost (executor driver) (311/882) 2020-02-14 18:43:14 Executor: INFO: Running task 311.0 in stage 1.0 (TID 312) 2020-02-14 18:43:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10435428352+33554432 2020-02-14 18:43:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:44:04 Executor: INFO: Finished task 311.0 in stage 1.0 (TID 312). 1645 bytes result sent to driver 2020-02-14 18:44:04 TaskSetManager: INFO: Starting task 312.0 in stage 1.0 (TID 313, localhost, executor driver, partition 312, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:44:04 TaskSetManager: INFO: Finished task 311.0 in stage 1.0 (TID 312) in 49807 ms on localhost (executor driver) (312/882) 2020-02-14 18:44:04 Executor: INFO: Running task 312.0 in stage 1.0 (TID 313) 2020-02-14 18:44:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10468982784+33554432 2020-02-14 18:44:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:45:07 Executor: INFO: Finished task 312.0 in stage 1.0 (TID 313). 1602 bytes result sent to driver 2020-02-14 18:45:07 TaskSetManager: INFO: Starting task 313.0 in stage 1.0 (TID 314, localhost, executor driver, partition 313, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:45:07 TaskSetManager: INFO: Finished task 312.0 in stage 1.0 (TID 313) in 63306 ms on localhost (executor driver) (313/882) 2020-02-14 18:45:07 Executor: INFO: Running task 313.0 in stage 1.0 (TID 314) 2020-02-14 18:45:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10502537216+33554432 2020-02-14 18:45:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:46:09 Executor: INFO: Finished task 313.0 in stage 1.0 (TID 314). 1602 bytes result sent to driver 2020-02-14 18:46:09 TaskSetManager: INFO: Starting task 314.0 in stage 1.0 (TID 315, localhost, executor driver, partition 314, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:46:09 TaskSetManager: INFO: Finished task 313.0 in stage 1.0 (TID 314) in 62027 ms on localhost (executor driver) (314/882) 2020-02-14 18:46:09 Executor: INFO: Running task 314.0 in stage 1.0 (TID 315) 2020-02-14 18:46:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10536091648+33554432 2020-02-14 18:46:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:47:10 Executor: INFO: Finished task 314.0 in stage 1.0 (TID 315). 1602 bytes result sent to driver 2020-02-14 18:47:10 TaskSetManager: INFO: Starting task 315.0 in stage 1.0 (TID 316, localhost, executor driver, partition 315, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:47:10 TaskSetManager: INFO: Finished task 314.0 in stage 1.0 (TID 315) in 60663 ms on localhost (executor driver) (315/882) 2020-02-14 18:47:10 Executor: INFO: Running task 315.0 in stage 1.0 (TID 316) 2020-02-14 18:47:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10569646080+33554432 2020-02-14 18:47:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:48:16 Executor: INFO: Finished task 315.0 in stage 1.0 (TID 316). 1602 bytes result sent to driver 2020-02-14 18:48:16 TaskSetManager: INFO: Starting task 316.0 in stage 1.0 (TID 317, localhost, executor driver, partition 316, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:48:16 TaskSetManager: INFO: Finished task 315.0 in stage 1.0 (TID 316) in 65724 ms on localhost (executor driver) (316/882) 2020-02-14 18:48:16 Executor: INFO: Running task 316.0 in stage 1.0 (TID 317) 2020-02-14 18:48:16 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10603200512+33554432 2020-02-14 18:48:16 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:49:14 Executor: INFO: Finished task 316.0 in stage 1.0 (TID 317). 1602 bytes result sent to driver 2020-02-14 18:49:14 TaskSetManager: INFO: Starting task 317.0 in stage 1.0 (TID 318, localhost, executor driver, partition 317, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:49:14 TaskSetManager: INFO: Finished task 316.0 in stage 1.0 (TID 317) in 58311 ms on localhost (executor driver) (317/882) 2020-02-14 18:49:14 Executor: INFO: Running task 317.0 in stage 1.0 (TID 318) 2020-02-14 18:49:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10636754944+33554432 2020-02-14 18:49:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:50:01 Executor: INFO: Finished task 317.0 in stage 1.0 (TID 318). 1649 bytes result sent to driver 2020-02-14 18:50:01 TaskSetManager: INFO: Starting task 318.0 in stage 1.0 (TID 319, localhost, executor driver, partition 318, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:50:01 TaskSetManager: INFO: Finished task 317.0 in stage 1.0 (TID 318) in 47616 ms on localhost (executor driver) (318/882) 2020-02-14 18:50:01 Executor: INFO: Running task 318.0 in stage 1.0 (TID 319) 2020-02-14 18:50:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10670309376+33554432 2020-02-14 18:50:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:50:53 Executor: INFO: Finished task 318.0 in stage 1.0 (TID 319). 1627 bytes result sent to driver 2020-02-14 18:50:53 TaskSetManager: INFO: Starting task 319.0 in stage 1.0 (TID 320, localhost, executor driver, partition 319, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:50:53 TaskSetManager: INFO: Finished task 318.0 in stage 1.0 (TID 319) in 51516 ms on localhost (executor driver) (319/882) 2020-02-14 18:50:53 Executor: INFO: Running task 319.0 in stage 1.0 (TID 320) 2020-02-14 18:50:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10703863808+33554432 2020-02-14 18:50:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:51:50 Executor: INFO: Finished task 319.0 in stage 1.0 (TID 320). 1602 bytes result sent to driver 2020-02-14 18:51:50 TaskSetManager: INFO: Starting task 320.0 in stage 1.0 (TID 321, localhost, executor driver, partition 320, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:51:50 TaskSetManager: INFO: Finished task 319.0 in stage 1.0 (TID 320) in 56981 ms on localhost (executor driver) (320/882) 2020-02-14 18:51:50 Executor: INFO: Running task 320.0 in stage 1.0 (TID 321) 2020-02-14 18:51:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10737418240+33554432 2020-02-14 18:51:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:52:56 Executor: INFO: Finished task 320.0 in stage 1.0 (TID 321). 1602 bytes result sent to driver 2020-02-14 18:52:56 TaskSetManager: INFO: Starting task 321.0 in stage 1.0 (TID 322, localhost, executor driver, partition 321, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:52:56 TaskSetManager: INFO: Finished task 320.0 in stage 1.0 (TID 321) in 66448 ms on localhost (executor driver) (321/882) 2020-02-14 18:52:56 Executor: INFO: Running task 321.0 in stage 1.0 (TID 322) 2020-02-14 18:52:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10770972672+33554432 2020-02-14 18:52:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:53:58 Executor: INFO: Finished task 321.0 in stage 1.0 (TID 322). 1678 bytes result sent to driver 2020-02-14 18:53:58 TaskSetManager: INFO: Starting task 322.0 in stage 1.0 (TID 323, localhost, executor driver, partition 322, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:53:58 TaskSetManager: INFO: Finished task 321.0 in stage 1.0 (TID 322) in 61644 ms on localhost (executor driver) (322/882) 2020-02-14 18:53:58 Executor: INFO: Running task 322.0 in stage 1.0 (TID 323) 2020-02-14 18:53:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10804527104+33554432 2020-02-14 18:53:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:54:53 Executor: INFO: Finished task 322.0 in stage 1.0 (TID 323). 1602 bytes result sent to driver 2020-02-14 18:54:53 TaskSetManager: INFO: Starting task 323.0 in stage 1.0 (TID 324, localhost, executor driver, partition 323, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:54:53 TaskSetManager: INFO: Finished task 322.0 in stage 1.0 (TID 323) in 54888 ms on localhost (executor driver) (323/882) 2020-02-14 18:54:53 Executor: INFO: Running task 323.0 in stage 1.0 (TID 324) 2020-02-14 18:54:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10838081536+33554432 2020-02-14 18:54:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:55:59 Executor: INFO: Finished task 323.0 in stage 1.0 (TID 324). 1602 bytes result sent to driver 2020-02-14 18:55:59 TaskSetManager: INFO: Starting task 324.0 in stage 1.0 (TID 325, localhost, executor driver, partition 324, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:55:59 TaskSetManager: INFO: Finished task 323.0 in stage 1.0 (TID 324) in 66368 ms on localhost (executor driver) (324/882) 2020-02-14 18:55:59 Executor: INFO: Running task 324.0 in stage 1.0 (TID 325) 2020-02-14 18:55:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10871635968+33554432 2020-02-14 18:55:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:56:48 Executor: INFO: Finished task 324.0 in stage 1.0 (TID 325). 1666 bytes result sent to driver 2020-02-14 18:56:48 TaskSetManager: INFO: Starting task 325.0 in stage 1.0 (TID 326, localhost, executor driver, partition 325, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:56:48 TaskSetManager: INFO: Finished task 324.0 in stage 1.0 (TID 325) in 49063 ms on localhost (executor driver) (325/882) 2020-02-14 18:56:48 Executor: INFO: Running task 325.0 in stage 1.0 (TID 326) 2020-02-14 18:56:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10905190400+33554432 2020-02-14 18:56:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:57:46 Executor: INFO: Finished task 325.0 in stage 1.0 (TID 326). 1670 bytes result sent to driver 2020-02-14 18:57:46 TaskSetManager: INFO: Starting task 326.0 in stage 1.0 (TID 327, localhost, executor driver, partition 326, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:57:46 TaskSetManager: INFO: Finished task 325.0 in stage 1.0 (TID 326) in 57895 ms on localhost (executor driver) (326/882) 2020-02-14 18:57:46 Executor: INFO: Running task 326.0 in stage 1.0 (TID 327) 2020-02-14 18:57:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10938744832+33554432 2020-02-14 18:57:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:58:43 Executor: INFO: Finished task 326.0 in stage 1.0 (TID 327). 1668 bytes result sent to driver 2020-02-14 18:58:43 TaskSetManager: INFO: Starting task 327.0 in stage 1.0 (TID 328, localhost, executor driver, partition 327, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:58:43 TaskSetManager: INFO: Finished task 326.0 in stage 1.0 (TID 327) in 56823 ms on localhost (executor driver) (327/882) 2020-02-14 18:58:43 Executor: INFO: Running task 327.0 in stage 1.0 (TID 328) 2020-02-14 18:58:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:10972299264+33554432 2020-02-14 18:58:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 18:59:32 Executor: INFO: Finished task 327.0 in stage 1.0 (TID 328). 1616 bytes result sent to driver 2020-02-14 18:59:32 TaskSetManager: INFO: Starting task 328.0 in stage 1.0 (TID 329, localhost, executor driver, partition 328, PROCESS_LOCAL, 7933 bytes) 2020-02-14 18:59:32 TaskSetManager: INFO: Finished task 327.0 in stage 1.0 (TID 328) in 48785 ms on localhost (executor driver) (328/882) 2020-02-14 18:59:32 Executor: INFO: Running task 328.0 in stage 1.0 (TID 329) 2020-02-14 18:59:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11005853696+33554432 2020-02-14 18:59:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:00:32 Executor: INFO: Finished task 328.0 in stage 1.0 (TID 329). 1602 bytes result sent to driver 2020-02-14 19:00:32 TaskSetManager: INFO: Starting task 329.0 in stage 1.0 (TID 330, localhost, executor driver, partition 329, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:00:32 TaskSetManager: INFO: Finished task 328.0 in stage 1.0 (TID 329) in 60029 ms on localhost (executor driver) (329/882) 2020-02-14 19:00:32 Executor: INFO: Running task 329.0 in stage 1.0 (TID 330) 2020-02-14 19:00:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11039408128+33554432 2020-02-14 19:00:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:01:25 Executor: INFO: Finished task 329.0 in stage 1.0 (TID 330). 1645 bytes result sent to driver 2020-02-14 19:01:25 TaskSetManager: INFO: Starting task 330.0 in stage 1.0 (TID 331, localhost, executor driver, partition 330, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:01:25 TaskSetManager: INFO: Finished task 329.0 in stage 1.0 (TID 330) in 52666 ms on localhost (executor driver) (330/882) 2020-02-14 19:01:25 Executor: INFO: Running task 330.0 in stage 1.0 (TID 331) 2020-02-14 19:01:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11072962560+33554432 2020-02-14 19:01:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:02:16 Executor: INFO: Finished task 330.0 in stage 1.0 (TID 331). 1608 bytes result sent to driver 2020-02-14 19:02:16 TaskSetManager: INFO: Starting task 331.0 in stage 1.0 (TID 332, localhost, executor driver, partition 331, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:02:16 TaskSetManager: INFO: Finished task 330.0 in stage 1.0 (TID 331) in 51215 ms on localhost (executor driver) (331/882) 2020-02-14 19:02:16 Executor: INFO: Running task 331.0 in stage 1.0 (TID 332) 2020-02-14 19:02:16 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11106516992+33554432 2020-02-14 19:02:16 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:03:13 Executor: INFO: Finished task 331.0 in stage 1.0 (TID 332). 1606 bytes result sent to driver 2020-02-14 19:03:13 TaskSetManager: INFO: Starting task 332.0 in stage 1.0 (TID 333, localhost, executor driver, partition 332, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:03:13 TaskSetManager: INFO: Finished task 331.0 in stage 1.0 (TID 332) in 56850 ms on localhost (executor driver) (332/882) 2020-02-14 19:03:13 Executor: INFO: Running task 332.0 in stage 1.0 (TID 333) 2020-02-14 19:03:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11140071424+33554432 2020-02-14 19:03:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:04:09 Executor: INFO: Finished task 332.0 in stage 1.0 (TID 333). 1602 bytes result sent to driver 2020-02-14 19:04:09 TaskSetManager: INFO: Starting task 333.0 in stage 1.0 (TID 334, localhost, executor driver, partition 333, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:04:09 TaskSetManager: INFO: Finished task 332.0 in stage 1.0 (TID 333) in 56480 ms on localhost (executor driver) (333/882) 2020-02-14 19:04:09 Executor: INFO: Running task 333.0 in stage 1.0 (TID 334) 2020-02-14 19:04:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11173625856+33554432 2020-02-14 19:04:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:05:12 Executor: INFO: Finished task 333.0 in stage 1.0 (TID 334). 1602 bytes result sent to driver 2020-02-14 19:05:12 TaskSetManager: INFO: Starting task 334.0 in stage 1.0 (TID 335, localhost, executor driver, partition 334, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:05:12 TaskSetManager: INFO: Finished task 333.0 in stage 1.0 (TID 334) in 62880 ms on localhost (executor driver) (334/882) 2020-02-14 19:05:12 Executor: INFO: Running task 334.0 in stage 1.0 (TID 335) 2020-02-14 19:05:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11207180288+33554432 2020-02-14 19:05:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:06:12 Executor: INFO: Finished task 334.0 in stage 1.0 (TID 335). 1602 bytes result sent to driver 2020-02-14 19:06:12 TaskSetManager: INFO: Starting task 335.0 in stage 1.0 (TID 336, localhost, executor driver, partition 335, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:06:12 TaskSetManager: INFO: Finished task 334.0 in stage 1.0 (TID 335) in 60487 ms on localhost (executor driver) (335/882) 2020-02-14 19:06:12 Executor: INFO: Running task 335.0 in stage 1.0 (TID 336) 2020-02-14 19:06:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11240734720+33554432 2020-02-14 19:06:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:07:10 Executor: INFO: Finished task 335.0 in stage 1.0 (TID 336). 1602 bytes result sent to driver 2020-02-14 19:07:10 TaskSetManager: INFO: Starting task 336.0 in stage 1.0 (TID 337, localhost, executor driver, partition 336, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:07:10 TaskSetManager: INFO: Finished task 335.0 in stage 1.0 (TID 336) in 57259 ms on localhost (executor driver) (336/882) 2020-02-14 19:07:10 Executor: INFO: Running task 336.0 in stage 1.0 (TID 337) 2020-02-14 19:07:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11274289152+33554432 2020-02-14 19:07:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:08:11 Executor: INFO: Finished task 336.0 in stage 1.0 (TID 337). 1649 bytes result sent to driver 2020-02-14 19:08:11 TaskSetManager: INFO: Starting task 337.0 in stage 1.0 (TID 338, localhost, executor driver, partition 337, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:08:11 TaskSetManager: INFO: Finished task 336.0 in stage 1.0 (TID 337) in 60807 ms on localhost (executor driver) (337/882) 2020-02-14 19:08:11 Executor: INFO: Running task 337.0 in stage 1.0 (TID 338) 2020-02-14 19:08:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11307843584+33554432 2020-02-14 19:08:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:09:08 Executor: INFO: Finished task 337.0 in stage 1.0 (TID 338). 1621 bytes result sent to driver 2020-02-14 19:09:08 TaskSetManager: INFO: Starting task 338.0 in stage 1.0 (TID 339, localhost, executor driver, partition 338, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:09:08 TaskSetManager: INFO: Finished task 337.0 in stage 1.0 (TID 338) in 56996 ms on localhost (executor driver) (338/882) 2020-02-14 19:09:08 Executor: INFO: Running task 338.0 in stage 1.0 (TID 339) 2020-02-14 19:09:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11341398016+33554432 2020-02-14 19:09:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:10:13 Executor: INFO: Finished task 338.0 in stage 1.0 (TID 339). 1672 bytes result sent to driver 2020-02-14 19:10:13 TaskSetManager: INFO: Starting task 339.0 in stage 1.0 (TID 340, localhost, executor driver, partition 339, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:10:13 TaskSetManager: INFO: Finished task 338.0 in stage 1.0 (TID 339) in 65166 ms on localhost (executor driver) (339/882) 2020-02-14 19:10:13 Executor: INFO: Running task 339.0 in stage 1.0 (TID 340) 2020-02-14 19:10:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11374952448+33554432 2020-02-14 19:10:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:11:14 Executor: INFO: Finished task 339.0 in stage 1.0 (TID 340). 1619 bytes result sent to driver 2020-02-14 19:11:14 TaskSetManager: INFO: Starting task 340.0 in stage 1.0 (TID 341, localhost, executor driver, partition 340, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:11:14 TaskSetManager: INFO: Finished task 339.0 in stage 1.0 (TID 340) in 61241 ms on localhost (executor driver) (340/882) 2020-02-14 19:11:14 Executor: INFO: Running task 340.0 in stage 1.0 (TID 341) 2020-02-14 19:11:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11408506880+33554432 2020-02-14 19:11:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:12:11 Executor: INFO: Finished task 340.0 in stage 1.0 (TID 341). 1609 bytes result sent to driver 2020-02-14 19:12:11 TaskSetManager: INFO: Starting task 341.0 in stage 1.0 (TID 342, localhost, executor driver, partition 341, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:12:11 TaskSetManager: INFO: Finished task 340.0 in stage 1.0 (TID 341) in 56945 ms on localhost (executor driver) (341/882) 2020-02-14 19:12:11 Executor: INFO: Running task 341.0 in stage 1.0 (TID 342) 2020-02-14 19:12:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11442061312+33554432 2020-02-14 19:12:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:13:10 Executor: INFO: Finished task 341.0 in stage 1.0 (TID 342). 1602 bytes result sent to driver 2020-02-14 19:13:10 TaskSetManager: INFO: Starting task 342.0 in stage 1.0 (TID 343, localhost, executor driver, partition 342, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:13:10 TaskSetManager: INFO: Finished task 341.0 in stage 1.0 (TID 342) in 58760 ms on localhost (executor driver) (342/882) 2020-02-14 19:13:10 Executor: INFO: Running task 342.0 in stage 1.0 (TID 343) 2020-02-14 19:13:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11475615744+33554432 2020-02-14 19:13:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:14:10 Executor: INFO: Finished task 342.0 in stage 1.0 (TID 343). 1602 bytes result sent to driver 2020-02-14 19:14:10 TaskSetManager: INFO: Starting task 343.0 in stage 1.0 (TID 344, localhost, executor driver, partition 343, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:14:10 TaskSetManager: INFO: Finished task 342.0 in stage 1.0 (TID 343) in 60652 ms on localhost (executor driver) (343/882) 2020-02-14 19:14:10 Executor: INFO: Running task 343.0 in stage 1.0 (TID 344) 2020-02-14 19:14:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11509170176+33554432 2020-02-14 19:14:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:15:02 Executor: INFO: Finished task 343.0 in stage 1.0 (TID 344). 1611 bytes result sent to driver 2020-02-14 19:15:02 TaskSetManager: INFO: Starting task 344.0 in stage 1.0 (TID 345, localhost, executor driver, partition 344, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:15:02 TaskSetManager: INFO: Finished task 343.0 in stage 1.0 (TID 344) in 51692 ms on localhost (executor driver) (344/882) 2020-02-14 19:15:02 Executor: INFO: Running task 344.0 in stage 1.0 (TID 345) 2020-02-14 19:15:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11542724608+33554432 2020-02-14 19:15:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:15:59 Executor: INFO: Finished task 344.0 in stage 1.0 (TID 345). 1646 bytes result sent to driver 2020-02-14 19:15:59 TaskSetManager: INFO: Starting task 345.0 in stage 1.0 (TID 346, localhost, executor driver, partition 345, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:15:59 TaskSetManager: INFO: Finished task 344.0 in stage 1.0 (TID 345) in 56734 ms on localhost (executor driver) (345/882) 2020-02-14 19:15:59 Executor: INFO: Running task 345.0 in stage 1.0 (TID 346) 2020-02-14 19:15:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11576279040+33554432 2020-02-14 19:15:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:16:54 Executor: INFO: Finished task 345.0 in stage 1.0 (TID 346). 1606 bytes result sent to driver 2020-02-14 19:16:54 TaskSetManager: INFO: Starting task 346.0 in stage 1.0 (TID 347, localhost, executor driver, partition 346, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:16:54 TaskSetManager: INFO: Finished task 345.0 in stage 1.0 (TID 346) in 55449 ms on localhost (executor driver) (346/882) 2020-02-14 19:16:54 Executor: INFO: Running task 346.0 in stage 1.0 (TID 347) 2020-02-14 19:16:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11609833472+33554432 2020-02-14 19:16:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:17:51 Executor: INFO: Finished task 346.0 in stage 1.0 (TID 347). 1602 bytes result sent to driver 2020-02-14 19:17:51 TaskSetManager: INFO: Starting task 347.0 in stage 1.0 (TID 348, localhost, executor driver, partition 347, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:17:51 TaskSetManager: INFO: Finished task 346.0 in stage 1.0 (TID 347) in 56336 ms on localhost (executor driver) (347/882) 2020-02-14 19:17:51 Executor: INFO: Running task 347.0 in stage 1.0 (TID 348) 2020-02-14 19:17:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11643387904+33554432 2020-02-14 19:17:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:18:48 Executor: INFO: Finished task 347.0 in stage 1.0 (TID 348). 1602 bytes result sent to driver 2020-02-14 19:18:48 TaskSetManager: INFO: Starting task 348.0 in stage 1.0 (TID 349, localhost, executor driver, partition 348, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:18:48 TaskSetManager: INFO: Finished task 347.0 in stage 1.0 (TID 348) in 57980 ms on localhost (executor driver) (348/882) 2020-02-14 19:18:48 Executor: INFO: Running task 348.0 in stage 1.0 (TID 349) 2020-02-14 19:18:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11676942336+33554432 2020-02-14 19:18:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:19:51 Executor: INFO: Finished task 348.0 in stage 1.0 (TID 349). 1602 bytes result sent to driver 2020-02-14 19:19:51 TaskSetManager: INFO: Starting task 349.0 in stage 1.0 (TID 350, localhost, executor driver, partition 349, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:19:51 TaskSetManager: INFO: Finished task 348.0 in stage 1.0 (TID 349) in 62034 ms on localhost (executor driver) (349/882) 2020-02-14 19:19:51 Executor: INFO: Running task 349.0 in stage 1.0 (TID 350) 2020-02-14 19:19:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11710496768+33554432 2020-02-14 19:19:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:20:40 Executor: INFO: Finished task 349.0 in stage 1.0 (TID 350). 1769 bytes result sent to driver 2020-02-14 19:20:40 TaskSetManager: INFO: Starting task 350.0 in stage 1.0 (TID 351, localhost, executor driver, partition 350, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:20:40 TaskSetManager: INFO: Finished task 349.0 in stage 1.0 (TID 350) in 49577 ms on localhost (executor driver) (350/882) 2020-02-14 19:20:40 Executor: INFO: Running task 350.0 in stage 1.0 (TID 351) 2020-02-14 19:20:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11744051200+33554432 2020-02-14 19:20:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:21:48 Executor: INFO: Finished task 350.0 in stage 1.0 (TID 351). 1602 bytes result sent to driver 2020-02-14 19:21:48 TaskSetManager: INFO: Starting task 351.0 in stage 1.0 (TID 352, localhost, executor driver, partition 351, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:21:48 TaskSetManager: INFO: Finished task 350.0 in stage 1.0 (TID 351) in 67479 ms on localhost (executor driver) (351/882) 2020-02-14 19:21:48 Executor: INFO: Running task 351.0 in stage 1.0 (TID 352) 2020-02-14 19:21:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11777605632+33554432 2020-02-14 19:21:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:22:51 Executor: INFO: Finished task 351.0 in stage 1.0 (TID 352). 1605 bytes result sent to driver 2020-02-14 19:22:51 TaskSetManager: INFO: Starting task 352.0 in stage 1.0 (TID 353, localhost, executor driver, partition 352, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:22:51 TaskSetManager: INFO: Finished task 351.0 in stage 1.0 (TID 352) in 63594 ms on localhost (executor driver) (352/882) 2020-02-14 19:22:51 Executor: INFO: Running task 352.0 in stage 1.0 (TID 353) 2020-02-14 19:22:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11811160064+33554432 2020-02-14 19:22:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:23:53 Executor: INFO: Finished task 352.0 in stage 1.0 (TID 353). 1609 bytes result sent to driver 2020-02-14 19:23:53 TaskSetManager: INFO: Starting task 353.0 in stage 1.0 (TID 354, localhost, executor driver, partition 353, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:23:53 TaskSetManager: INFO: Finished task 352.0 in stage 1.0 (TID 353) in 61387 ms on localhost (executor driver) (353/882) 2020-02-14 19:23:53 Executor: INFO: Running task 353.0 in stage 1.0 (TID 354) 2020-02-14 19:23:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11844714496+33554432 2020-02-14 19:23:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:25:00 Executor: INFO: Finished task 353.0 in stage 1.0 (TID 354). 1610 bytes result sent to driver 2020-02-14 19:25:00 TaskSetManager: INFO: Starting task 354.0 in stage 1.0 (TID 355, localhost, executor driver, partition 354, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:25:00 TaskSetManager: INFO: Finished task 353.0 in stage 1.0 (TID 354) in 66981 ms on localhost (executor driver) (354/882) 2020-02-14 19:25:00 Executor: INFO: Running task 354.0 in stage 1.0 (TID 355) 2020-02-14 19:25:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11878268928+33554432 2020-02-14 19:25:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:26:04 Executor: INFO: Finished task 354.0 in stage 1.0 (TID 355). 1602 bytes result sent to driver 2020-02-14 19:26:04 TaskSetManager: INFO: Starting task 355.0 in stage 1.0 (TID 356, localhost, executor driver, partition 355, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:26:04 TaskSetManager: INFO: Finished task 354.0 in stage 1.0 (TID 355) in 64272 ms on localhost (executor driver) (355/882) 2020-02-14 19:26:04 Executor: INFO: Running task 355.0 in stage 1.0 (TID 356) 2020-02-14 19:26:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11911823360+33554432 2020-02-14 19:26:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:26:59 Executor: INFO: Finished task 355.0 in stage 1.0 (TID 356). 1602 bytes result sent to driver 2020-02-14 19:26:59 TaskSetManager: INFO: Starting task 356.0 in stage 1.0 (TID 357, localhost, executor driver, partition 356, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:26:59 TaskSetManager: INFO: Finished task 355.0 in stage 1.0 (TID 356) in 55176 ms on localhost (executor driver) (356/882) 2020-02-14 19:26:59 Executor: INFO: Running task 356.0 in stage 1.0 (TID 357) 2020-02-14 19:26:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11945377792+33554432 2020-02-14 19:26:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:28:03 Executor: INFO: Finished task 356.0 in stage 1.0 (TID 357). 1631 bytes result sent to driver 2020-02-14 19:28:03 TaskSetManager: INFO: Starting task 357.0 in stage 1.0 (TID 358, localhost, executor driver, partition 357, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:28:03 TaskSetManager: INFO: Finished task 356.0 in stage 1.0 (TID 357) in 64306 ms on localhost (executor driver) (357/882) 2020-02-14 19:28:03 Executor: INFO: Running task 357.0 in stage 1.0 (TID 358) 2020-02-14 19:28:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:11978932224+33554432 2020-02-14 19:28:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:29:07 Executor: INFO: Finished task 357.0 in stage 1.0 (TID 358). 1632 bytes result sent to driver 2020-02-14 19:29:07 TaskSetManager: INFO: Starting task 358.0 in stage 1.0 (TID 359, localhost, executor driver, partition 358, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:29:07 TaskSetManager: INFO: Finished task 357.0 in stage 1.0 (TID 358) in 63909 ms on localhost (executor driver) (358/882) 2020-02-14 19:29:07 Executor: INFO: Running task 358.0 in stage 1.0 (TID 359) 2020-02-14 19:29:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12012486656+33554432 2020-02-14 19:29:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:30:00 Executor: INFO: Finished task 358.0 in stage 1.0 (TID 359). 1602 bytes result sent to driver 2020-02-14 19:30:00 TaskSetManager: INFO: Starting task 359.0 in stage 1.0 (TID 360, localhost, executor driver, partition 359, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:30:00 TaskSetManager: INFO: Finished task 358.0 in stage 1.0 (TID 359) in 52843 ms on localhost (executor driver) (359/882) 2020-02-14 19:30:00 Executor: INFO: Running task 359.0 in stage 1.0 (TID 360) 2020-02-14 19:30:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12046041088+33554432 2020-02-14 19:30:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:30:57 Executor: INFO: Finished task 359.0 in stage 1.0 (TID 360). 1604 bytes result sent to driver 2020-02-14 19:30:57 TaskSetManager: INFO: Starting task 360.0 in stage 1.0 (TID 361, localhost, executor driver, partition 360, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:30:57 TaskSetManager: INFO: Finished task 359.0 in stage 1.0 (TID 360) in 57334 ms on localhost (executor driver) (360/882) 2020-02-14 19:30:57 Executor: INFO: Running task 360.0 in stage 1.0 (TID 361) 2020-02-14 19:30:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12079595520+33554432 2020-02-14 19:30:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:31:58 Executor: INFO: Finished task 360.0 in stage 1.0 (TID 361). 1625 bytes result sent to driver 2020-02-14 19:31:58 TaskSetManager: INFO: Starting task 361.0 in stage 1.0 (TID 362, localhost, executor driver, partition 361, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:31:58 TaskSetManager: INFO: Finished task 360.0 in stage 1.0 (TID 361) in 61014 ms on localhost (executor driver) (361/882) 2020-02-14 19:31:58 Executor: INFO: Running task 361.0 in stage 1.0 (TID 362) 2020-02-14 19:31:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12113149952+33554432 2020-02-14 19:31:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:33:00 Executor: INFO: Finished task 361.0 in stage 1.0 (TID 362). 1607 bytes result sent to driver 2020-02-14 19:33:00 TaskSetManager: INFO: Starting task 362.0 in stage 1.0 (TID 363, localhost, executor driver, partition 362, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:33:00 TaskSetManager: INFO: Finished task 361.0 in stage 1.0 (TID 362) in 62044 ms on localhost (executor driver) (362/882) 2020-02-14 19:33:00 Executor: INFO: Running task 362.0 in stage 1.0 (TID 363) 2020-02-14 19:33:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12146704384+33554432 2020-02-14 19:33:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:33:42 Executor: INFO: Finished task 362.0 in stage 1.0 (TID 363). 1643 bytes result sent to driver 2020-02-14 19:33:42 TaskSetManager: INFO: Starting task 363.0 in stage 1.0 (TID 364, localhost, executor driver, partition 363, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:33:42 TaskSetManager: INFO: Finished task 362.0 in stage 1.0 (TID 363) in 41231 ms on localhost (executor driver) (363/882) 2020-02-14 19:33:42 Executor: INFO: Running task 363.0 in stage 1.0 (TID 364) 2020-02-14 19:33:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12180258816+33554432 2020-02-14 19:33:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:34:33 Executor: INFO: Finished task 363.0 in stage 1.0 (TID 364). 1630 bytes result sent to driver 2020-02-14 19:34:33 TaskSetManager: INFO: Starting task 364.0 in stage 1.0 (TID 365, localhost, executor driver, partition 364, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:34:33 TaskSetManager: INFO: Finished task 363.0 in stage 1.0 (TID 364) in 51336 ms on localhost (executor driver) (364/882) 2020-02-14 19:34:33 Executor: INFO: Running task 364.0 in stage 1.0 (TID 365) 2020-02-14 19:34:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12213813248+33554432 2020-02-14 19:34:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:35:29 Executor: INFO: Finished task 364.0 in stage 1.0 (TID 365). 1602 bytes result sent to driver 2020-02-14 19:35:29 TaskSetManager: INFO: Starting task 365.0 in stage 1.0 (TID 366, localhost, executor driver, partition 365, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:35:29 TaskSetManager: INFO: Finished task 364.0 in stage 1.0 (TID 365) in 56087 ms on localhost (executor driver) (365/882) 2020-02-14 19:35:29 Executor: INFO: Running task 365.0 in stage 1.0 (TID 366) 2020-02-14 19:35:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12247367680+33554432 2020-02-14 19:35:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:36:19 Executor: INFO: Finished task 365.0 in stage 1.0 (TID 366). 1649 bytes result sent to driver 2020-02-14 19:36:19 TaskSetManager: INFO: Starting task 366.0 in stage 1.0 (TID 367, localhost, executor driver, partition 366, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:36:19 TaskSetManager: INFO: Finished task 365.0 in stage 1.0 (TID 366) in 50207 ms on localhost (executor driver) (366/882) 2020-02-14 19:36:19 Executor: INFO: Running task 366.0 in stage 1.0 (TID 367) 2020-02-14 19:36:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12280922112+33554432 2020-02-14 19:36:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:37:00 Executor: INFO: Finished task 366.0 in stage 1.0 (TID 367). 1609 bytes result sent to driver 2020-02-14 19:37:00 TaskSetManager: INFO: Starting task 367.0 in stage 1.0 (TID 368, localhost, executor driver, partition 367, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:37:00 TaskSetManager: INFO: Finished task 366.0 in stage 1.0 (TID 367) in 40996 ms on localhost (executor driver) (367/882) 2020-02-14 19:37:00 Executor: INFO: Running task 367.0 in stage 1.0 (TID 368) 2020-02-14 19:37:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12314476544+33554432 2020-02-14 19:37:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:37:48 Executor: INFO: Finished task 367.0 in stage 1.0 (TID 368). 1602 bytes result sent to driver 2020-02-14 19:37:48 TaskSetManager: INFO: Starting task 368.0 in stage 1.0 (TID 369, localhost, executor driver, partition 368, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:37:48 TaskSetManager: INFO: Finished task 367.0 in stage 1.0 (TID 368) in 47349 ms on localhost (executor driver) (368/882) 2020-02-14 19:37:48 Executor: INFO: Running task 368.0 in stage 1.0 (TID 369) 2020-02-14 19:37:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12348030976+33554432 2020-02-14 19:37:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:38:36 Executor: INFO: Finished task 368.0 in stage 1.0 (TID 369). 1626 bytes result sent to driver 2020-02-14 19:38:36 TaskSetManager: INFO: Starting task 369.0 in stage 1.0 (TID 370, localhost, executor driver, partition 369, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:38:36 TaskSetManager: INFO: Finished task 368.0 in stage 1.0 (TID 369) in 48525 ms on localhost (executor driver) (369/882) 2020-02-14 19:38:36 Executor: INFO: Running task 369.0 in stage 1.0 (TID 370) 2020-02-14 19:38:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12381585408+33554432 2020-02-14 19:38:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:39:25 Executor: INFO: Finished task 369.0 in stage 1.0 (TID 370). 1604 bytes result sent to driver 2020-02-14 19:39:25 TaskSetManager: INFO: Starting task 370.0 in stage 1.0 (TID 371, localhost, executor driver, partition 370, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:39:25 TaskSetManager: INFO: Finished task 369.0 in stage 1.0 (TID 370) in 49060 ms on localhost (executor driver) (370/882) 2020-02-14 19:39:25 Executor: INFO: Running task 370.0 in stage 1.0 (TID 371) 2020-02-14 19:39:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12415139840+33554432 2020-02-14 19:39:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:40:14 Executor: INFO: Finished task 370.0 in stage 1.0 (TID 371). 1661 bytes result sent to driver 2020-02-14 19:40:14 TaskSetManager: INFO: Starting task 371.0 in stage 1.0 (TID 372, localhost, executor driver, partition 371, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:40:14 TaskSetManager: INFO: Finished task 370.0 in stage 1.0 (TID 371) in 48816 ms on localhost (executor driver) (371/882) 2020-02-14 19:40:14 Executor: INFO: Running task 371.0 in stage 1.0 (TID 372) 2020-02-14 19:40:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12448694272+33554432 2020-02-14 19:40:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:41:01 Executor: INFO: Finished task 371.0 in stage 1.0 (TID 372). 1646 bytes result sent to driver 2020-02-14 19:41:01 TaskSetManager: INFO: Starting task 372.0 in stage 1.0 (TID 373, localhost, executor driver, partition 372, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:41:01 TaskSetManager: INFO: Finished task 371.0 in stage 1.0 (TID 372) in 46769 ms on localhost (executor driver) (372/882) 2020-02-14 19:41:01 Executor: INFO: Running task 372.0 in stage 1.0 (TID 373) 2020-02-14 19:41:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12482248704+33554432 2020-02-14 19:41:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:41:57 Executor: INFO: Finished task 372.0 in stage 1.0 (TID 373). 1610 bytes result sent to driver 2020-02-14 19:41:57 TaskSetManager: INFO: Starting task 373.0 in stage 1.0 (TID 374, localhost, executor driver, partition 373, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:41:57 TaskSetManager: INFO: Finished task 372.0 in stage 1.0 (TID 373) in 55770 ms on localhost (executor driver) (373/882) 2020-02-14 19:41:57 Executor: INFO: Running task 373.0 in stage 1.0 (TID 374) 2020-02-14 19:41:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12515803136+33554432 2020-02-14 19:41:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:42:55 Executor: INFO: Finished task 373.0 in stage 1.0 (TID 374). 1672 bytes result sent to driver 2020-02-14 19:42:55 TaskSetManager: INFO: Starting task 374.0 in stage 1.0 (TID 375, localhost, executor driver, partition 374, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:42:55 TaskSetManager: INFO: Finished task 373.0 in stage 1.0 (TID 374) in 58863 ms on localhost (executor driver) (374/882) 2020-02-14 19:42:55 Executor: INFO: Running task 374.0 in stage 1.0 (TID 375) 2020-02-14 19:42:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12549357568+33554432 2020-02-14 19:42:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:43:52 Executor: INFO: Finished task 374.0 in stage 1.0 (TID 375). 1691 bytes result sent to driver 2020-02-14 19:43:52 TaskSetManager: INFO: Starting task 375.0 in stage 1.0 (TID 376, localhost, executor driver, partition 375, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:43:52 TaskSetManager: INFO: Finished task 374.0 in stage 1.0 (TID 375) in 56756 ms on localhost (executor driver) (375/882) 2020-02-14 19:43:52 Executor: INFO: Running task 375.0 in stage 1.0 (TID 376) 2020-02-14 19:43:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12582912000+33554432 2020-02-14 19:43:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:44:56 Executor: INFO: Finished task 375.0 in stage 1.0 (TID 376). 1669 bytes result sent to driver 2020-02-14 19:44:56 TaskSetManager: INFO: Starting task 376.0 in stage 1.0 (TID 377, localhost, executor driver, partition 376, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:44:56 TaskSetManager: INFO: Finished task 375.0 in stage 1.0 (TID 376) in 63323 ms on localhost (executor driver) (376/882) 2020-02-14 19:44:56 Executor: INFO: Running task 376.0 in stage 1.0 (TID 377) 2020-02-14 19:44:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12616466432+33554432 2020-02-14 19:44:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:45:55 Executor: INFO: Finished task 376.0 in stage 1.0 (TID 377). 1648 bytes result sent to driver 2020-02-14 19:45:55 TaskSetManager: INFO: Starting task 377.0 in stage 1.0 (TID 378, localhost, executor driver, partition 377, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:45:55 TaskSetManager: INFO: Finished task 376.0 in stage 1.0 (TID 377) in 59242 ms on localhost (executor driver) (377/882) 2020-02-14 19:45:55 Executor: INFO: Running task 377.0 in stage 1.0 (TID 378) 2020-02-14 19:45:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12650020864+33554432 2020-02-14 19:45:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:46:51 Executor: INFO: Finished task 377.0 in stage 1.0 (TID 378). 1602 bytes result sent to driver 2020-02-14 19:46:51 TaskSetManager: INFO: Starting task 378.0 in stage 1.0 (TID 379, localhost, executor driver, partition 378, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:46:51 TaskSetManager: INFO: Finished task 377.0 in stage 1.0 (TID 378) in 55803 ms on localhost (executor driver) (378/882) 2020-02-14 19:46:51 Executor: INFO: Running task 378.0 in stage 1.0 (TID 379) 2020-02-14 19:46:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12683575296+33554432 2020-02-14 19:46:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:47:41 Executor: INFO: Finished task 378.0 in stage 1.0 (TID 379). 1602 bytes result sent to driver 2020-02-14 19:47:41 TaskSetManager: INFO: Starting task 379.0 in stage 1.0 (TID 380, localhost, executor driver, partition 379, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:47:41 TaskSetManager: INFO: Finished task 378.0 in stage 1.0 (TID 379) in 50595 ms on localhost (executor driver) (379/882) 2020-02-14 19:47:41 Executor: INFO: Running task 379.0 in stage 1.0 (TID 380) 2020-02-14 19:47:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12717129728+33554432 2020-02-14 19:47:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:48:49 Executor: INFO: Finished task 379.0 in stage 1.0 (TID 380). 1602 bytes result sent to driver 2020-02-14 19:48:49 TaskSetManager: INFO: Starting task 380.0 in stage 1.0 (TID 381, localhost, executor driver, partition 380, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:48:49 TaskSetManager: INFO: Finished task 379.0 in stage 1.0 (TID 380) in 67916 ms on localhost (executor driver) (380/882) 2020-02-14 19:48:49 Executor: INFO: Running task 380.0 in stage 1.0 (TID 381) 2020-02-14 19:48:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12750684160+33554432 2020-02-14 19:48:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:49:55 Executor: INFO: Finished task 380.0 in stage 1.0 (TID 381). 1607 bytes result sent to driver 2020-02-14 19:49:55 TaskSetManager: INFO: Starting task 381.0 in stage 1.0 (TID 382, localhost, executor driver, partition 381, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:49:55 TaskSetManager: INFO: Finished task 380.0 in stage 1.0 (TID 381) in 65849 ms on localhost (executor driver) (381/882) 2020-02-14 19:49:55 Executor: INFO: Running task 381.0 in stage 1.0 (TID 382) 2020-02-14 19:49:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12784238592+33554432 2020-02-14 19:49:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:50:54 Executor: INFO: Finished task 381.0 in stage 1.0 (TID 382). 1608 bytes result sent to driver 2020-02-14 19:50:54 TaskSetManager: INFO: Starting task 382.0 in stage 1.0 (TID 383, localhost, executor driver, partition 382, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:50:54 TaskSetManager: INFO: Finished task 381.0 in stage 1.0 (TID 382) in 59000 ms on localhost (executor driver) (382/882) 2020-02-14 19:50:54 Executor: INFO: Running task 382.0 in stage 1.0 (TID 383) 2020-02-14 19:50:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12817793024+33554432 2020-02-14 19:50:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:51:57 Executor: INFO: Finished task 382.0 in stage 1.0 (TID 383). 1604 bytes result sent to driver 2020-02-14 19:51:57 TaskSetManager: INFO: Starting task 383.0 in stage 1.0 (TID 384, localhost, executor driver, partition 383, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:51:57 TaskSetManager: INFO: Finished task 382.0 in stage 1.0 (TID 383) in 63426 ms on localhost (executor driver) (383/882) 2020-02-14 19:51:57 Executor: INFO: Running task 383.0 in stage 1.0 (TID 384) 2020-02-14 19:51:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12851347456+33554432 2020-02-14 19:51:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:52:51 Executor: INFO: Finished task 383.0 in stage 1.0 (TID 384). 1602 bytes result sent to driver 2020-02-14 19:52:51 TaskSetManager: INFO: Starting task 384.0 in stage 1.0 (TID 385, localhost, executor driver, partition 384, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:52:51 TaskSetManager: INFO: Finished task 383.0 in stage 1.0 (TID 384) in 53274 ms on localhost (executor driver) (384/882) 2020-02-14 19:52:51 Executor: INFO: Running task 384.0 in stage 1.0 (TID 385) 2020-02-14 19:52:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12884901888+33554432 2020-02-14 19:52:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:53:56 Executor: INFO: Finished task 384.0 in stage 1.0 (TID 385). 1602 bytes result sent to driver 2020-02-14 19:53:56 TaskSetManager: INFO: Starting task 385.0 in stage 1.0 (TID 386, localhost, executor driver, partition 385, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:53:56 TaskSetManager: INFO: Finished task 384.0 in stage 1.0 (TID 385) in 65794 ms on localhost (executor driver) (385/882) 2020-02-14 19:53:56 Executor: INFO: Running task 385.0 in stage 1.0 (TID 386) 2020-02-14 19:53:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12918456320+33554432 2020-02-14 19:53:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:54:52 Executor: INFO: Finished task 385.0 in stage 1.0 (TID 386). 1603 bytes result sent to driver 2020-02-14 19:54:52 TaskSetManager: INFO: Starting task 386.0 in stage 1.0 (TID 387, localhost, executor driver, partition 386, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:54:52 TaskSetManager: INFO: Finished task 385.0 in stage 1.0 (TID 386) in 55922 ms on localhost (executor driver) (386/882) 2020-02-14 19:54:52 Executor: INFO: Running task 386.0 in stage 1.0 (TID 387) 2020-02-14 19:54:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12952010752+33554432 2020-02-14 19:54:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:55:56 Executor: INFO: Finished task 386.0 in stage 1.0 (TID 387). 1607 bytes result sent to driver 2020-02-14 19:55:56 TaskSetManager: INFO: Starting task 387.0 in stage 1.0 (TID 388, localhost, executor driver, partition 387, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:55:56 TaskSetManager: INFO: Finished task 386.0 in stage 1.0 (TID 387) in 64163 ms on localhost (executor driver) (387/882) 2020-02-14 19:55:56 Executor: INFO: Running task 387.0 in stage 1.0 (TID 388) 2020-02-14 19:55:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:12985565184+33554432 2020-02-14 19:55:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:57:00 Executor: INFO: Finished task 387.0 in stage 1.0 (TID 388). 1602 bytes result sent to driver 2020-02-14 19:57:00 TaskSetManager: INFO: Starting task 388.0 in stage 1.0 (TID 389, localhost, executor driver, partition 388, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:57:00 TaskSetManager: INFO: Finished task 387.0 in stage 1.0 (TID 388) in 63386 ms on localhost (executor driver) (388/882) 2020-02-14 19:57:00 Executor: INFO: Running task 388.0 in stage 1.0 (TID 389) 2020-02-14 19:57:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13019119616+33554432 2020-02-14 19:57:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:58:02 Executor: INFO: Finished task 388.0 in stage 1.0 (TID 389). 1602 bytes result sent to driver 2020-02-14 19:58:02 TaskSetManager: INFO: Starting task 389.0 in stage 1.0 (TID 390, localhost, executor driver, partition 389, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:58:02 TaskSetManager: INFO: Finished task 388.0 in stage 1.0 (TID 389) in 61786 ms on localhost (executor driver) (389/882) 2020-02-14 19:58:02 Executor: INFO: Running task 389.0 in stage 1.0 (TID 390) 2020-02-14 19:58:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13052674048+33554432 2020-02-14 19:58:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 19:58:55 Executor: INFO: Finished task 389.0 in stage 1.0 (TID 390). 1602 bytes result sent to driver 2020-02-14 19:58:55 TaskSetManager: INFO: Starting task 390.0 in stage 1.0 (TID 391, localhost, executor driver, partition 390, PROCESS_LOCAL, 7933 bytes) 2020-02-14 19:58:55 TaskSetManager: INFO: Finished task 389.0 in stage 1.0 (TID 390) in 53073 ms on localhost (executor driver) (390/882) 2020-02-14 19:58:55 Executor: INFO: Running task 390.0 in stage 1.0 (TID 391) 2020-02-14 19:58:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13086228480+33554432 2020-02-14 19:58:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:00:01 Executor: INFO: Finished task 390.0 in stage 1.0 (TID 391). 1609 bytes result sent to driver 2020-02-14 20:00:01 TaskSetManager: INFO: Starting task 391.0 in stage 1.0 (TID 392, localhost, executor driver, partition 391, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:00:01 TaskSetManager: INFO: Finished task 390.0 in stage 1.0 (TID 391) in 66084 ms on localhost (executor driver) (391/882) 2020-02-14 20:00:01 Executor: INFO: Running task 391.0 in stage 1.0 (TID 392) 2020-02-14 20:00:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13119782912+33554432 2020-02-14 20:00:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:01:07 Executor: INFO: Finished task 391.0 in stage 1.0 (TID 392). 1604 bytes result sent to driver 2020-02-14 20:01:07 TaskSetManager: INFO: Starting task 392.0 in stage 1.0 (TID 393, localhost, executor driver, partition 392, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:01:07 TaskSetManager: INFO: Finished task 391.0 in stage 1.0 (TID 392) in 66559 ms on localhost (executor driver) (392/882) 2020-02-14 20:01:07 Executor: INFO: Running task 392.0 in stage 1.0 (TID 393) 2020-02-14 20:01:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13153337344+33554432 2020-02-14 20:01:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:02:10 Executor: INFO: Finished task 392.0 in stage 1.0 (TID 393). 1684 bytes result sent to driver 2020-02-14 20:02:10 TaskSetManager: INFO: Starting task 393.0 in stage 1.0 (TID 394, localhost, executor driver, partition 393, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:02:10 TaskSetManager: INFO: Finished task 392.0 in stage 1.0 (TID 393) in 62649 ms on localhost (executor driver) (393/882) 2020-02-14 20:02:10 Executor: INFO: Running task 393.0 in stage 1.0 (TID 394) 2020-02-14 20:02:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13186891776+33554432 2020-02-14 20:02:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:03:07 Executor: INFO: Finished task 393.0 in stage 1.0 (TID 394). 1642 bytes result sent to driver 2020-02-14 20:03:07 TaskSetManager: INFO: Starting task 394.0 in stage 1.0 (TID 395, localhost, executor driver, partition 394, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:03:07 TaskSetManager: INFO: Finished task 393.0 in stage 1.0 (TID 394) in 57320 ms on localhost (executor driver) (394/882) 2020-02-14 20:03:07 Executor: INFO: Running task 394.0 in stage 1.0 (TID 395) 2020-02-14 20:03:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13220446208+33554432 2020-02-14 20:03:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:04:00 Executor: INFO: Finished task 394.0 in stage 1.0 (TID 395). 1605 bytes result sent to driver 2020-02-14 20:04:00 TaskSetManager: INFO: Starting task 395.0 in stage 1.0 (TID 396, localhost, executor driver, partition 395, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:04:00 TaskSetManager: INFO: Finished task 394.0 in stage 1.0 (TID 395) in 52637 ms on localhost (executor driver) (395/882) 2020-02-14 20:04:00 Executor: INFO: Running task 395.0 in stage 1.0 (TID 396) 2020-02-14 20:04:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13254000640+33554432 2020-02-14 20:04:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:04:56 Executor: INFO: Finished task 395.0 in stage 1.0 (TID 396). 1609 bytes result sent to driver 2020-02-14 20:04:56 TaskSetManager: INFO: Starting task 396.0 in stage 1.0 (TID 397, localhost, executor driver, partition 396, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:04:56 TaskSetManager: INFO: Finished task 395.0 in stage 1.0 (TID 396) in 56025 ms on localhost (executor driver) (396/882) 2020-02-14 20:04:56 Executor: INFO: Running task 396.0 in stage 1.0 (TID 397) 2020-02-14 20:04:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13287555072+33554432 2020-02-14 20:04:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:05:50 Executor: INFO: Finished task 396.0 in stage 1.0 (TID 397). 1602 bytes result sent to driver 2020-02-14 20:05:50 TaskSetManager: INFO: Starting task 397.0 in stage 1.0 (TID 398, localhost, executor driver, partition 397, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:05:50 TaskSetManager: INFO: Finished task 396.0 in stage 1.0 (TID 397) in 54412 ms on localhost (executor driver) (397/882) 2020-02-14 20:05:50 Executor: INFO: Running task 397.0 in stage 1.0 (TID 398) 2020-02-14 20:05:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13321109504+33554432 2020-02-14 20:05:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:06:53 Executor: INFO: Finished task 397.0 in stage 1.0 (TID 398). 1645 bytes result sent to driver 2020-02-14 20:06:53 TaskSetManager: INFO: Starting task 398.0 in stage 1.0 (TID 399, localhost, executor driver, partition 398, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:06:53 TaskSetManager: INFO: Finished task 397.0 in stage 1.0 (TID 398) in 63006 ms on localhost (executor driver) (398/882) 2020-02-14 20:06:53 Executor: INFO: Running task 398.0 in stage 1.0 (TID 399) 2020-02-14 20:06:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13354663936+33554432 2020-02-14 20:06:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:07:54 Executor: INFO: Finished task 398.0 in stage 1.0 (TID 399). 1609 bytes result sent to driver 2020-02-14 20:07:54 TaskSetManager: INFO: Starting task 399.0 in stage 1.0 (TID 400, localhost, executor driver, partition 399, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:07:54 TaskSetManager: INFO: Finished task 398.0 in stage 1.0 (TID 399) in 60891 ms on localhost (executor driver) (399/882) 2020-02-14 20:07:54 Executor: INFO: Running task 399.0 in stage 1.0 (TID 400) 2020-02-14 20:07:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13388218368+33554432 2020-02-14 20:07:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:08:44 Executor: INFO: Finished task 399.0 in stage 1.0 (TID 400). 1655 bytes result sent to driver 2020-02-14 20:08:44 TaskSetManager: INFO: Starting task 400.0 in stage 1.0 (TID 401, localhost, executor driver, partition 400, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:08:44 TaskSetManager: INFO: Finished task 399.0 in stage 1.0 (TID 400) in 49729 ms on localhost (executor driver) (400/882) 2020-02-14 20:08:44 Executor: INFO: Running task 400.0 in stage 1.0 (TID 401) 2020-02-14 20:08:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13421772800+33554432 2020-02-14 20:08:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:09:44 Executor: INFO: Finished task 400.0 in stage 1.0 (TID 401). 1646 bytes result sent to driver 2020-02-14 20:09:44 TaskSetManager: INFO: Starting task 401.0 in stage 1.0 (TID 402, localhost, executor driver, partition 401, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:09:44 TaskSetManager: INFO: Finished task 400.0 in stage 1.0 (TID 401) in 60290 ms on localhost (executor driver) (401/882) 2020-02-14 20:09:44 Executor: INFO: Running task 401.0 in stage 1.0 (TID 402) 2020-02-14 20:09:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13455327232+33554432 2020-02-14 20:09:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:10:47 Executor: INFO: Finished task 401.0 in stage 1.0 (TID 402). 1645 bytes result sent to driver 2020-02-14 20:10:47 TaskSetManager: INFO: Starting task 402.0 in stage 1.0 (TID 403, localhost, executor driver, partition 402, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:10:47 TaskSetManager: INFO: Finished task 401.0 in stage 1.0 (TID 402) in 62466 ms on localhost (executor driver) (402/882) 2020-02-14 20:10:47 Executor: INFO: Running task 402.0 in stage 1.0 (TID 403) 2020-02-14 20:10:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13488881664+33554432 2020-02-14 20:10:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:11:41 Executor: INFO: Finished task 402.0 in stage 1.0 (TID 403). 1615 bytes result sent to driver 2020-02-14 20:11:41 TaskSetManager: INFO: Starting task 403.0 in stage 1.0 (TID 404, localhost, executor driver, partition 403, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:11:41 TaskSetManager: INFO: Finished task 402.0 in stage 1.0 (TID 403) in 54297 ms on localhost (executor driver) (403/882) 2020-02-14 20:11:41 Executor: INFO: Running task 403.0 in stage 1.0 (TID 404) 2020-02-14 20:11:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13522436096+33554432 2020-02-14 20:11:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:12:35 Executor: INFO: Finished task 403.0 in stage 1.0 (TID 404). 1630 bytes result sent to driver 2020-02-14 20:12:35 TaskSetManager: INFO: Starting task 404.0 in stage 1.0 (TID 405, localhost, executor driver, partition 404, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:12:35 TaskSetManager: INFO: Finished task 403.0 in stage 1.0 (TID 404) in 54042 ms on localhost (executor driver) (404/882) 2020-02-14 20:12:35 Executor: INFO: Running task 404.0 in stage 1.0 (TID 405) 2020-02-14 20:12:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13555990528+33554432 2020-02-14 20:12:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:13:35 Executor: INFO: Finished task 404.0 in stage 1.0 (TID 405). 1614 bytes result sent to driver 2020-02-14 20:13:35 TaskSetManager: INFO: Starting task 405.0 in stage 1.0 (TID 406, localhost, executor driver, partition 405, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:13:35 TaskSetManager: INFO: Finished task 404.0 in stage 1.0 (TID 405) in 59543 ms on localhost (executor driver) (405/882) 2020-02-14 20:13:35 Executor: INFO: Running task 405.0 in stage 1.0 (TID 406) 2020-02-14 20:13:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13589544960+33554432 2020-02-14 20:13:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:14:30 Executor: INFO: Finished task 405.0 in stage 1.0 (TID 406). 1602 bytes result sent to driver 2020-02-14 20:14:30 TaskSetManager: INFO: Starting task 406.0 in stage 1.0 (TID 407, localhost, executor driver, partition 406, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:14:30 TaskSetManager: INFO: Finished task 405.0 in stage 1.0 (TID 406) in 55197 ms on localhost (executor driver) (406/882) 2020-02-14 20:14:30 Executor: INFO: Running task 406.0 in stage 1.0 (TID 407) 2020-02-14 20:14:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13623099392+33554432 2020-02-14 20:14:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:15:20 Executor: INFO: Finished task 406.0 in stage 1.0 (TID 407). 1639 bytes result sent to driver 2020-02-14 20:15:20 TaskSetManager: INFO: Starting task 407.0 in stage 1.0 (TID 408, localhost, executor driver, partition 407, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:15:20 TaskSetManager: INFO: Finished task 406.0 in stage 1.0 (TID 407) in 50575 ms on localhost (executor driver) (407/882) 2020-02-14 20:15:20 Executor: INFO: Running task 407.0 in stage 1.0 (TID 408) 2020-02-14 20:15:20 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13656653824+33554432 2020-02-14 20:15:20 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:16:19 Executor: INFO: Finished task 407.0 in stage 1.0 (TID 408). 1602 bytes result sent to driver 2020-02-14 20:16:19 TaskSetManager: INFO: Starting task 408.0 in stage 1.0 (TID 409, localhost, executor driver, partition 408, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:16:19 TaskSetManager: INFO: Finished task 407.0 in stage 1.0 (TID 408) in 58397 ms on localhost (executor driver) (408/882) 2020-02-14 20:16:19 Executor: INFO: Running task 408.0 in stage 1.0 (TID 409) 2020-02-14 20:16:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13690208256+33554432 2020-02-14 20:16:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:17:10 Executor: INFO: Finished task 408.0 in stage 1.0 (TID 409). 1602 bytes result sent to driver 2020-02-14 20:17:10 TaskSetManager: INFO: Starting task 409.0 in stage 1.0 (TID 410, localhost, executor driver, partition 409, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:17:10 TaskSetManager: INFO: Finished task 408.0 in stage 1.0 (TID 409) in 51312 ms on localhost (executor driver) (409/882) 2020-02-14 20:17:10 Executor: INFO: Running task 409.0 in stage 1.0 (TID 410) 2020-02-14 20:17:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13723762688+33554432 2020-02-14 20:17:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:18:05 Executor: INFO: Finished task 409.0 in stage 1.0 (TID 410). 1604 bytes result sent to driver 2020-02-14 20:18:05 TaskSetManager: INFO: Starting task 410.0 in stage 1.0 (TID 411, localhost, executor driver, partition 410, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:18:05 TaskSetManager: INFO: Finished task 409.0 in stage 1.0 (TID 410) in 55225 ms on localhost (executor driver) (410/882) 2020-02-14 20:18:05 Executor: INFO: Running task 410.0 in stage 1.0 (TID 411) 2020-02-14 20:18:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13757317120+33554432 2020-02-14 20:18:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:19:03 Executor: INFO: Finished task 410.0 in stage 1.0 (TID 411). 1614 bytes result sent to driver 2020-02-14 20:19:03 TaskSetManager: INFO: Starting task 411.0 in stage 1.0 (TID 412, localhost, executor driver, partition 411, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:19:03 TaskSetManager: INFO: Finished task 410.0 in stage 1.0 (TID 411) in 57322 ms on localhost (executor driver) (411/882) 2020-02-14 20:19:03 Executor: INFO: Running task 411.0 in stage 1.0 (TID 412) 2020-02-14 20:19:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13790871552+33554432 2020-02-14 20:19:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:19:52 Executor: INFO: Finished task 411.0 in stage 1.0 (TID 412). 1608 bytes result sent to driver 2020-02-14 20:19:52 TaskSetManager: INFO: Starting task 412.0 in stage 1.0 (TID 413, localhost, executor driver, partition 412, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:19:52 TaskSetManager: INFO: Finished task 411.0 in stage 1.0 (TID 412) in 49214 ms on localhost (executor driver) (412/882) 2020-02-14 20:19:52 Executor: INFO: Running task 412.0 in stage 1.0 (TID 413) 2020-02-14 20:19:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13824425984+33554432 2020-02-14 20:19:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:20:47 Executor: INFO: Finished task 412.0 in stage 1.0 (TID 413). 1625 bytes result sent to driver 2020-02-14 20:20:47 TaskSetManager: INFO: Starting task 413.0 in stage 1.0 (TID 414, localhost, executor driver, partition 413, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:20:47 TaskSetManager: INFO: Finished task 412.0 in stage 1.0 (TID 413) in 55021 ms on localhost (executor driver) (413/882) 2020-02-14 20:20:47 Executor: INFO: Running task 413.0 in stage 1.0 (TID 414) 2020-02-14 20:20:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13857980416+33554432 2020-02-14 20:20:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:21:36 Executor: INFO: Finished task 413.0 in stage 1.0 (TID 414). 1726 bytes result sent to driver 2020-02-14 20:21:36 TaskSetManager: INFO: Starting task 414.0 in stage 1.0 (TID 415, localhost, executor driver, partition 414, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:21:36 TaskSetManager: INFO: Finished task 413.0 in stage 1.0 (TID 414) in 49114 ms on localhost (executor driver) (414/882) 2020-02-14 20:21:36 Executor: INFO: Running task 414.0 in stage 1.0 (TID 415) 2020-02-14 20:21:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13891534848+33554432 2020-02-14 20:21:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:22:24 Executor: INFO: Finished task 414.0 in stage 1.0 (TID 415). 1616 bytes result sent to driver 2020-02-14 20:22:24 TaskSetManager: INFO: Starting task 415.0 in stage 1.0 (TID 416, localhost, executor driver, partition 415, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:22:24 TaskSetManager: INFO: Finished task 414.0 in stage 1.0 (TID 415) in 48112 ms on localhost (executor driver) (415/882) 2020-02-14 20:22:24 Executor: INFO: Running task 415.0 in stage 1.0 (TID 416) 2020-02-14 20:22:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13925089280+33554432 2020-02-14 20:22:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:23:08 Executor: INFO: Finished task 415.0 in stage 1.0 (TID 416). 1645 bytes result sent to driver 2020-02-14 20:23:08 TaskSetManager: INFO: Starting task 416.0 in stage 1.0 (TID 417, localhost, executor driver, partition 416, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:23:08 TaskSetManager: INFO: Finished task 415.0 in stage 1.0 (TID 416) in 43968 ms on localhost (executor driver) (416/882) 2020-02-14 20:23:08 Executor: INFO: Running task 416.0 in stage 1.0 (TID 417) 2020-02-14 20:23:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13958643712+33554432 2020-02-14 20:23:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:23:57 Executor: INFO: Finished task 416.0 in stage 1.0 (TID 417). 1606 bytes result sent to driver 2020-02-14 20:23:57 TaskSetManager: INFO: Starting task 417.0 in stage 1.0 (TID 418, localhost, executor driver, partition 417, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:23:57 TaskSetManager: INFO: Finished task 416.0 in stage 1.0 (TID 417) in 48976 ms on localhost (executor driver) (417/882) 2020-02-14 20:23:57 Executor: INFO: Running task 417.0 in stage 1.0 (TID 418) 2020-02-14 20:23:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:13992198144+33554432 2020-02-14 20:23:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:24:58 Executor: INFO: Finished task 417.0 in stage 1.0 (TID 418). 1602 bytes result sent to driver 2020-02-14 20:24:58 TaskSetManager: INFO: Starting task 418.0 in stage 1.0 (TID 419, localhost, executor driver, partition 418, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:24:58 TaskSetManager: INFO: Finished task 417.0 in stage 1.0 (TID 418) in 61256 ms on localhost (executor driver) (418/882) 2020-02-14 20:24:58 Executor: INFO: Running task 418.0 in stage 1.0 (TID 419) 2020-02-14 20:24:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14025752576+33554432 2020-02-14 20:24:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:25:59 Executor: INFO: Finished task 418.0 in stage 1.0 (TID 419). 1647 bytes result sent to driver 2020-02-14 20:25:59 TaskSetManager: INFO: Starting task 419.0 in stage 1.0 (TID 420, localhost, executor driver, partition 419, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:25:59 TaskSetManager: INFO: Finished task 418.0 in stage 1.0 (TID 419) in 61084 ms on localhost (executor driver) (419/882) 2020-02-14 20:25:59 Executor: INFO: Running task 419.0 in stage 1.0 (TID 420) 2020-02-14 20:25:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14059307008+33554432 2020-02-14 20:25:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:26:58 Executor: INFO: Finished task 419.0 in stage 1.0 (TID 420). 1602 bytes result sent to driver 2020-02-14 20:26:58 TaskSetManager: INFO: Starting task 420.0 in stage 1.0 (TID 421, localhost, executor driver, partition 420, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:26:58 TaskSetManager: INFO: Finished task 419.0 in stage 1.0 (TID 420) in 59032 ms on localhost (executor driver) (420/882) 2020-02-14 20:26:58 Executor: INFO: Running task 420.0 in stage 1.0 (TID 421) 2020-02-14 20:26:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14092861440+33554432 2020-02-14 20:26:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:28:00 Executor: INFO: Finished task 420.0 in stage 1.0 (TID 421). 1642 bytes result sent to driver 2020-02-14 20:28:00 TaskSetManager: INFO: Starting task 421.0 in stage 1.0 (TID 422, localhost, executor driver, partition 421, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:28:00 TaskSetManager: INFO: Finished task 420.0 in stage 1.0 (TID 421) in 61043 ms on localhost (executor driver) (421/882) 2020-02-14 20:28:00 Executor: INFO: Running task 421.0 in stage 1.0 (TID 422) 2020-02-14 20:28:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14126415872+33554432 2020-02-14 20:28:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:28:59 Executor: INFO: Finished task 421.0 in stage 1.0 (TID 422). 1602 bytes result sent to driver 2020-02-14 20:28:59 TaskSetManager: INFO: Starting task 422.0 in stage 1.0 (TID 423, localhost, executor driver, partition 422, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:28:59 TaskSetManager: INFO: Finished task 421.0 in stage 1.0 (TID 422) in 59345 ms on localhost (executor driver) (422/882) 2020-02-14 20:28:59 Executor: INFO: Running task 422.0 in stage 1.0 (TID 423) 2020-02-14 20:28:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14159970304+33554432 2020-02-14 20:28:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:30:02 Executor: INFO: Finished task 422.0 in stage 1.0 (TID 423). 1610 bytes result sent to driver 2020-02-14 20:30:02 TaskSetManager: INFO: Starting task 423.0 in stage 1.0 (TID 424, localhost, executor driver, partition 423, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:30:02 TaskSetManager: INFO: Finished task 422.0 in stage 1.0 (TID 423) in 62920 ms on localhost (executor driver) (423/882) 2020-02-14 20:30:02 Executor: INFO: Running task 423.0 in stage 1.0 (TID 424) 2020-02-14 20:30:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14193524736+33554432 2020-02-14 20:30:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:31:06 Executor: INFO: Finished task 423.0 in stage 1.0 (TID 424). 1602 bytes result sent to driver 2020-02-14 20:31:06 TaskSetManager: INFO: Starting task 424.0 in stage 1.0 (TID 425, localhost, executor driver, partition 424, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:31:06 TaskSetManager: INFO: Finished task 423.0 in stage 1.0 (TID 424) in 64421 ms on localhost (executor driver) (424/882) 2020-02-14 20:31:06 Executor: INFO: Running task 424.0 in stage 1.0 (TID 425) 2020-02-14 20:31:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14227079168+33554432 2020-02-14 20:31:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:32:07 Executor: INFO: Finished task 424.0 in stage 1.0 (TID 425). 1602 bytes result sent to driver 2020-02-14 20:32:07 TaskSetManager: INFO: Starting task 425.0 in stage 1.0 (TID 426, localhost, executor driver, partition 425, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:32:07 TaskSetManager: INFO: Finished task 424.0 in stage 1.0 (TID 425) in 61188 ms on localhost (executor driver) (425/882) 2020-02-14 20:32:07 Executor: INFO: Running task 425.0 in stage 1.0 (TID 426) 2020-02-14 20:32:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14260633600+33554432 2020-02-14 20:32:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:33:00 Executor: INFO: Finished task 425.0 in stage 1.0 (TID 426). 1645 bytes result sent to driver 2020-02-14 20:33:00 TaskSetManager: INFO: Starting task 426.0 in stage 1.0 (TID 427, localhost, executor driver, partition 426, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:33:00 TaskSetManager: INFO: Finished task 425.0 in stage 1.0 (TID 426) in 52383 ms on localhost (executor driver) (426/882) 2020-02-14 20:33:00 Executor: INFO: Running task 426.0 in stage 1.0 (TID 427) 2020-02-14 20:33:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14294188032+33554432 2020-02-14 20:33:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:33:49 Executor: INFO: Finished task 426.0 in stage 1.0 (TID 427). 1607 bytes result sent to driver 2020-02-14 20:33:49 TaskSetManager: INFO: Starting task 427.0 in stage 1.0 (TID 428, localhost, executor driver, partition 427, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:33:49 TaskSetManager: INFO: Finished task 426.0 in stage 1.0 (TID 427) in 49307 ms on localhost (executor driver) (427/882) 2020-02-14 20:33:49 Executor: INFO: Running task 427.0 in stage 1.0 (TID 428) 2020-02-14 20:33:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14327742464+33554432 2020-02-14 20:33:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:34:15 Executor: INFO: Finished task 427.0 in stage 1.0 (TID 428). 1722 bytes result sent to driver 2020-02-14 20:34:15 TaskSetManager: INFO: Starting task 428.0 in stage 1.0 (TID 429, localhost, executor driver, partition 428, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:34:15 TaskSetManager: INFO: Finished task 427.0 in stage 1.0 (TID 428) in 25605 ms on localhost (executor driver) (428/882) 2020-02-14 20:34:15 Executor: INFO: Running task 428.0 in stage 1.0 (TID 429) 2020-02-14 20:34:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14361296896+33554432 2020-02-14 20:34:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:35:00 Executor: INFO: Finished task 428.0 in stage 1.0 (TID 429). 1610 bytes result sent to driver 2020-02-14 20:35:00 TaskSetManager: INFO: Starting task 429.0 in stage 1.0 (TID 430, localhost, executor driver, partition 429, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:35:00 TaskSetManager: INFO: Finished task 428.0 in stage 1.0 (TID 429) in 45784 ms on localhost (executor driver) (429/882) 2020-02-14 20:35:00 Executor: INFO: Running task 429.0 in stage 1.0 (TID 430) 2020-02-14 20:35:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14394851328+33554432 2020-02-14 20:35:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:35:41 Executor: INFO: Finished task 429.0 in stage 1.0 (TID 430). 1607 bytes result sent to driver 2020-02-14 20:35:41 TaskSetManager: INFO: Starting task 430.0 in stage 1.0 (TID 431, localhost, executor driver, partition 430, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:35:41 TaskSetManager: INFO: Finished task 429.0 in stage 1.0 (TID 430) in 40345 ms on localhost (executor driver) (430/882) 2020-02-14 20:35:41 Executor: INFO: Running task 430.0 in stage 1.0 (TID 431) 2020-02-14 20:35:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14428405760+33554432 2020-02-14 20:35:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:36:37 Executor: INFO: Finished task 430.0 in stage 1.0 (TID 431). 1602 bytes result sent to driver 2020-02-14 20:36:37 TaskSetManager: INFO: Starting task 431.0 in stage 1.0 (TID 432, localhost, executor driver, partition 431, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:36:37 TaskSetManager: INFO: Finished task 430.0 in stage 1.0 (TID 431) in 56046 ms on localhost (executor driver) (431/882) 2020-02-14 20:36:37 Executor: INFO: Running task 431.0 in stage 1.0 (TID 432) 2020-02-14 20:36:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14461960192+33554432 2020-02-14 20:36:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:37:12 Executor: INFO: Finished task 431.0 in stage 1.0 (TID 432). 1624 bytes result sent to driver 2020-02-14 20:37:12 TaskSetManager: INFO: Starting task 432.0 in stage 1.0 (TID 433, localhost, executor driver, partition 432, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:37:12 TaskSetManager: INFO: Finished task 431.0 in stage 1.0 (TID 432) in 35503 ms on localhost (executor driver) (432/882) 2020-02-14 20:37:12 Executor: INFO: Running task 432.0 in stage 1.0 (TID 433) 2020-02-14 20:37:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14495514624+33554432 2020-02-14 20:37:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:38:09 Executor: INFO: Finished task 432.0 in stage 1.0 (TID 433). 1620 bytes result sent to driver 2020-02-14 20:38:09 TaskSetManager: INFO: Starting task 433.0 in stage 1.0 (TID 434, localhost, executor driver, partition 433, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:38:09 TaskSetManager: INFO: Finished task 432.0 in stage 1.0 (TID 433) in 56206 ms on localhost (executor driver) (433/882) 2020-02-14 20:38:09 Executor: INFO: Running task 433.0 in stage 1.0 (TID 434) 2020-02-14 20:38:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14529069056+33554432 2020-02-14 20:38:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:39:14 Executor: INFO: Finished task 433.0 in stage 1.0 (TID 434). 1602 bytes result sent to driver 2020-02-14 20:39:14 TaskSetManager: INFO: Starting task 434.0 in stage 1.0 (TID 435, localhost, executor driver, partition 434, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:39:14 TaskSetManager: INFO: Finished task 433.0 in stage 1.0 (TID 434) in 65740 ms on localhost (executor driver) (434/882) 2020-02-14 20:39:14 Executor: INFO: Running task 434.0 in stage 1.0 (TID 435) 2020-02-14 20:39:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14562623488+33554432 2020-02-14 20:39:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:40:13 Executor: INFO: Finished task 434.0 in stage 1.0 (TID 435). 1602 bytes result sent to driver 2020-02-14 20:40:13 TaskSetManager: INFO: Starting task 435.0 in stage 1.0 (TID 436, localhost, executor driver, partition 435, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:40:13 TaskSetManager: INFO: Finished task 434.0 in stage 1.0 (TID 435) in 58798 ms on localhost (executor driver) (435/882) 2020-02-14 20:40:13 Executor: INFO: Running task 435.0 in stage 1.0 (TID 436) 2020-02-14 20:40:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14596177920+33554432 2020-02-14 20:40:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:41:08 Executor: INFO: Finished task 435.0 in stage 1.0 (TID 436). 1650 bytes result sent to driver 2020-02-14 20:41:08 TaskSetManager: INFO: Starting task 436.0 in stage 1.0 (TID 437, localhost, executor driver, partition 436, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:41:08 TaskSetManager: INFO: Finished task 435.0 in stage 1.0 (TID 436) in 54636 ms on localhost (executor driver) (436/882) 2020-02-14 20:41:08 Executor: INFO: Running task 436.0 in stage 1.0 (TID 437) 2020-02-14 20:41:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14629732352+33554432 2020-02-14 20:41:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:42:01 Executor: INFO: Finished task 436.0 in stage 1.0 (TID 437). 1604 bytes result sent to driver 2020-02-14 20:42:01 TaskSetManager: INFO: Starting task 437.0 in stage 1.0 (TID 438, localhost, executor driver, partition 437, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:42:01 TaskSetManager: INFO: Finished task 436.0 in stage 1.0 (TID 437) in 53649 ms on localhost (executor driver) (437/882) 2020-02-14 20:42:01 Executor: INFO: Running task 437.0 in stage 1.0 (TID 438) 2020-02-14 20:42:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14663286784+33554432 2020-02-14 20:42:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:43:06 Executor: INFO: Finished task 437.0 in stage 1.0 (TID 438). 1645 bytes result sent to driver 2020-02-14 20:43:06 TaskSetManager: INFO: Starting task 438.0 in stage 1.0 (TID 439, localhost, executor driver, partition 438, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:43:06 TaskSetManager: INFO: Finished task 437.0 in stage 1.0 (TID 438) in 64925 ms on localhost (executor driver) (438/882) 2020-02-14 20:43:06 Executor: INFO: Running task 438.0 in stage 1.0 (TID 439) 2020-02-14 20:43:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14696841216+33554432 2020-02-14 20:43:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:44:01 Executor: INFO: Finished task 438.0 in stage 1.0 (TID 439). 1606 bytes result sent to driver 2020-02-14 20:44:01 TaskSetManager: INFO: Starting task 439.0 in stage 1.0 (TID 440, localhost, executor driver, partition 439, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:44:01 TaskSetManager: INFO: Finished task 438.0 in stage 1.0 (TID 439) in 54478 ms on localhost (executor driver) (439/882) 2020-02-14 20:44:01 Executor: INFO: Running task 439.0 in stage 1.0 (TID 440) 2020-02-14 20:44:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14730395648+33554432 2020-02-14 20:44:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:45:08 Executor: INFO: Finished task 439.0 in stage 1.0 (TID 440). 1645 bytes result sent to driver 2020-02-14 20:45:08 TaskSetManager: INFO: Starting task 440.0 in stage 1.0 (TID 441, localhost, executor driver, partition 440, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:45:08 TaskSetManager: INFO: Finished task 439.0 in stage 1.0 (TID 440) in 67565 ms on localhost (executor driver) (440/882) 2020-02-14 20:45:08 Executor: INFO: Running task 440.0 in stage 1.0 (TID 441) 2020-02-14 20:45:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14763950080+33554432 2020-02-14 20:45:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:45:58 Executor: INFO: Finished task 440.0 in stage 1.0 (TID 441). 1602 bytes result sent to driver 2020-02-14 20:45:58 TaskSetManager: INFO: Starting task 441.0 in stage 1.0 (TID 442, localhost, executor driver, partition 441, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:45:58 TaskSetManager: INFO: Finished task 440.0 in stage 1.0 (TID 441) in 49478 ms on localhost (executor driver) (441/882) 2020-02-14 20:45:58 Executor: INFO: Running task 441.0 in stage 1.0 (TID 442) 2020-02-14 20:45:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14797504512+33554432 2020-02-14 20:45:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:46:51 Executor: INFO: Finished task 441.0 in stage 1.0 (TID 442). 1602 bytes result sent to driver 2020-02-14 20:46:51 TaskSetManager: INFO: Starting task 442.0 in stage 1.0 (TID 443, localhost, executor driver, partition 442, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:46:51 TaskSetManager: INFO: Finished task 441.0 in stage 1.0 (TID 442) in 52690 ms on localhost (executor driver) (442/882) 2020-02-14 20:46:51 Executor: INFO: Running task 442.0 in stage 1.0 (TID 443) 2020-02-14 20:46:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14831058944+33554432 2020-02-14 20:46:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:47:32 Executor: INFO: Finished task 442.0 in stage 1.0 (TID 443). 1646 bytes result sent to driver 2020-02-14 20:47:32 TaskSetManager: INFO: Starting task 443.0 in stage 1.0 (TID 444, localhost, executor driver, partition 443, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:47:32 TaskSetManager: INFO: Finished task 442.0 in stage 1.0 (TID 443) in 41911 ms on localhost (executor driver) (443/882) 2020-02-14 20:47:32 Executor: INFO: Running task 443.0 in stage 1.0 (TID 444) 2020-02-14 20:47:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14864613376+33554432 2020-02-14 20:47:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:48:11 Executor: INFO: Finished task 443.0 in stage 1.0 (TID 444). 1637 bytes result sent to driver 2020-02-14 20:48:11 TaskSetManager: INFO: Starting task 444.0 in stage 1.0 (TID 445, localhost, executor driver, partition 444, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:48:11 TaskSetManager: INFO: Finished task 443.0 in stage 1.0 (TID 444) in 38925 ms on localhost (executor driver) (444/882) 2020-02-14 20:48:11 Executor: INFO: Running task 444.0 in stage 1.0 (TID 445) 2020-02-14 20:48:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14898167808+33554432 2020-02-14 20:48:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:48:46 Executor: INFO: Finished task 444.0 in stage 1.0 (TID 445). 1611 bytes result sent to driver 2020-02-14 20:48:46 TaskSetManager: INFO: Starting task 445.0 in stage 1.0 (TID 446, localhost, executor driver, partition 445, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:48:46 TaskSetManager: INFO: Finished task 444.0 in stage 1.0 (TID 445) in 34377 ms on localhost (executor driver) (445/882) 2020-02-14 20:48:46 Executor: INFO: Running task 445.0 in stage 1.0 (TID 446) 2020-02-14 20:48:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14931722240+33554432 2020-02-14 20:48:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:49:39 Executor: INFO: Finished task 445.0 in stage 1.0 (TID 446). 1659 bytes result sent to driver 2020-02-14 20:49:39 TaskSetManager: INFO: Starting task 446.0 in stage 1.0 (TID 447, localhost, executor driver, partition 446, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:49:39 TaskSetManager: INFO: Finished task 445.0 in stage 1.0 (TID 446) in 53527 ms on localhost (executor driver) (446/882) 2020-02-14 20:49:39 Executor: INFO: Running task 446.0 in stage 1.0 (TID 447) 2020-02-14 20:49:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14965276672+33554432 2020-02-14 20:49:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:50:34 Executor: INFO: Finished task 446.0 in stage 1.0 (TID 447). 1665 bytes result sent to driver 2020-02-14 20:50:34 TaskSetManager: INFO: Starting task 447.0 in stage 1.0 (TID 448, localhost, executor driver, partition 447, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:50:34 TaskSetManager: INFO: Finished task 446.0 in stage 1.0 (TID 447) in 55018 ms on localhost (executor driver) (447/882) 2020-02-14 20:50:34 Executor: INFO: Running task 447.0 in stage 1.0 (TID 448) 2020-02-14 20:50:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:14998831104+33554432 2020-02-14 20:50:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:51:27 Executor: INFO: Finished task 447.0 in stage 1.0 (TID 448). 1658 bytes result sent to driver 2020-02-14 20:51:27 TaskSetManager: INFO: Starting task 448.0 in stage 1.0 (TID 449, localhost, executor driver, partition 448, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:51:27 TaskSetManager: INFO: Finished task 447.0 in stage 1.0 (TID 448) in 53023 ms on localhost (executor driver) (448/882) 2020-02-14 20:51:27 Executor: INFO: Running task 448.0 in stage 1.0 (TID 449) 2020-02-14 20:51:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15032385536+33554432 2020-02-14 20:51:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:52:32 Executor: INFO: Finished task 448.0 in stage 1.0 (TID 449). 1602 bytes result sent to driver 2020-02-14 20:52:32 TaskSetManager: INFO: Starting task 449.0 in stage 1.0 (TID 450, localhost, executor driver, partition 449, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:52:32 TaskSetManager: INFO: Finished task 448.0 in stage 1.0 (TID 449) in 64892 ms on localhost (executor driver) (449/882) 2020-02-14 20:52:32 Executor: INFO: Running task 449.0 in stage 1.0 (TID 450) 2020-02-14 20:52:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15065939968+33554432 2020-02-14 20:52:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:53:23 Executor: INFO: Finished task 449.0 in stage 1.0 (TID 450). 1602 bytes result sent to driver 2020-02-14 20:53:23 TaskSetManager: INFO: Starting task 450.0 in stage 1.0 (TID 451, localhost, executor driver, partition 450, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:53:23 TaskSetManager: INFO: Finished task 449.0 in stage 1.0 (TID 450) in 51074 ms on localhost (executor driver) (450/882) 2020-02-14 20:53:23 Executor: INFO: Running task 450.0 in stage 1.0 (TID 451) 2020-02-14 20:53:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15099494400+33554432 2020-02-14 20:53:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:54:18 Executor: INFO: Finished task 450.0 in stage 1.0 (TID 451). 1604 bytes result sent to driver 2020-02-14 20:54:18 TaskSetManager: INFO: Starting task 451.0 in stage 1.0 (TID 452, localhost, executor driver, partition 451, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:54:18 TaskSetManager: INFO: Finished task 450.0 in stage 1.0 (TID 451) in 54911 ms on localhost (executor driver) (451/882) 2020-02-14 20:54:18 Executor: INFO: Running task 451.0 in stage 1.0 (TID 452) 2020-02-14 20:54:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15133048832+33554432 2020-02-14 20:54:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:55:22 Executor: INFO: Finished task 451.0 in stage 1.0 (TID 452). 1602 bytes result sent to driver 2020-02-14 20:55:22 TaskSetManager: INFO: Starting task 452.0 in stage 1.0 (TID 453, localhost, executor driver, partition 452, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:55:22 TaskSetManager: INFO: Finished task 451.0 in stage 1.0 (TID 452) in 63887 ms on localhost (executor driver) (452/882) 2020-02-14 20:55:22 Executor: INFO: Running task 452.0 in stage 1.0 (TID 453) 2020-02-14 20:55:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15166603264+33554432 2020-02-14 20:55:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:56:31 Executor: INFO: Finished task 452.0 in stage 1.0 (TID 453). 1645 bytes result sent to driver 2020-02-14 20:56:31 TaskSetManager: INFO: Starting task 453.0 in stage 1.0 (TID 454, localhost, executor driver, partition 453, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:56:31 TaskSetManager: INFO: Finished task 452.0 in stage 1.0 (TID 453) in 68912 ms on localhost (executor driver) (453/882) 2020-02-14 20:56:31 Executor: INFO: Running task 453.0 in stage 1.0 (TID 454) 2020-02-14 20:56:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15200157696+33554432 2020-02-14 20:56:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:57:30 Executor: INFO: Finished task 453.0 in stage 1.0 (TID 454). 1615 bytes result sent to driver 2020-02-14 20:57:30 TaskSetManager: INFO: Starting task 454.0 in stage 1.0 (TID 455, localhost, executor driver, partition 454, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:57:30 TaskSetManager: INFO: Finished task 453.0 in stage 1.0 (TID 454) in 58866 ms on localhost (executor driver) (454/882) 2020-02-14 20:57:30 Executor: INFO: Running task 454.0 in stage 1.0 (TID 455) 2020-02-14 20:57:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15233712128+33554432 2020-02-14 20:57:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:58:33 Executor: INFO: Finished task 454.0 in stage 1.0 (TID 455). 1602 bytes result sent to driver 2020-02-14 20:58:33 TaskSetManager: INFO: Starting task 455.0 in stage 1.0 (TID 456, localhost, executor driver, partition 455, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:58:33 TaskSetManager: INFO: Finished task 454.0 in stage 1.0 (TID 455) in 63357 ms on localhost (executor driver) (455/882) 2020-02-14 20:58:33 Executor: INFO: Running task 455.0 in stage 1.0 (TID 456) 2020-02-14 20:58:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15267266560+33554432 2020-02-14 20:58:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 20:59:30 Executor: INFO: Finished task 455.0 in stage 1.0 (TID 456). 1606 bytes result sent to driver 2020-02-14 20:59:30 TaskSetManager: INFO: Starting task 456.0 in stage 1.0 (TID 457, localhost, executor driver, partition 456, PROCESS_LOCAL, 7933 bytes) 2020-02-14 20:59:30 TaskSetManager: INFO: Finished task 455.0 in stage 1.0 (TID 456) in 56517 ms on localhost (executor driver) (456/882) 2020-02-14 20:59:30 Executor: INFO: Running task 456.0 in stage 1.0 (TID 457) 2020-02-14 20:59:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15300820992+33554432 2020-02-14 20:59:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:00:30 Executor: INFO: Finished task 456.0 in stage 1.0 (TID 457). 1627 bytes result sent to driver 2020-02-14 21:00:30 TaskSetManager: INFO: Starting task 457.0 in stage 1.0 (TID 458, localhost, executor driver, partition 457, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:00:30 TaskSetManager: INFO: Finished task 456.0 in stage 1.0 (TID 457) in 60505 ms on localhost (executor driver) (457/882) 2020-02-14 21:00:30 Executor: INFO: Running task 457.0 in stage 1.0 (TID 458) 2020-02-14 21:00:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15334375424+33554432 2020-02-14 21:00:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:01:30 Executor: INFO: Finished task 457.0 in stage 1.0 (TID 458). 1677 bytes result sent to driver 2020-02-14 21:01:30 TaskSetManager: INFO: Starting task 458.0 in stage 1.0 (TID 459, localhost, executor driver, partition 458, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:01:30 TaskSetManager: INFO: Finished task 457.0 in stage 1.0 (TID 458) in 59549 ms on localhost (executor driver) (458/882) 2020-02-14 21:01:30 Executor: INFO: Running task 458.0 in stage 1.0 (TID 459) 2020-02-14 21:01:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15367929856+33554432 2020-02-14 21:01:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:02:28 Executor: INFO: Finished task 458.0 in stage 1.0 (TID 459). 1658 bytes result sent to driver 2020-02-14 21:02:28 TaskSetManager: INFO: Starting task 459.0 in stage 1.0 (TID 460, localhost, executor driver, partition 459, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:02:28 TaskSetManager: INFO: Finished task 458.0 in stage 1.0 (TID 459) in 58490 ms on localhost (executor driver) (459/882) 2020-02-14 21:02:28 Executor: INFO: Running task 459.0 in stage 1.0 (TID 460) 2020-02-14 21:02:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15401484288+33554432 2020-02-14 21:02:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:03:18 Executor: INFO: Finished task 459.0 in stage 1.0 (TID 460). 1653 bytes result sent to driver 2020-02-14 21:03:18 TaskSetManager: INFO: Starting task 460.0 in stage 1.0 (TID 461, localhost, executor driver, partition 460, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:03:18 TaskSetManager: INFO: Finished task 459.0 in stage 1.0 (TID 460) in 49777 ms on localhost (executor driver) (460/882) 2020-02-14 21:03:18 Executor: INFO: Running task 460.0 in stage 1.0 (TID 461) 2020-02-14 21:03:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15435038720+33554432 2020-02-14 21:03:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:04:27 Executor: INFO: Finished task 460.0 in stage 1.0 (TID 461). 1602 bytes result sent to driver 2020-02-14 21:04:27 TaskSetManager: INFO: Starting task 461.0 in stage 1.0 (TID 462, localhost, executor driver, partition 461, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:04:27 TaskSetManager: INFO: Finished task 460.0 in stage 1.0 (TID 461) in 69268 ms on localhost (executor driver) (461/882) 2020-02-14 21:04:27 Executor: INFO: Running task 461.0 in stage 1.0 (TID 462) 2020-02-14 21:04:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15468593152+33554432 2020-02-14 21:04:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:05:32 Executor: INFO: Finished task 461.0 in stage 1.0 (TID 462). 1602 bytes result sent to driver 2020-02-14 21:05:32 TaskSetManager: INFO: Starting task 462.0 in stage 1.0 (TID 463, localhost, executor driver, partition 462, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:05:32 TaskSetManager: INFO: Finished task 461.0 in stage 1.0 (TID 462) in 64313 ms on localhost (executor driver) (462/882) 2020-02-14 21:05:32 Executor: INFO: Running task 462.0 in stage 1.0 (TID 463) 2020-02-14 21:05:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15502147584+33554432 2020-02-14 21:05:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:06:27 Executor: INFO: Finished task 462.0 in stage 1.0 (TID 463). 1602 bytes result sent to driver 2020-02-14 21:06:27 TaskSetManager: INFO: Starting task 463.0 in stage 1.0 (TID 464, localhost, executor driver, partition 463, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:06:27 TaskSetManager: INFO: Finished task 462.0 in stage 1.0 (TID 463) in 55558 ms on localhost (executor driver) (463/882) 2020-02-14 21:06:27 Executor: INFO: Running task 463.0 in stage 1.0 (TID 464) 2020-02-14 21:06:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15535702016+33554432 2020-02-14 21:06:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:07:31 Executor: INFO: Finished task 463.0 in stage 1.0 (TID 464). 1604 bytes result sent to driver 2020-02-14 21:07:31 TaskSetManager: INFO: Starting task 464.0 in stage 1.0 (TID 465, localhost, executor driver, partition 464, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:07:31 TaskSetManager: INFO: Finished task 463.0 in stage 1.0 (TID 464) in 63795 ms on localhost (executor driver) (464/882) 2020-02-14 21:07:31 Executor: INFO: Running task 464.0 in stage 1.0 (TID 465) 2020-02-14 21:07:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15569256448+33554432 2020-02-14 21:07:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:08:39 Executor: INFO: Finished task 464.0 in stage 1.0 (TID 465). 1604 bytes result sent to driver 2020-02-14 21:08:39 TaskSetManager: INFO: Starting task 465.0 in stage 1.0 (TID 466, localhost, executor driver, partition 465, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:08:39 TaskSetManager: INFO: Finished task 464.0 in stage 1.0 (TID 465) in 68366 ms on localhost (executor driver) (465/882) 2020-02-14 21:08:39 Executor: INFO: Running task 465.0 in stage 1.0 (TID 466) 2020-02-14 21:08:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15602810880+33554432 2020-02-14 21:08:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:09:40 Executor: INFO: Finished task 465.0 in stage 1.0 (TID 466). 1645 bytes result sent to driver 2020-02-14 21:09:40 TaskSetManager: INFO: Starting task 466.0 in stage 1.0 (TID 467, localhost, executor driver, partition 466, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:09:40 TaskSetManager: INFO: Finished task 465.0 in stage 1.0 (TID 466) in 60770 ms on localhost (executor driver) (466/882) 2020-02-14 21:09:40 Executor: INFO: Running task 466.0 in stage 1.0 (TID 467) 2020-02-14 21:09:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15636365312+33554432 2020-02-14 21:09:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:10:33 Executor: INFO: Finished task 466.0 in stage 1.0 (TID 467). 1815 bytes result sent to driver 2020-02-14 21:10:33 TaskSetManager: INFO: Starting task 467.0 in stage 1.0 (TID 468, localhost, executor driver, partition 467, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:10:33 TaskSetManager: INFO: Finished task 466.0 in stage 1.0 (TID 467) in 52692 ms on localhost (executor driver) (467/882) 2020-02-14 21:10:33 Executor: INFO: Running task 467.0 in stage 1.0 (TID 468) 2020-02-14 21:10:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15669919744+33554432 2020-02-14 21:10:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:11:35 Executor: INFO: Finished task 467.0 in stage 1.0 (TID 468). 1636 bytes result sent to driver 2020-02-14 21:11:35 TaskSetManager: INFO: Starting task 468.0 in stage 1.0 (TID 469, localhost, executor driver, partition 468, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:11:35 TaskSetManager: INFO: Finished task 467.0 in stage 1.0 (TID 468) in 62595 ms on localhost (executor driver) (468/882) 2020-02-14 21:11:35 Executor: INFO: Running task 468.0 in stage 1.0 (TID 469) 2020-02-14 21:11:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15703474176+33554432 2020-02-14 21:11:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:12:07 Executor: INFO: Finished task 468.0 in stage 1.0 (TID 469). 1645 bytes result sent to driver 2020-02-14 21:12:07 TaskSetManager: INFO: Starting task 469.0 in stage 1.0 (TID 470, localhost, executor driver, partition 469, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:12:07 TaskSetManager: INFO: Finished task 468.0 in stage 1.0 (TID 469) in 31227 ms on localhost (executor driver) (469/882) 2020-02-14 21:12:07 Executor: INFO: Running task 469.0 in stage 1.0 (TID 470) 2020-02-14 21:12:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15737028608+33554432 2020-02-14 21:12:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:12:21 Executor: INFO: Finished task 469.0 in stage 1.0 (TID 470). 1614 bytes result sent to driver 2020-02-14 21:12:21 TaskSetManager: INFO: Starting task 470.0 in stage 1.0 (TID 471, localhost, executor driver, partition 470, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:12:21 TaskSetManager: INFO: Finished task 469.0 in stage 1.0 (TID 470) in 14041 ms on localhost (executor driver) (470/882) 2020-02-14 21:12:21 Executor: INFO: Running task 470.0 in stage 1.0 (TID 471) 2020-02-14 21:12:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15770583040+33554432 2020-02-14 21:12:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:12:28 Executor: INFO: Finished task 470.0 in stage 1.0 (TID 471). 1601 bytes result sent to driver 2020-02-14 21:12:28 TaskSetManager: INFO: Starting task 471.0 in stage 1.0 (TID 472, localhost, executor driver, partition 471, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:12:28 TaskSetManager: INFO: Finished task 470.0 in stage 1.0 (TID 471) in 7116 ms on localhost (executor driver) (471/882) 2020-02-14 21:12:28 Executor: INFO: Running task 471.0 in stage 1.0 (TID 472) 2020-02-14 21:12:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15804137472+33554432 2020-02-14 21:12:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:12:51 Executor: INFO: Finished task 471.0 in stage 1.0 (TID 472). 1631 bytes result sent to driver 2020-02-14 21:12:51 TaskSetManager: INFO: Starting task 472.0 in stage 1.0 (TID 473, localhost, executor driver, partition 472, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:12:51 TaskSetManager: INFO: Finished task 471.0 in stage 1.0 (TID 472) in 23566 ms on localhost (executor driver) (472/882) 2020-02-14 21:12:51 Executor: INFO: Running task 472.0 in stage 1.0 (TID 473) 2020-02-14 21:12:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15837691904+33554432 2020-02-14 21:12:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:13:31 Executor: INFO: Finished task 472.0 in stage 1.0 (TID 473). 1603 bytes result sent to driver 2020-02-14 21:13:31 TaskSetManager: INFO: Starting task 473.0 in stage 1.0 (TID 474, localhost, executor driver, partition 473, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:13:31 TaskSetManager: INFO: Finished task 472.0 in stage 1.0 (TID 473) in 40156 ms on localhost (executor driver) (473/882) 2020-02-14 21:13:31 Executor: INFO: Running task 473.0 in stage 1.0 (TID 474) 2020-02-14 21:13:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15871246336+33554432 2020-02-14 21:13:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:13:54 Executor: INFO: Finished task 473.0 in stage 1.0 (TID 474). 1602 bytes result sent to driver 2020-02-14 21:13:54 TaskSetManager: INFO: Starting task 474.0 in stage 1.0 (TID 475, localhost, executor driver, partition 474, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:13:54 TaskSetManager: INFO: Finished task 473.0 in stage 1.0 (TID 474) in 22506 ms on localhost (executor driver) (474/882) 2020-02-14 21:13:54 Executor: INFO: Running task 474.0 in stage 1.0 (TID 475) 2020-02-14 21:13:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15904800768+33554432 2020-02-14 21:13:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:14:01 Executor: INFO: Finished task 474.0 in stage 1.0 (TID 475). 1662 bytes result sent to driver 2020-02-14 21:14:01 TaskSetManager: INFO: Starting task 475.0 in stage 1.0 (TID 476, localhost, executor driver, partition 475, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:14:01 TaskSetManager: INFO: Finished task 474.0 in stage 1.0 (TID 475) in 7390 ms on localhost (executor driver) (475/882) 2020-02-14 21:14:01 Executor: INFO: Running task 475.0 in stage 1.0 (TID 476) 2020-02-14 21:14:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15938355200+33554432 2020-02-14 21:14:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:14:08 Executor: INFO: Finished task 475.0 in stage 1.0 (TID 476). 1601 bytes result sent to driver 2020-02-14 21:14:08 TaskSetManager: INFO: Starting task 476.0 in stage 1.0 (TID 477, localhost, executor driver, partition 476, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:14:08 TaskSetManager: INFO: Finished task 475.0 in stage 1.0 (TID 476) in 6177 ms on localhost (executor driver) (476/882) 2020-02-14 21:14:08 Executor: INFO: Running task 476.0 in stage 1.0 (TID 477) 2020-02-14 21:14:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:15971909632+33554432 2020-02-14 21:14:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:14:15 Executor: INFO: Finished task 476.0 in stage 1.0 (TID 477). 1602 bytes result sent to driver 2020-02-14 21:14:15 TaskSetManager: INFO: Starting task 477.0 in stage 1.0 (TID 478, localhost, executor driver, partition 477, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:14:15 TaskSetManager: INFO: Finished task 476.0 in stage 1.0 (TID 477) in 7052 ms on localhost (executor driver) (477/882) 2020-02-14 21:14:15 Executor: INFO: Running task 477.0 in stage 1.0 (TID 478) 2020-02-14 21:14:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16005464064+33554432 2020-02-14 21:14:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:15:09 Executor: INFO: Finished task 477.0 in stage 1.0 (TID 478). 1602 bytes result sent to driver 2020-02-14 21:15:09 TaskSetManager: INFO: Starting task 478.0 in stage 1.0 (TID 479, localhost, executor driver, partition 478, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:15:09 TaskSetManager: INFO: Finished task 477.0 in stage 1.0 (TID 478) in 54097 ms on localhost (executor driver) (478/882) 2020-02-14 21:15:09 Executor: INFO: Running task 478.0 in stage 1.0 (TID 479) 2020-02-14 21:15:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16039018496+33554432 2020-02-14 21:15:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:15:40 Executor: INFO: Finished task 478.0 in stage 1.0 (TID 479). 1955 bytes result sent to driver 2020-02-14 21:15:40 TaskSetManager: INFO: Starting task 479.0 in stage 1.0 (TID 480, localhost, executor driver, partition 479, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:15:40 TaskSetManager: INFO: Finished task 478.0 in stage 1.0 (TID 479) in 31333 ms on localhost (executor driver) (479/882) 2020-02-14 21:15:40 Executor: INFO: Running task 479.0 in stage 1.0 (TID 480) 2020-02-14 21:15:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16072572928+33554432 2020-02-14 21:15:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:16:10 Executor: INFO: Finished task 479.0 in stage 1.0 (TID 480). 1684 bytes result sent to driver 2020-02-14 21:16:10 TaskSetManager: INFO: Starting task 480.0 in stage 1.0 (TID 481, localhost, executor driver, partition 480, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:16:10 TaskSetManager: INFO: Finished task 479.0 in stage 1.0 (TID 480) in 29913 ms on localhost (executor driver) (480/882) 2020-02-14 21:16:10 Executor: INFO: Running task 480.0 in stage 1.0 (TID 481) 2020-02-14 21:16:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16106127360+33554432 2020-02-14 21:16:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:16:20 Executor: INFO: Finished task 480.0 in stage 1.0 (TID 481). 1722 bytes result sent to driver 2020-02-14 21:16:20 TaskSetManager: INFO: Starting task 481.0 in stage 1.0 (TID 482, localhost, executor driver, partition 481, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:16:20 TaskSetManager: INFO: Finished task 480.0 in stage 1.0 (TID 481) in 10010 ms on localhost (executor driver) (481/882) 2020-02-14 21:16:20 Executor: INFO: Running task 481.0 in stage 1.0 (TID 482) 2020-02-14 21:16:20 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16139681792+33554432 2020-02-14 21:16:20 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:16:30 Executor: INFO: Finished task 481.0 in stage 1.0 (TID 482). 1676 bytes result sent to driver 2020-02-14 21:16:30 TaskSetManager: INFO: Starting task 482.0 in stage 1.0 (TID 483, localhost, executor driver, partition 482, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:16:30 TaskSetManager: INFO: Finished task 481.0 in stage 1.0 (TID 482) in 9803 ms on localhost (executor driver) (482/882) 2020-02-14 21:16:30 Executor: INFO: Running task 482.0 in stage 1.0 (TID 483) 2020-02-14 21:16:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16173236224+33554432 2020-02-14 21:16:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:16:37 Executor: INFO: Finished task 482.0 in stage 1.0 (TID 483). 1649 bytes result sent to driver 2020-02-14 21:16:37 TaskSetManager: INFO: Starting task 483.0 in stage 1.0 (TID 484, localhost, executor driver, partition 483, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:16:37 TaskSetManager: INFO: Finished task 482.0 in stage 1.0 (TID 483) in 7095 ms on localhost (executor driver) (483/882) 2020-02-14 21:16:37 Executor: INFO: Running task 483.0 in stage 1.0 (TID 484) 2020-02-14 21:16:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16206790656+33554432 2020-02-14 21:16:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:16:43 Executor: INFO: Finished task 483.0 in stage 1.0 (TID 484). 1823 bytes result sent to driver 2020-02-14 21:16:43 TaskSetManager: INFO: Starting task 484.0 in stage 1.0 (TID 485, localhost, executor driver, partition 484, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:16:43 TaskSetManager: INFO: Finished task 483.0 in stage 1.0 (TID 484) in 6502 ms on localhost (executor driver) (484/882) 2020-02-14 21:16:43 Executor: INFO: Running task 484.0 in stage 1.0 (TID 485) 2020-02-14 21:16:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16240345088+33554432 2020-02-14 21:16:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:16:50 Executor: INFO: Finished task 484.0 in stage 1.0 (TID 485). 1690 bytes result sent to driver 2020-02-14 21:16:50 TaskSetManager: INFO: Starting task 485.0 in stage 1.0 (TID 486, localhost, executor driver, partition 485, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:16:50 TaskSetManager: INFO: Finished task 484.0 in stage 1.0 (TID 485) in 6379 ms on localhost (executor driver) (485/882) 2020-02-14 21:16:50 Executor: INFO: Running task 485.0 in stage 1.0 (TID 486) 2020-02-14 21:16:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16273899520+33554432 2020-02-14 21:16:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:17:03 Executor: INFO: Finished task 485.0 in stage 1.0 (TID 486). 1653 bytes result sent to driver 2020-02-14 21:17:03 TaskSetManager: INFO: Starting task 486.0 in stage 1.0 (TID 487, localhost, executor driver, partition 486, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:17:03 TaskSetManager: INFO: Finished task 485.0 in stage 1.0 (TID 486) in 12954 ms on localhost (executor driver) (486/882) 2020-02-14 21:17:03 Executor: INFO: Running task 486.0 in stage 1.0 (TID 487) 2020-02-14 21:17:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16307453952+33554432 2020-02-14 21:17:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:17:18 Executor: INFO: Finished task 486.0 in stage 1.0 (TID 487). 1824 bytes result sent to driver 2020-02-14 21:17:18 TaskSetManager: INFO: Starting task 487.0 in stage 1.0 (TID 488, localhost, executor driver, partition 487, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:17:18 TaskSetManager: INFO: Finished task 486.0 in stage 1.0 (TID 487) in 15608 ms on localhost (executor driver) (487/882) 2020-02-14 21:17:18 Executor: INFO: Running task 487.0 in stage 1.0 (TID 488) 2020-02-14 21:17:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16341008384+33554432 2020-02-14 21:17:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:17:41 Executor: INFO: Finished task 487.0 in stage 1.0 (TID 488). 1718 bytes result sent to driver 2020-02-14 21:17:41 TaskSetManager: INFO: Starting task 488.0 in stage 1.0 (TID 489, localhost, executor driver, partition 488, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:17:41 TaskSetManager: INFO: Finished task 487.0 in stage 1.0 (TID 488) in 22661 ms on localhost (executor driver) (488/882) 2020-02-14 21:17:41 Executor: INFO: Running task 488.0 in stage 1.0 (TID 489) 2020-02-14 21:17:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16374562816+33554432 2020-02-14 21:17:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:18:02 Executor: INFO: Finished task 488.0 in stage 1.0 (TID 489). 1730 bytes result sent to driver 2020-02-14 21:18:02 TaskSetManager: INFO: Starting task 489.0 in stage 1.0 (TID 490, localhost, executor driver, partition 489, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:18:02 TaskSetManager: INFO: Finished task 488.0 in stage 1.0 (TID 489) in 20636 ms on localhost (executor driver) (489/882) 2020-02-14 21:18:02 Executor: INFO: Running task 489.0 in stage 1.0 (TID 490) 2020-02-14 21:18:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16408117248+33554432 2020-02-14 21:18:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:18:21 Executor: INFO: Finished task 489.0 in stage 1.0 (TID 490). 1624 bytes result sent to driver 2020-02-14 21:18:21 TaskSetManager: INFO: Starting task 490.0 in stage 1.0 (TID 491, localhost, executor driver, partition 490, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:18:21 TaskSetManager: INFO: Finished task 489.0 in stage 1.0 (TID 490) in 19885 ms on localhost (executor driver) (490/882) 2020-02-14 21:18:21 Executor: INFO: Running task 490.0 in stage 1.0 (TID 491) 2020-02-14 21:18:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16441671680+33554432 2020-02-14 21:18:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:18:36 Executor: INFO: Finished task 490.0 in stage 1.0 (TID 491). 1638 bytes result sent to driver 2020-02-14 21:18:36 TaskSetManager: INFO: Starting task 491.0 in stage 1.0 (TID 492, localhost, executor driver, partition 491, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:18:36 TaskSetManager: INFO: Finished task 490.0 in stage 1.0 (TID 491) in 14651 ms on localhost (executor driver) (491/882) 2020-02-14 21:18:36 Executor: INFO: Running task 491.0 in stage 1.0 (TID 492) 2020-02-14 21:18:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16475226112+33554432 2020-02-14 21:18:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:18:44 Executor: INFO: Finished task 491.0 in stage 1.0 (TID 492). 1820 bytes result sent to driver 2020-02-14 21:18:44 TaskSetManager: INFO: Starting task 492.0 in stage 1.0 (TID 493, localhost, executor driver, partition 492, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:18:44 TaskSetManager: INFO: Finished task 491.0 in stage 1.0 (TID 492) in 8217 ms on localhost (executor driver) (492/882) 2020-02-14 21:18:44 Executor: INFO: Running task 492.0 in stage 1.0 (TID 493) 2020-02-14 21:18:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16508780544+33554432 2020-02-14 21:18:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:19:06 Executor: INFO: Finished task 492.0 in stage 1.0 (TID 493). 1808 bytes result sent to driver 2020-02-14 21:19:06 TaskSetManager: INFO: Starting task 493.0 in stage 1.0 (TID 494, localhost, executor driver, partition 493, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:19:06 TaskSetManager: INFO: Finished task 492.0 in stage 1.0 (TID 493) in 21936 ms on localhost (executor driver) (493/882) 2020-02-14 21:19:06 Executor: INFO: Running task 493.0 in stage 1.0 (TID 494) 2020-02-14 21:19:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16542334976+33554432 2020-02-14 21:19:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:19:17 Executor: INFO: Finished task 493.0 in stage 1.0 (TID 494). 1870 bytes result sent to driver 2020-02-14 21:19:17 TaskSetManager: INFO: Starting task 494.0 in stage 1.0 (TID 495, localhost, executor driver, partition 494, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:19:17 TaskSetManager: INFO: Finished task 493.0 in stage 1.0 (TID 494) in 11109 ms on localhost (executor driver) (494/882) 2020-02-14 21:19:17 Executor: INFO: Running task 494.0 in stage 1.0 (TID 495) 2020-02-14 21:19:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16575889408+33554432 2020-02-14 21:19:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:19:58 Executor: INFO: Finished task 494.0 in stage 1.0 (TID 495). 1627 bytes result sent to driver 2020-02-14 21:19:58 TaskSetManager: INFO: Starting task 495.0 in stage 1.0 (TID 496, localhost, executor driver, partition 495, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:19:58 TaskSetManager: INFO: Finished task 494.0 in stage 1.0 (TID 495) in 40650 ms on localhost (executor driver) (495/882) 2020-02-14 21:19:58 Executor: INFO: Running task 495.0 in stage 1.0 (TID 496) 2020-02-14 21:19:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16609443840+33554432 2020-02-14 21:19:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:20:51 Executor: INFO: Finished task 495.0 in stage 1.0 (TID 496). 1627 bytes result sent to driver 2020-02-14 21:20:51 TaskSetManager: INFO: Starting task 496.0 in stage 1.0 (TID 497, localhost, executor driver, partition 496, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:20:51 TaskSetManager: INFO: Finished task 495.0 in stage 1.0 (TID 496) in 52812 ms on localhost (executor driver) (496/882) 2020-02-14 21:20:51 Executor: INFO: Running task 496.0 in stage 1.0 (TID 497) 2020-02-14 21:20:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16642998272+33554432 2020-02-14 21:20:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:21:16 Executor: INFO: Finished task 496.0 in stage 1.0 (TID 497). 1629 bytes result sent to driver 2020-02-14 21:21:16 TaskSetManager: INFO: Starting task 497.0 in stage 1.0 (TID 498, localhost, executor driver, partition 497, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:21:16 TaskSetManager: INFO: Finished task 496.0 in stage 1.0 (TID 497) in 25111 ms on localhost (executor driver) (497/882) 2020-02-14 21:21:16 Executor: INFO: Running task 497.0 in stage 1.0 (TID 498) 2020-02-14 21:21:16 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16676552704+33554432 2020-02-14 21:21:16 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:21:45 Executor: INFO: Finished task 497.0 in stage 1.0 (TID 498). 1694 bytes result sent to driver 2020-02-14 21:21:45 TaskSetManager: INFO: Starting task 498.0 in stage 1.0 (TID 499, localhost, executor driver, partition 498, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:21:45 TaskSetManager: INFO: Finished task 497.0 in stage 1.0 (TID 498) in 28842 ms on localhost (executor driver) (498/882) 2020-02-14 21:21:45 Executor: INFO: Running task 498.0 in stage 1.0 (TID 499) 2020-02-14 21:21:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16710107136+33554432 2020-02-14 21:21:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:22:31 Executor: INFO: Finished task 498.0 in stage 1.0 (TID 499). 1803 bytes result sent to driver 2020-02-14 21:22:31 TaskSetManager: INFO: Starting task 499.0 in stage 1.0 (TID 500, localhost, executor driver, partition 499, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:22:31 TaskSetManager: INFO: Finished task 498.0 in stage 1.0 (TID 499) in 45945 ms on localhost (executor driver) (499/882) 2020-02-14 21:22:31 Executor: INFO: Running task 499.0 in stage 1.0 (TID 500) 2020-02-14 21:22:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16743661568+33554432 2020-02-14 21:22:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:23:22 Executor: INFO: Finished task 499.0 in stage 1.0 (TID 500). 1693 bytes result sent to driver 2020-02-14 21:23:22 TaskSetManager: INFO: Starting task 500.0 in stage 1.0 (TID 501, localhost, executor driver, partition 500, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:23:22 TaskSetManager: INFO: Finished task 499.0 in stage 1.0 (TID 500) in 51119 ms on localhost (executor driver) (500/882) 2020-02-14 21:23:22 Executor: INFO: Running task 500.0 in stage 1.0 (TID 501) 2020-02-14 21:23:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16777216000+33554432 2020-02-14 21:23:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:24:19 Executor: INFO: Finished task 500.0 in stage 1.0 (TID 501). 1624 bytes result sent to driver 2020-02-14 21:24:19 TaskSetManager: INFO: Starting task 501.0 in stage 1.0 (TID 502, localhost, executor driver, partition 501, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:24:19 TaskSetManager: INFO: Finished task 500.0 in stage 1.0 (TID 501) in 56769 ms on localhost (executor driver) (501/882) 2020-02-14 21:24:19 Executor: INFO: Running task 501.0 in stage 1.0 (TID 502) 2020-02-14 21:24:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16810770432+33554432 2020-02-14 21:24:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:25:21 Executor: INFO: Finished task 501.0 in stage 1.0 (TID 502). 1625 bytes result sent to driver 2020-02-14 21:25:21 TaskSetManager: INFO: Starting task 502.0 in stage 1.0 (TID 503, localhost, executor driver, partition 502, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:25:21 TaskSetManager: INFO: Finished task 501.0 in stage 1.0 (TID 502) in 62154 ms on localhost (executor driver) (502/882) 2020-02-14 21:25:21 Executor: INFO: Running task 502.0 in stage 1.0 (TID 503) 2020-02-14 21:25:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16844324864+33554432 2020-02-14 21:25:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:26:07 Executor: INFO: Finished task 502.0 in stage 1.0 (TID 503). 1675 bytes result sent to driver 2020-02-14 21:26:07 TaskSetManager: INFO: Starting task 503.0 in stage 1.0 (TID 504, localhost, executor driver, partition 503, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:26:07 TaskSetManager: INFO: Finished task 502.0 in stage 1.0 (TID 503) in 46301 ms on localhost (executor driver) (503/882) 2020-02-14 21:26:07 Executor: INFO: Running task 503.0 in stage 1.0 (TID 504) 2020-02-14 21:26:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16877879296+33554432 2020-02-14 21:26:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:26:42 Executor: INFO: Finished task 503.0 in stage 1.0 (TID 504). 1670 bytes result sent to driver 2020-02-14 21:26:42 TaskSetManager: INFO: Starting task 504.0 in stage 1.0 (TID 505, localhost, executor driver, partition 504, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:26:42 TaskSetManager: INFO: Finished task 503.0 in stage 1.0 (TID 504) in 34954 ms on localhost (executor driver) (504/882) 2020-02-14 21:26:42 Executor: INFO: Running task 504.0 in stage 1.0 (TID 505) 2020-02-14 21:26:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16911433728+33554432 2020-02-14 21:26:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:27:06 Executor: INFO: Finished task 504.0 in stage 1.0 (TID 505). 1695 bytes result sent to driver 2020-02-14 21:27:06 TaskSetManager: INFO: Starting task 505.0 in stage 1.0 (TID 506, localhost, executor driver, partition 505, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:27:06 TaskSetManager: INFO: Finished task 504.0 in stage 1.0 (TID 505) in 23624 ms on localhost (executor driver) (505/882) 2020-02-14 21:27:06 Executor: INFO: Running task 505.0 in stage 1.0 (TID 506) 2020-02-14 21:27:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16944988160+33554432 2020-02-14 21:27:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:27:35 Executor: INFO: Finished task 505.0 in stage 1.0 (TID 506). 1647 bytes result sent to driver 2020-02-14 21:27:35 TaskSetManager: INFO: Starting task 506.0 in stage 1.0 (TID 507, localhost, executor driver, partition 506, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:27:35 TaskSetManager: INFO: Finished task 505.0 in stage 1.0 (TID 506) in 29602 ms on localhost (executor driver) (506/882) 2020-02-14 21:27:35 Executor: INFO: Running task 506.0 in stage 1.0 (TID 507) 2020-02-14 21:27:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:16978542592+33554432 2020-02-14 21:27:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:28:17 Executor: INFO: Finished task 506.0 in stage 1.0 (TID 507). 1680 bytes result sent to driver 2020-02-14 21:28:17 TaskSetManager: INFO: Starting task 507.0 in stage 1.0 (TID 508, localhost, executor driver, partition 507, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:28:17 TaskSetManager: INFO: Finished task 506.0 in stage 1.0 (TID 507) in 41775 ms on localhost (executor driver) (507/882) 2020-02-14 21:28:17 Executor: INFO: Running task 507.0 in stage 1.0 (TID 508) 2020-02-14 21:28:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17012097024+33554432 2020-02-14 21:28:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:28:57 Executor: INFO: Finished task 507.0 in stage 1.0 (TID 508). 1677 bytes result sent to driver 2020-02-14 21:28:57 TaskSetManager: INFO: Starting task 508.0 in stage 1.0 (TID 509, localhost, executor driver, partition 508, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:28:57 TaskSetManager: INFO: Finished task 507.0 in stage 1.0 (TID 508) in 39703 ms on localhost (executor driver) (508/882) 2020-02-14 21:28:57 Executor: INFO: Running task 508.0 in stage 1.0 (TID 509) 2020-02-14 21:28:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17045651456+33554432 2020-02-14 21:28:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:29:34 Executor: INFO: Finished task 508.0 in stage 1.0 (TID 509). 1669 bytes result sent to driver 2020-02-14 21:29:34 TaskSetManager: INFO: Starting task 509.0 in stage 1.0 (TID 510, localhost, executor driver, partition 509, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:29:34 TaskSetManager: INFO: Finished task 508.0 in stage 1.0 (TID 509) in 36918 ms on localhost (executor driver) (509/882) 2020-02-14 21:29:34 Executor: INFO: Running task 509.0 in stage 1.0 (TID 510) 2020-02-14 21:29:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17079205888+33554432 2020-02-14 21:29:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:30:11 Executor: INFO: Finished task 509.0 in stage 1.0 (TID 510). 1737 bytes result sent to driver 2020-02-14 21:30:11 TaskSetManager: INFO: Starting task 510.0 in stage 1.0 (TID 511, localhost, executor driver, partition 510, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:30:11 TaskSetManager: INFO: Finished task 509.0 in stage 1.0 (TID 510) in 37164 ms on localhost (executor driver) (510/882) 2020-02-14 21:30:11 Executor: INFO: Running task 510.0 in stage 1.0 (TID 511) 2020-02-14 21:30:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17112760320+33554432 2020-02-14 21:30:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:30:52 Executor: INFO: Finished task 510.0 in stage 1.0 (TID 511). 1736 bytes result sent to driver 2020-02-14 21:30:52 TaskSetManager: INFO: Starting task 511.0 in stage 1.0 (TID 512, localhost, executor driver, partition 511, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:30:52 TaskSetManager: INFO: Finished task 510.0 in stage 1.0 (TID 511) in 41285 ms on localhost (executor driver) (511/882) 2020-02-14 21:30:52 Executor: INFO: Running task 511.0 in stage 1.0 (TID 512) 2020-02-14 21:30:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17146314752+33554432 2020-02-14 21:30:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:31:35 Executor: INFO: Finished task 511.0 in stage 1.0 (TID 512). 1624 bytes result sent to driver 2020-02-14 21:31:35 TaskSetManager: INFO: Starting task 512.0 in stage 1.0 (TID 513, localhost, executor driver, partition 512, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:31:35 TaskSetManager: INFO: Finished task 511.0 in stage 1.0 (TID 512) in 42519 ms on localhost (executor driver) (512/882) 2020-02-14 21:31:35 Executor: INFO: Running task 512.0 in stage 1.0 (TID 513) 2020-02-14 21:31:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17179869184+33554432 2020-02-14 21:31:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:32:14 Executor: INFO: Finished task 512.0 in stage 1.0 (TID 513). 1632 bytes result sent to driver 2020-02-14 21:32:14 TaskSetManager: INFO: Starting task 513.0 in stage 1.0 (TID 514, localhost, executor driver, partition 513, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:32:14 TaskSetManager: INFO: Finished task 512.0 in stage 1.0 (TID 513) in 38915 ms on localhost (executor driver) (513/882) 2020-02-14 21:32:14 Executor: INFO: Running task 513.0 in stage 1.0 (TID 514) 2020-02-14 21:32:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17213423616+33554432 2020-02-14 21:32:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:33:00 Executor: INFO: Finished task 513.0 in stage 1.0 (TID 514). 1633 bytes result sent to driver 2020-02-14 21:33:00 TaskSetManager: INFO: Starting task 514.0 in stage 1.0 (TID 515, localhost, executor driver, partition 514, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:33:00 TaskSetManager: INFO: Finished task 513.0 in stage 1.0 (TID 514) in 46194 ms on localhost (executor driver) (514/882) 2020-02-14 21:33:00 Executor: INFO: Running task 514.0 in stage 1.0 (TID 515) 2020-02-14 21:33:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17246978048+33554432 2020-02-14 21:33:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:33:47 Executor: INFO: Finished task 514.0 in stage 1.0 (TID 515). 1624 bytes result sent to driver 2020-02-14 21:33:47 TaskSetManager: INFO: Starting task 515.0 in stage 1.0 (TID 516, localhost, executor driver, partition 515, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:33:47 TaskSetManager: INFO: Finished task 514.0 in stage 1.0 (TID 515) in 46850 ms on localhost (executor driver) (515/882) 2020-02-14 21:33:47 Executor: INFO: Running task 515.0 in stage 1.0 (TID 516) 2020-02-14 21:33:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17280532480+33554432 2020-02-14 21:33:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:34:38 Executor: INFO: Finished task 515.0 in stage 1.0 (TID 516). 1624 bytes result sent to driver 2020-02-14 21:34:38 TaskSetManager: INFO: Starting task 516.0 in stage 1.0 (TID 517, localhost, executor driver, partition 516, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:34:38 TaskSetManager: INFO: Finished task 515.0 in stage 1.0 (TID 516) in 51035 ms on localhost (executor driver) (516/882) 2020-02-14 21:34:38 Executor: INFO: Running task 516.0 in stage 1.0 (TID 517) 2020-02-14 21:34:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17314086912+33554432 2020-02-14 21:34:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:35:35 Executor: INFO: Finished task 516.0 in stage 1.0 (TID 517). 1672 bytes result sent to driver 2020-02-14 21:35:35 TaskSetManager: INFO: Starting task 517.0 in stage 1.0 (TID 518, localhost, executor driver, partition 517, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:35:35 TaskSetManager: INFO: Finished task 516.0 in stage 1.0 (TID 517) in 57409 ms on localhost (executor driver) (517/882) 2020-02-14 21:35:35 Executor: INFO: Running task 517.0 in stage 1.0 (TID 518) 2020-02-14 21:35:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17347641344+33554432 2020-02-14 21:35:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:36:39 Executor: INFO: Finished task 517.0 in stage 1.0 (TID 518). 1648 bytes result sent to driver 2020-02-14 21:36:39 TaskSetManager: INFO: Starting task 518.0 in stage 1.0 (TID 519, localhost, executor driver, partition 518, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:36:39 TaskSetManager: INFO: Finished task 517.0 in stage 1.0 (TID 518) in 64388 ms on localhost (executor driver) (518/882) 2020-02-14 21:36:39 Executor: INFO: Running task 518.0 in stage 1.0 (TID 519) 2020-02-14 21:36:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17381195776+33554432 2020-02-14 21:36:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:37:04 Executor: INFO: Finished task 518.0 in stage 1.0 (TID 519). 1624 bytes result sent to driver 2020-02-14 21:37:04 TaskSetManager: INFO: Starting task 519.0 in stage 1.0 (TID 520, localhost, executor driver, partition 519, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:37:04 TaskSetManager: INFO: Finished task 518.0 in stage 1.0 (TID 519) in 24798 ms on localhost (executor driver) (519/882) 2020-02-14 21:37:04 Executor: INFO: Running task 519.0 in stage 1.0 (TID 520) 2020-02-14 21:37:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17414750208+33554432 2020-02-14 21:37:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:37:56 Executor: INFO: Finished task 519.0 in stage 1.0 (TID 520). 1624 bytes result sent to driver 2020-02-14 21:37:56 TaskSetManager: INFO: Starting task 520.0 in stage 1.0 (TID 521, localhost, executor driver, partition 520, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:37:56 TaskSetManager: INFO: Finished task 519.0 in stage 1.0 (TID 520) in 52042 ms on localhost (executor driver) (520/882) 2020-02-14 21:37:56 Executor: INFO: Running task 520.0 in stage 1.0 (TID 521) 2020-02-14 21:37:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17448304640+33554432 2020-02-14 21:37:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:38:57 Executor: INFO: Finished task 520.0 in stage 1.0 (TID 521). 1659 bytes result sent to driver 2020-02-14 21:38:57 TaskSetManager: INFO: Starting task 521.0 in stage 1.0 (TID 522, localhost, executor driver, partition 521, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:38:57 TaskSetManager: INFO: Finished task 520.0 in stage 1.0 (TID 521) in 60708 ms on localhost (executor driver) (521/882) 2020-02-14 21:38:57 Executor: INFO: Running task 521.0 in stage 1.0 (TID 522) 2020-02-14 21:38:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17481859072+33554432 2020-02-14 21:38:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:39:57 Executor: INFO: Finished task 521.0 in stage 1.0 (TID 522). 1624 bytes result sent to driver 2020-02-14 21:39:57 TaskSetManager: INFO: Starting task 522.0 in stage 1.0 (TID 523, localhost, executor driver, partition 522, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:39:57 TaskSetManager: INFO: Finished task 521.0 in stage 1.0 (TID 522) in 60361 ms on localhost (executor driver) (522/882) 2020-02-14 21:39:57 Executor: INFO: Running task 522.0 in stage 1.0 (TID 523) 2020-02-14 21:39:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17515413504+33554432 2020-02-14 21:39:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:40:41 Executor: INFO: Finished task 522.0 in stage 1.0 (TID 523). 1629 bytes result sent to driver 2020-02-14 21:40:41 TaskSetManager: INFO: Starting task 523.0 in stage 1.0 (TID 524, localhost, executor driver, partition 523, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:40:41 TaskSetManager: INFO: Finished task 522.0 in stage 1.0 (TID 523) in 43314 ms on localhost (executor driver) (523/882) 2020-02-14 21:40:41 Executor: INFO: Running task 523.0 in stage 1.0 (TID 524) 2020-02-14 21:40:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17548967936+33554432 2020-02-14 21:40:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:41:25 Executor: INFO: Finished task 523.0 in stage 1.0 (TID 524). 1628 bytes result sent to driver 2020-02-14 21:41:25 TaskSetManager: INFO: Starting task 524.0 in stage 1.0 (TID 525, localhost, executor driver, partition 524, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:41:25 TaskSetManager: INFO: Finished task 523.0 in stage 1.0 (TID 524) in 44334 ms on localhost (executor driver) (524/882) 2020-02-14 21:41:25 Executor: INFO: Running task 524.0 in stage 1.0 (TID 525) 2020-02-14 21:41:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17582522368+33554432 2020-02-14 21:41:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:42:07 Executor: INFO: Finished task 524.0 in stage 1.0 (TID 525). 1682 bytes result sent to driver 2020-02-14 21:42:07 TaskSetManager: INFO: Starting task 525.0 in stage 1.0 (TID 526, localhost, executor driver, partition 525, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:42:07 TaskSetManager: INFO: Finished task 524.0 in stage 1.0 (TID 525) in 41761 ms on localhost (executor driver) (525/882) 2020-02-14 21:42:07 Executor: INFO: Running task 525.0 in stage 1.0 (TID 526) 2020-02-14 21:42:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17616076800+33554432 2020-02-14 21:42:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:42:52 Executor: INFO: Finished task 525.0 in stage 1.0 (TID 526). 1667 bytes result sent to driver 2020-02-14 21:42:52 TaskSetManager: INFO: Starting task 526.0 in stage 1.0 (TID 527, localhost, executor driver, partition 526, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:42:52 TaskSetManager: INFO: Finished task 525.0 in stage 1.0 (TID 526) in 45456 ms on localhost (executor driver) (526/882) 2020-02-14 21:42:52 Executor: INFO: Running task 526.0 in stage 1.0 (TID 527) 2020-02-14 21:42:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17649631232+33554432 2020-02-14 21:42:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:43:39 Executor: INFO: Finished task 526.0 in stage 1.0 (TID 527). 1669 bytes result sent to driver 2020-02-14 21:43:39 TaskSetManager: INFO: Starting task 527.0 in stage 1.0 (TID 528, localhost, executor driver, partition 527, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:43:39 TaskSetManager: INFO: Finished task 526.0 in stage 1.0 (TID 527) in 47174 ms on localhost (executor driver) (527/882) 2020-02-14 21:43:39 Executor: INFO: Running task 527.0 in stage 1.0 (TID 528) 2020-02-14 21:43:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17683185664+33554432 2020-02-14 21:43:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:44:35 Executor: INFO: Finished task 527.0 in stage 1.0 (TID 528). 1656 bytes result sent to driver 2020-02-14 21:44:35 TaskSetManager: INFO: Starting task 528.0 in stage 1.0 (TID 529, localhost, executor driver, partition 528, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:44:35 TaskSetManager: INFO: Finished task 527.0 in stage 1.0 (TID 528) in 55933 ms on localhost (executor driver) (528/882) 2020-02-14 21:44:35 Executor: INFO: Running task 528.0 in stage 1.0 (TID 529) 2020-02-14 21:44:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17716740096+33554432 2020-02-14 21:44:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:45:27 Executor: INFO: Finished task 528.0 in stage 1.0 (TID 529). 1628 bytes result sent to driver 2020-02-14 21:45:27 TaskSetManager: INFO: Starting task 529.0 in stage 1.0 (TID 530, localhost, executor driver, partition 529, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:45:27 TaskSetManager: INFO: Finished task 528.0 in stage 1.0 (TID 529) in 51765 ms on localhost (executor driver) (529/882) 2020-02-14 21:45:27 Executor: INFO: Running task 529.0 in stage 1.0 (TID 530) 2020-02-14 21:45:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17750294528+33554432 2020-02-14 21:45:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:46:11 Executor: INFO: Finished task 529.0 in stage 1.0 (TID 530). 1629 bytes result sent to driver 2020-02-14 21:46:11 TaskSetManager: INFO: Starting task 530.0 in stage 1.0 (TID 531, localhost, executor driver, partition 530, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:46:11 TaskSetManager: INFO: Finished task 529.0 in stage 1.0 (TID 530) in 44168 ms on localhost (executor driver) (530/882) 2020-02-14 21:46:11 Executor: INFO: Running task 530.0 in stage 1.0 (TID 531) 2020-02-14 21:46:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17783848960+33554432 2020-02-14 21:46:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:46:55 Executor: INFO: Finished task 530.0 in stage 1.0 (TID 531). 1627 bytes result sent to driver 2020-02-14 21:46:55 TaskSetManager: INFO: Starting task 531.0 in stage 1.0 (TID 532, localhost, executor driver, partition 531, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:46:55 TaskSetManager: INFO: Finished task 530.0 in stage 1.0 (TID 531) in 43469 ms on localhost (executor driver) (531/882) 2020-02-14 21:46:55 Executor: INFO: Running task 531.0 in stage 1.0 (TID 532) 2020-02-14 21:46:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17817403392+33554432 2020-02-14 21:46:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:47:34 Executor: INFO: Finished task 531.0 in stage 1.0 (TID 532). 1674 bytes result sent to driver 2020-02-14 21:47:34 TaskSetManager: INFO: Starting task 532.0 in stage 1.0 (TID 533, localhost, executor driver, partition 532, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:47:34 TaskSetManager: INFO: Finished task 531.0 in stage 1.0 (TID 532) in 39519 ms on localhost (executor driver) (532/882) 2020-02-14 21:47:34 Executor: INFO: Running task 532.0 in stage 1.0 (TID 533) 2020-02-14 21:47:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17850957824+33554432 2020-02-14 21:47:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:48:12 Executor: INFO: Finished task 532.0 in stage 1.0 (TID 533). 1634 bytes result sent to driver 2020-02-14 21:48:12 TaskSetManager: INFO: Starting task 533.0 in stage 1.0 (TID 534, localhost, executor driver, partition 533, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:48:12 TaskSetManager: INFO: Finished task 532.0 in stage 1.0 (TID 533) in 37792 ms on localhost (executor driver) (533/882) 2020-02-14 21:48:12 Executor: INFO: Running task 533.0 in stage 1.0 (TID 534) 2020-02-14 21:48:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17884512256+33554432 2020-02-14 21:48:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:48:55 Executor: INFO: Finished task 533.0 in stage 1.0 (TID 534). 1628 bytes result sent to driver 2020-02-14 21:48:55 TaskSetManager: INFO: Starting task 534.0 in stage 1.0 (TID 535, localhost, executor driver, partition 534, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:48:55 TaskSetManager: INFO: Finished task 533.0 in stage 1.0 (TID 534) in 42575 ms on localhost (executor driver) (534/882) 2020-02-14 21:48:55 Executor: INFO: Running task 534.0 in stage 1.0 (TID 535) 2020-02-14 21:48:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17918066688+33554432 2020-02-14 21:48:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:49:34 Executor: INFO: Finished task 534.0 in stage 1.0 (TID 535). 1637 bytes result sent to driver 2020-02-14 21:49:34 TaskSetManager: INFO: Starting task 535.0 in stage 1.0 (TID 536, localhost, executor driver, partition 535, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:49:34 TaskSetManager: INFO: Finished task 534.0 in stage 1.0 (TID 535) in 39198 ms on localhost (executor driver) (535/882) 2020-02-14 21:49:34 Executor: INFO: Running task 535.0 in stage 1.0 (TID 536) 2020-02-14 21:49:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17951621120+33554432 2020-02-14 21:49:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:50:24 Executor: INFO: Finished task 535.0 in stage 1.0 (TID 536). 1625 bytes result sent to driver 2020-02-14 21:50:24 TaskSetManager: INFO: Starting task 536.0 in stage 1.0 (TID 537, localhost, executor driver, partition 536, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:50:24 TaskSetManager: INFO: Finished task 535.0 in stage 1.0 (TID 536) in 49958 ms on localhost (executor driver) (536/882) 2020-02-14 21:50:24 Executor: INFO: Running task 536.0 in stage 1.0 (TID 537) 2020-02-14 21:50:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:17985175552+33554432 2020-02-14 21:50:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:51:08 Executor: INFO: Finished task 536.0 in stage 1.0 (TID 537). 1625 bytes result sent to driver 2020-02-14 21:51:08 TaskSetManager: INFO: Starting task 537.0 in stage 1.0 (TID 538, localhost, executor driver, partition 537, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:51:08 TaskSetManager: INFO: Finished task 536.0 in stage 1.0 (TID 537) in 44589 ms on localhost (executor driver) (537/882) 2020-02-14 21:51:08 Executor: INFO: Running task 537.0 in stage 1.0 (TID 538) 2020-02-14 21:51:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18018729984+33554432 2020-02-14 21:51:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:52:03 Executor: INFO: Finished task 537.0 in stage 1.0 (TID 538). 1626 bytes result sent to driver 2020-02-14 21:52:03 TaskSetManager: INFO: Starting task 538.0 in stage 1.0 (TID 539, localhost, executor driver, partition 538, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:52:03 TaskSetManager: INFO: Finished task 537.0 in stage 1.0 (TID 538) in 54703 ms on localhost (executor driver) (538/882) 2020-02-14 21:52:03 Executor: INFO: Running task 538.0 in stage 1.0 (TID 539) 2020-02-14 21:52:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18052284416+33554432 2020-02-14 21:52:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:53:03 Executor: INFO: Finished task 538.0 in stage 1.0 (TID 539). 1625 bytes result sent to driver 2020-02-14 21:53:03 TaskSetManager: INFO: Starting task 539.0 in stage 1.0 (TID 540, localhost, executor driver, partition 539, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:53:03 TaskSetManager: INFO: Finished task 538.0 in stage 1.0 (TID 539) in 59646 ms on localhost (executor driver) (539/882) 2020-02-14 21:53:03 Executor: INFO: Running task 539.0 in stage 1.0 (TID 540) 2020-02-14 21:53:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18085838848+33554432 2020-02-14 21:53:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:54:07 Executor: INFO: Finished task 539.0 in stage 1.0 (TID 540). 1667 bytes result sent to driver 2020-02-14 21:54:07 TaskSetManager: INFO: Starting task 540.0 in stage 1.0 (TID 541, localhost, executor driver, partition 540, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:54:07 TaskSetManager: INFO: Finished task 539.0 in stage 1.0 (TID 540) in 63908 ms on localhost (executor driver) (540/882) 2020-02-14 21:54:07 Executor: INFO: Running task 540.0 in stage 1.0 (TID 541) 2020-02-14 21:54:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18119393280+33554432 2020-02-14 21:54:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:55:13 Executor: INFO: Finished task 540.0 in stage 1.0 (TID 541). 1625 bytes result sent to driver 2020-02-14 21:55:13 TaskSetManager: INFO: Starting task 541.0 in stage 1.0 (TID 542, localhost, executor driver, partition 541, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:55:13 TaskSetManager: INFO: Finished task 540.0 in stage 1.0 (TID 541) in 66418 ms on localhost (executor driver) (541/882) 2020-02-14 21:55:13 Executor: INFO: Running task 541.0 in stage 1.0 (TID 542) 2020-02-14 21:55:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18152947712+33554432 2020-02-14 21:55:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:56:10 Executor: INFO: Finished task 541.0 in stage 1.0 (TID 542). 1632 bytes result sent to driver 2020-02-14 21:56:10 TaskSetManager: INFO: Starting task 542.0 in stage 1.0 (TID 543, localhost, executor driver, partition 542, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:56:10 TaskSetManager: INFO: Finished task 541.0 in stage 1.0 (TID 542) in 57186 ms on localhost (executor driver) (542/882) 2020-02-14 21:56:10 Executor: INFO: Running task 542.0 in stage 1.0 (TID 543) 2020-02-14 21:56:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18186502144+33554432 2020-02-14 21:56:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:57:13 Executor: INFO: Finished task 542.0 in stage 1.0 (TID 543). 1624 bytes result sent to driver 2020-02-14 21:57:13 TaskSetManager: INFO: Starting task 543.0 in stage 1.0 (TID 544, localhost, executor driver, partition 543, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:57:13 TaskSetManager: INFO: Finished task 542.0 in stage 1.0 (TID 543) in 62710 ms on localhost (executor driver) (543/882) 2020-02-14 21:57:13 Executor: INFO: Running task 543.0 in stage 1.0 (TID 544) 2020-02-14 21:57:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18220056576+33554432 2020-02-14 21:57:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:58:14 Executor: INFO: Finished task 543.0 in stage 1.0 (TID 544). 1642 bytes result sent to driver 2020-02-14 21:58:14 TaskSetManager: INFO: Starting task 544.0 in stage 1.0 (TID 545, localhost, executor driver, partition 544, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:58:14 TaskSetManager: INFO: Finished task 543.0 in stage 1.0 (TID 544) in 61086 ms on localhost (executor driver) (544/882) 2020-02-14 21:58:14 Executor: INFO: Running task 544.0 in stage 1.0 (TID 545) 2020-02-14 21:58:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18253611008+33554432 2020-02-14 21:58:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 21:59:09 Executor: INFO: Finished task 544.0 in stage 1.0 (TID 545). 1627 bytes result sent to driver 2020-02-14 21:59:09 TaskSetManager: INFO: Starting task 545.0 in stage 1.0 (TID 546, localhost, executor driver, partition 545, PROCESS_LOCAL, 7933 bytes) 2020-02-14 21:59:09 TaskSetManager: INFO: Finished task 544.0 in stage 1.0 (TID 545) in 55482 ms on localhost (executor driver) (545/882) 2020-02-14 21:59:09 Executor: INFO: Running task 545.0 in stage 1.0 (TID 546) 2020-02-14 21:59:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18287165440+33554432 2020-02-14 21:59:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:00:18 Executor: INFO: Finished task 545.0 in stage 1.0 (TID 546). 1628 bytes result sent to driver 2020-02-14 22:00:18 TaskSetManager: INFO: Starting task 546.0 in stage 1.0 (TID 547, localhost, executor driver, partition 546, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:00:18 TaskSetManager: INFO: Finished task 545.0 in stage 1.0 (TID 546) in 68939 ms on localhost (executor driver) (546/882) 2020-02-14 22:00:18 Executor: INFO: Running task 546.0 in stage 1.0 (TID 547) 2020-02-14 22:00:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18320719872+33554432 2020-02-14 22:00:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:01:19 Executor: INFO: Finished task 546.0 in stage 1.0 (TID 547). 1673 bytes result sent to driver 2020-02-14 22:01:19 TaskSetManager: INFO: Starting task 547.0 in stage 1.0 (TID 548, localhost, executor driver, partition 547, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:01:19 TaskSetManager: INFO: Finished task 546.0 in stage 1.0 (TID 547) in 61108 ms on localhost (executor driver) (547/882) 2020-02-14 22:01:19 Executor: INFO: Running task 547.0 in stage 1.0 (TID 548) 2020-02-14 22:01:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18354274304+33554432 2020-02-14 22:01:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:02:32 Executor: INFO: Finished task 547.0 in stage 1.0 (TID 548). 1624 bytes result sent to driver 2020-02-14 22:02:32 TaskSetManager: INFO: Starting task 548.0 in stage 1.0 (TID 549, localhost, executor driver, partition 548, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:02:32 TaskSetManager: INFO: Finished task 547.0 in stage 1.0 (TID 548) in 72027 ms on localhost (executor driver) (548/882) 2020-02-14 22:02:32 Executor: INFO: Running task 548.0 in stage 1.0 (TID 549) 2020-02-14 22:02:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18387828736+33554432 2020-02-14 22:02:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:03:30 Executor: INFO: Finished task 548.0 in stage 1.0 (TID 549). 1669 bytes result sent to driver 2020-02-14 22:03:30 TaskSetManager: INFO: Starting task 549.0 in stage 1.0 (TID 550, localhost, executor driver, partition 549, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:03:30 TaskSetManager: INFO: Finished task 548.0 in stage 1.0 (TID 549) in 58180 ms on localhost (executor driver) (549/882) 2020-02-14 22:03:30 Executor: INFO: Running task 549.0 in stage 1.0 (TID 550) 2020-02-14 22:03:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18421383168+33554432 2020-02-14 22:03:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:04:28 Executor: INFO: Finished task 549.0 in stage 1.0 (TID 550). 1624 bytes result sent to driver 2020-02-14 22:04:28 TaskSetManager: INFO: Starting task 550.0 in stage 1.0 (TID 551, localhost, executor driver, partition 550, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:04:28 TaskSetManager: INFO: Finished task 549.0 in stage 1.0 (TID 550) in 58166 ms on localhost (executor driver) (550/882) 2020-02-14 22:04:28 Executor: INFO: Running task 550.0 in stage 1.0 (TID 551) 2020-02-14 22:04:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18454937600+33554432 2020-02-14 22:04:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:05:28 Executor: INFO: Finished task 550.0 in stage 1.0 (TID 551). 1625 bytes result sent to driver 2020-02-14 22:05:28 TaskSetManager: INFO: Starting task 551.0 in stage 1.0 (TID 552, localhost, executor driver, partition 551, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:05:28 TaskSetManager: INFO: Finished task 550.0 in stage 1.0 (TID 551) in 60094 ms on localhost (executor driver) (551/882) 2020-02-14 22:05:28 Executor: INFO: Running task 551.0 in stage 1.0 (TID 552) 2020-02-14 22:05:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18488492032+33554432 2020-02-14 22:05:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:06:11 Executor: INFO: Finished task 551.0 in stage 1.0 (TID 552). 1629 bytes result sent to driver 2020-02-14 22:06:11 TaskSetManager: INFO: Starting task 552.0 in stage 1.0 (TID 553, localhost, executor driver, partition 552, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:06:11 TaskSetManager: INFO: Finished task 551.0 in stage 1.0 (TID 552) in 42912 ms on localhost (executor driver) (552/882) 2020-02-14 22:06:11 Executor: INFO: Running task 552.0 in stage 1.0 (TID 553) 2020-02-14 22:06:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18522046464+33554432 2020-02-14 22:06:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:06:57 Executor: INFO: Finished task 552.0 in stage 1.0 (TID 553). 1624 bytes result sent to driver 2020-02-14 22:06:57 TaskSetManager: INFO: Starting task 553.0 in stage 1.0 (TID 554, localhost, executor driver, partition 553, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:06:57 TaskSetManager: INFO: Finished task 552.0 in stage 1.0 (TID 553) in 46009 ms on localhost (executor driver) (553/882) 2020-02-14 22:06:57 Executor: INFO: Running task 553.0 in stage 1.0 (TID 554) 2020-02-14 22:06:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18555600896+33554432 2020-02-14 22:06:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:07:38 Executor: INFO: Finished task 553.0 in stage 1.0 (TID 554). 1626 bytes result sent to driver 2020-02-14 22:07:38 TaskSetManager: INFO: Starting task 554.0 in stage 1.0 (TID 555, localhost, executor driver, partition 554, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:07:38 TaskSetManager: INFO: Finished task 553.0 in stage 1.0 (TID 554) in 41137 ms on localhost (executor driver) (554/882) 2020-02-14 22:07:38 Executor: INFO: Running task 554.0 in stage 1.0 (TID 555) 2020-02-14 22:07:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18589155328+33554432 2020-02-14 22:07:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:08:23 Executor: INFO: Finished task 554.0 in stage 1.0 (TID 555). 1667 bytes result sent to driver 2020-02-14 22:08:23 TaskSetManager: INFO: Starting task 555.0 in stage 1.0 (TID 556, localhost, executor driver, partition 555, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:08:23 TaskSetManager: INFO: Finished task 554.0 in stage 1.0 (TID 555) in 45082 ms on localhost (executor driver) (555/882) 2020-02-14 22:08:23 Executor: INFO: Running task 555.0 in stage 1.0 (TID 556) 2020-02-14 22:08:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18622709760+33554432 2020-02-14 22:08:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:09:27 Executor: INFO: Finished task 555.0 in stage 1.0 (TID 556). 1624 bytes result sent to driver 2020-02-14 22:09:27 TaskSetManager: INFO: Starting task 556.0 in stage 1.0 (TID 557, localhost, executor driver, partition 556, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:09:27 TaskSetManager: INFO: Finished task 555.0 in stage 1.0 (TID 556) in 63447 ms on localhost (executor driver) (556/882) 2020-02-14 22:09:27 Executor: INFO: Running task 556.0 in stage 1.0 (TID 557) 2020-02-14 22:09:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18656264192+33554432 2020-02-14 22:09:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:10:20 Executor: INFO: Finished task 556.0 in stage 1.0 (TID 557). 1673 bytes result sent to driver 2020-02-14 22:10:20 TaskSetManager: INFO: Starting task 557.0 in stage 1.0 (TID 558, localhost, executor driver, partition 557, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:10:20 TaskSetManager: INFO: Finished task 556.0 in stage 1.0 (TID 557) in 53409 ms on localhost (executor driver) (557/882) 2020-02-14 22:10:20 Executor: INFO: Running task 557.0 in stage 1.0 (TID 558) 2020-02-14 22:10:20 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18689818624+33554432 2020-02-14 22:10:20 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:11:14 Executor: INFO: Finished task 557.0 in stage 1.0 (TID 558). 1675 bytes result sent to driver 2020-02-14 22:11:14 TaskSetManager: INFO: Starting task 558.0 in stage 1.0 (TID 559, localhost, executor driver, partition 558, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:11:14 TaskSetManager: INFO: Finished task 557.0 in stage 1.0 (TID 558) in 54317 ms on localhost (executor driver) (558/882) 2020-02-14 22:11:14 Executor: INFO: Running task 558.0 in stage 1.0 (TID 559) 2020-02-14 22:11:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18723373056+33554432 2020-02-14 22:11:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:12:19 Executor: INFO: Finished task 558.0 in stage 1.0 (TID 559). 1668 bytes result sent to driver 2020-02-14 22:12:19 TaskSetManager: INFO: Starting task 559.0 in stage 1.0 (TID 560, localhost, executor driver, partition 559, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:12:19 TaskSetManager: INFO: Finished task 558.0 in stage 1.0 (TID 559) in 64724 ms on localhost (executor driver) (559/882) 2020-02-14 22:12:19 Executor: INFO: Running task 559.0 in stage 1.0 (TID 560) 2020-02-14 22:12:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18756927488+33554432 2020-02-14 22:12:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:13:22 Executor: INFO: Finished task 559.0 in stage 1.0 (TID 560). 1645 bytes result sent to driver 2020-02-14 22:13:22 TaskSetManager: INFO: Starting task 560.0 in stage 1.0 (TID 561, localhost, executor driver, partition 560, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:13:22 TaskSetManager: INFO: Finished task 559.0 in stage 1.0 (TID 560) in 63075 ms on localhost (executor driver) (560/882) 2020-02-14 22:13:22 Executor: INFO: Running task 560.0 in stage 1.0 (TID 561) 2020-02-14 22:13:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18790481920+33554432 2020-02-14 22:13:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:14:24 Executor: INFO: Finished task 560.0 in stage 1.0 (TID 561). 1624 bytes result sent to driver 2020-02-14 22:14:24 TaskSetManager: INFO: Starting task 561.0 in stage 1.0 (TID 562, localhost, executor driver, partition 561, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:14:24 TaskSetManager: INFO: Finished task 560.0 in stage 1.0 (TID 561) in 62089 ms on localhost (executor driver) (561/882) 2020-02-14 22:14:24 Executor: INFO: Running task 561.0 in stage 1.0 (TID 562) 2020-02-14 22:14:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18824036352+33554432 2020-02-14 22:14:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:15:23 Executor: INFO: Finished task 561.0 in stage 1.0 (TID 562). 1624 bytes result sent to driver 2020-02-14 22:15:23 TaskSetManager: INFO: Starting task 562.0 in stage 1.0 (TID 563, localhost, executor driver, partition 562, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:15:23 TaskSetManager: INFO: Finished task 561.0 in stage 1.0 (TID 562) in 59345 ms on localhost (executor driver) (562/882) 2020-02-14 22:15:23 Executor: INFO: Running task 562.0 in stage 1.0 (TID 563) 2020-02-14 22:15:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18857590784+33554432 2020-02-14 22:15:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:16:22 Executor: INFO: Finished task 562.0 in stage 1.0 (TID 563). 1624 bytes result sent to driver 2020-02-14 22:16:22 TaskSetManager: INFO: Starting task 563.0 in stage 1.0 (TID 564, localhost, executor driver, partition 563, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:16:22 TaskSetManager: INFO: Finished task 562.0 in stage 1.0 (TID 563) in 58044 ms on localhost (executor driver) (563/882) 2020-02-14 22:16:22 Executor: INFO: Running task 563.0 in stage 1.0 (TID 564) 2020-02-14 22:16:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18891145216+33554432 2020-02-14 22:16:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:17:13 Executor: INFO: Finished task 563.0 in stage 1.0 (TID 564). 1676 bytes result sent to driver 2020-02-14 22:17:13 TaskSetManager: INFO: Starting task 564.0 in stage 1.0 (TID 565, localhost, executor driver, partition 564, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:17:13 TaskSetManager: INFO: Finished task 563.0 in stage 1.0 (TID 564) in 51345 ms on localhost (executor driver) (564/882) 2020-02-14 22:17:13 Executor: INFO: Running task 564.0 in stage 1.0 (TID 565) 2020-02-14 22:17:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18924699648+33554432 2020-02-14 22:17:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:18:01 Executor: INFO: Finished task 564.0 in stage 1.0 (TID 565). 1636 bytes result sent to driver 2020-02-14 22:18:01 TaskSetManager: INFO: Starting task 565.0 in stage 1.0 (TID 566, localhost, executor driver, partition 565, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:18:01 TaskSetManager: INFO: Finished task 564.0 in stage 1.0 (TID 565) in 47959 ms on localhost (executor driver) (565/882) 2020-02-14 22:18:01 Executor: INFO: Running task 565.0 in stage 1.0 (TID 566) 2020-02-14 22:18:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18958254080+33554432 2020-02-14 22:18:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:19:06 Executor: INFO: Finished task 565.0 in stage 1.0 (TID 566). 1625 bytes result sent to driver 2020-02-14 22:19:06 TaskSetManager: INFO: Starting task 566.0 in stage 1.0 (TID 567, localhost, executor driver, partition 566, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:19:06 TaskSetManager: INFO: Finished task 565.0 in stage 1.0 (TID 566) in 65594 ms on localhost (executor driver) (566/882) 2020-02-14 22:19:06 Executor: INFO: Running task 566.0 in stage 1.0 (TID 567) 2020-02-14 22:19:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:18991808512+33554432 2020-02-14 22:19:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:20:14 Executor: INFO: Finished task 566.0 in stage 1.0 (TID 567). 1667 bytes result sent to driver 2020-02-14 22:20:14 TaskSetManager: INFO: Starting task 567.0 in stage 1.0 (TID 568, localhost, executor driver, partition 567, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:20:14 TaskSetManager: INFO: Finished task 566.0 in stage 1.0 (TID 567) in 67961 ms on localhost (executor driver) (567/882) 2020-02-14 22:20:14 Executor: INFO: Running task 567.0 in stage 1.0 (TID 568) 2020-02-14 22:20:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19025362944+33554432 2020-02-14 22:20:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:21:11 Executor: INFO: Finished task 567.0 in stage 1.0 (TID 568). 1627 bytes result sent to driver 2020-02-14 22:21:11 TaskSetManager: INFO: Starting task 568.0 in stage 1.0 (TID 569, localhost, executor driver, partition 568, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:21:11 TaskSetManager: INFO: Finished task 567.0 in stage 1.0 (TID 568) in 56660 ms on localhost (executor driver) (568/882) 2020-02-14 22:21:11 Executor: INFO: Running task 568.0 in stage 1.0 (TID 569) 2020-02-14 22:21:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19058917376+33554432 2020-02-14 22:21:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:21:56 Executor: INFO: Finished task 568.0 in stage 1.0 (TID 569). 1638 bytes result sent to driver 2020-02-14 22:21:56 TaskSetManager: INFO: Starting task 569.0 in stage 1.0 (TID 570, localhost, executor driver, partition 569, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:21:56 TaskSetManager: INFO: Finished task 568.0 in stage 1.0 (TID 569) in 45347 ms on localhost (executor driver) (569/882) 2020-02-14 22:21:56 Executor: INFO: Running task 569.0 in stage 1.0 (TID 570) 2020-02-14 22:21:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19092471808+33554432 2020-02-14 22:21:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:22:57 Executor: INFO: Finished task 569.0 in stage 1.0 (TID 570). 1643 bytes result sent to driver 2020-02-14 22:22:57 TaskSetManager: INFO: Starting task 570.0 in stage 1.0 (TID 571, localhost, executor driver, partition 570, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:22:57 TaskSetManager: INFO: Finished task 569.0 in stage 1.0 (TID 570) in 60642 ms on localhost (executor driver) (570/882) 2020-02-14 22:22:57 Executor: INFO: Running task 570.0 in stage 1.0 (TID 571) 2020-02-14 22:22:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19126026240+33554432 2020-02-14 22:22:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:23:55 Executor: INFO: Finished task 570.0 in stage 1.0 (TID 571). 1624 bytes result sent to driver 2020-02-14 22:23:55 TaskSetManager: INFO: Starting task 571.0 in stage 1.0 (TID 572, localhost, executor driver, partition 571, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:23:55 TaskSetManager: INFO: Finished task 570.0 in stage 1.0 (TID 571) in 58426 ms on localhost (executor driver) (571/882) 2020-02-14 22:23:55 Executor: INFO: Running task 571.0 in stage 1.0 (TID 572) 2020-02-14 22:23:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19159580672+33554432 2020-02-14 22:23:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:24:50 Executor: INFO: Finished task 571.0 in stage 1.0 (TID 572). 1635 bytes result sent to driver 2020-02-14 22:24:50 TaskSetManager: INFO: Starting task 572.0 in stage 1.0 (TID 573, localhost, executor driver, partition 572, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:24:50 TaskSetManager: INFO: Finished task 571.0 in stage 1.0 (TID 572) in 54785 ms on localhost (executor driver) (572/882) 2020-02-14 22:24:50 Executor: INFO: Running task 572.0 in stage 1.0 (TID 573) 2020-02-14 22:24:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19193135104+33554432 2020-02-14 22:24:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:25:57 Executor: INFO: Finished task 572.0 in stage 1.0 (TID 573). 1624 bytes result sent to driver 2020-02-14 22:25:57 TaskSetManager: INFO: Starting task 573.0 in stage 1.0 (TID 574, localhost, executor driver, partition 573, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:25:57 TaskSetManager: INFO: Finished task 572.0 in stage 1.0 (TID 573) in 66267 ms on localhost (executor driver) (573/882) 2020-02-14 22:25:57 Executor: INFO: Running task 573.0 in stage 1.0 (TID 574) 2020-02-14 22:25:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19226689536+33554432 2020-02-14 22:25:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:26:46 Executor: INFO: Finished task 573.0 in stage 1.0 (TID 574). 1624 bytes result sent to driver 2020-02-14 22:26:46 TaskSetManager: INFO: Starting task 574.0 in stage 1.0 (TID 575, localhost, executor driver, partition 574, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:26:46 TaskSetManager: INFO: Finished task 573.0 in stage 1.0 (TID 574) in 49777 ms on localhost (executor driver) (574/882) 2020-02-14 22:26:46 Executor: INFO: Running task 574.0 in stage 1.0 (TID 575) 2020-02-14 22:26:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19260243968+33554432 2020-02-14 22:26:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:27:42 Executor: INFO: Finished task 574.0 in stage 1.0 (TID 575). 1671 bytes result sent to driver 2020-02-14 22:27:42 TaskSetManager: INFO: Starting task 575.0 in stage 1.0 (TID 576, localhost, executor driver, partition 575, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:27:42 TaskSetManager: INFO: Finished task 574.0 in stage 1.0 (TID 575) in 56102 ms on localhost (executor driver) (575/882) 2020-02-14 22:27:42 Executor: INFO: Running task 575.0 in stage 1.0 (TID 576) 2020-02-14 22:27:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19293798400+33554432 2020-02-14 22:27:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:28:39 Executor: INFO: Finished task 575.0 in stage 1.0 (TID 576). 1624 bytes result sent to driver 2020-02-14 22:28:39 TaskSetManager: INFO: Starting task 576.0 in stage 1.0 (TID 577, localhost, executor driver, partition 576, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:28:39 TaskSetManager: INFO: Finished task 575.0 in stage 1.0 (TID 576) in 56637 ms on localhost (executor driver) (576/882) 2020-02-14 22:28:39 Executor: INFO: Running task 576.0 in stage 1.0 (TID 577) 2020-02-14 22:28:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19327352832+33554432 2020-02-14 22:28:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:29:32 Executor: INFO: Finished task 576.0 in stage 1.0 (TID 577). 1625 bytes result sent to driver 2020-02-14 22:29:32 TaskSetManager: INFO: Starting task 577.0 in stage 1.0 (TID 578, localhost, executor driver, partition 577, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:29:32 TaskSetManager: INFO: Finished task 576.0 in stage 1.0 (TID 577) in 53198 ms on localhost (executor driver) (577/882) 2020-02-14 22:29:32 Executor: INFO: Running task 577.0 in stage 1.0 (TID 578) 2020-02-14 22:29:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19360907264+33554432 2020-02-14 22:29:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:30:27 Executor: INFO: Finished task 577.0 in stage 1.0 (TID 578). 1766 bytes result sent to driver 2020-02-14 22:30:27 TaskSetManager: INFO: Starting task 578.0 in stage 1.0 (TID 579, localhost, executor driver, partition 578, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:30:27 TaskSetManager: INFO: Finished task 577.0 in stage 1.0 (TID 578) in 54293 ms on localhost (executor driver) (578/882) 2020-02-14 22:30:27 Executor: INFO: Running task 578.0 in stage 1.0 (TID 579) 2020-02-14 22:30:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19394461696+33554432 2020-02-14 22:30:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:31:31 Executor: INFO: Finished task 578.0 in stage 1.0 (TID 579). 1624 bytes result sent to driver 2020-02-14 22:31:31 TaskSetManager: INFO: Starting task 579.0 in stage 1.0 (TID 580, localhost, executor driver, partition 579, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:31:31 TaskSetManager: INFO: Finished task 578.0 in stage 1.0 (TID 579) in 64871 ms on localhost (executor driver) (579/882) 2020-02-14 22:31:31 Executor: INFO: Running task 579.0 in stage 1.0 (TID 580) 2020-02-14 22:31:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19428016128+33554432 2020-02-14 22:31:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:32:36 Executor: INFO: Finished task 579.0 in stage 1.0 (TID 580). 1624 bytes result sent to driver 2020-02-14 22:32:36 TaskSetManager: INFO: Starting task 580.0 in stage 1.0 (TID 581, localhost, executor driver, partition 580, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:32:36 TaskSetManager: INFO: Finished task 579.0 in stage 1.0 (TID 580) in 64601 ms on localhost (executor driver) (580/882) 2020-02-14 22:32:36 Executor: INFO: Running task 580.0 in stage 1.0 (TID 581) 2020-02-14 22:32:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19461570560+33554432 2020-02-14 22:32:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:33:12 Executor: INFO: Finished task 580.0 in stage 1.0 (TID 581). 1624 bytes result sent to driver 2020-02-14 22:33:12 TaskSetManager: INFO: Starting task 581.0 in stage 1.0 (TID 582, localhost, executor driver, partition 581, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:33:12 TaskSetManager: INFO: Finished task 580.0 in stage 1.0 (TID 581) in 36336 ms on localhost (executor driver) (581/882) 2020-02-14 22:33:12 Executor: INFO: Running task 581.0 in stage 1.0 (TID 582) 2020-02-14 22:33:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19495124992+33554432 2020-02-14 22:33:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:34:13 Executor: INFO: Finished task 581.0 in stage 1.0 (TID 582). 1710 bytes result sent to driver 2020-02-14 22:34:13 TaskSetManager: INFO: Starting task 582.0 in stage 1.0 (TID 583, localhost, executor driver, partition 582, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:34:13 TaskSetManager: INFO: Finished task 581.0 in stage 1.0 (TID 582) in 60178 ms on localhost (executor driver) (582/882) 2020-02-14 22:34:13 Executor: INFO: Running task 582.0 in stage 1.0 (TID 583) 2020-02-14 22:34:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19528679424+33554432 2020-02-14 22:34:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:35:10 Executor: INFO: Finished task 582.0 in stage 1.0 (TID 583). 1635 bytes result sent to driver 2020-02-14 22:35:10 TaskSetManager: INFO: Starting task 583.0 in stage 1.0 (TID 584, localhost, executor driver, partition 583, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:35:10 TaskSetManager: INFO: Finished task 582.0 in stage 1.0 (TID 583) in 57951 ms on localhost (executor driver) (583/882) 2020-02-14 22:35:10 Executor: INFO: Running task 583.0 in stage 1.0 (TID 584) 2020-02-14 22:35:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19562233856+33554432 2020-02-14 22:35:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:36:04 Executor: INFO: Finished task 583.0 in stage 1.0 (TID 584). 1642 bytes result sent to driver 2020-02-14 22:36:04 TaskSetManager: INFO: Starting task 584.0 in stage 1.0 (TID 585, localhost, executor driver, partition 584, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:36:04 TaskSetManager: INFO: Finished task 583.0 in stage 1.0 (TID 584) in 53934 ms on localhost (executor driver) (584/882) 2020-02-14 22:36:04 Executor: INFO: Running task 584.0 in stage 1.0 (TID 585) 2020-02-14 22:36:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19595788288+33554432 2020-02-14 22:36:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:37:02 Executor: INFO: Finished task 584.0 in stage 1.0 (TID 585). 1667 bytes result sent to driver 2020-02-14 22:37:02 TaskSetManager: INFO: Starting task 585.0 in stage 1.0 (TID 586, localhost, executor driver, partition 585, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:37:02 TaskSetManager: INFO: Finished task 584.0 in stage 1.0 (TID 585) in 57453 ms on localhost (executor driver) (585/882) 2020-02-14 22:37:02 Executor: INFO: Running task 585.0 in stage 1.0 (TID 586) 2020-02-14 22:37:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19629342720+33554432 2020-02-14 22:37:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:37:55 Executor: INFO: Finished task 585.0 in stage 1.0 (TID 586). 1624 bytes result sent to driver 2020-02-14 22:37:55 TaskSetManager: INFO: Starting task 586.0 in stage 1.0 (TID 587, localhost, executor driver, partition 586, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:37:55 TaskSetManager: INFO: Finished task 585.0 in stage 1.0 (TID 586) in 53302 ms on localhost (executor driver) (586/882) 2020-02-14 22:37:55 Executor: INFO: Running task 586.0 in stage 1.0 (TID 587) 2020-02-14 22:37:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19662897152+33554432 2020-02-14 22:37:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:38:58 Executor: INFO: Finished task 586.0 in stage 1.0 (TID 587). 1624 bytes result sent to driver 2020-02-14 22:38:58 TaskSetManager: INFO: Starting task 587.0 in stage 1.0 (TID 588, localhost, executor driver, partition 587, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:38:58 TaskSetManager: INFO: Finished task 586.0 in stage 1.0 (TID 587) in 62627 ms on localhost (executor driver) (587/882) 2020-02-14 22:38:58 Executor: INFO: Running task 587.0 in stage 1.0 (TID 588) 2020-02-14 22:38:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19696451584+33554432 2020-02-14 22:38:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:39:57 Executor: INFO: Finished task 587.0 in stage 1.0 (TID 588). 1634 bytes result sent to driver 2020-02-14 22:39:57 TaskSetManager: INFO: Starting task 588.0 in stage 1.0 (TID 589, localhost, executor driver, partition 588, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:39:57 TaskSetManager: INFO: Finished task 587.0 in stage 1.0 (TID 588) in 59307 ms on localhost (executor driver) (588/882) 2020-02-14 22:39:57 Executor: INFO: Running task 588.0 in stage 1.0 (TID 589) 2020-02-14 22:39:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19730006016+33554432 2020-02-14 22:39:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:40:48 Executor: INFO: Finished task 588.0 in stage 1.0 (TID 589). 1626 bytes result sent to driver 2020-02-14 22:40:48 TaskSetManager: INFO: Starting task 589.0 in stage 1.0 (TID 590, localhost, executor driver, partition 589, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:40:48 TaskSetManager: INFO: Finished task 588.0 in stage 1.0 (TID 589) in 50998 ms on localhost (executor driver) (589/882) 2020-02-14 22:40:48 Executor: INFO: Running task 589.0 in stage 1.0 (TID 590) 2020-02-14 22:40:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19763560448+33554432 2020-02-14 22:40:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:41:41 Executor: INFO: Finished task 589.0 in stage 1.0 (TID 590). 1667 bytes result sent to driver 2020-02-14 22:41:41 TaskSetManager: INFO: Starting task 590.0 in stage 1.0 (TID 591, localhost, executor driver, partition 590, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:41:41 TaskSetManager: INFO: Finished task 589.0 in stage 1.0 (TID 590) in 52840 ms on localhost (executor driver) (590/882) 2020-02-14 22:41:41 Executor: INFO: Running task 590.0 in stage 1.0 (TID 591) 2020-02-14 22:41:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19797114880+33554432 2020-02-14 22:41:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:42:39 Executor: INFO: Finished task 590.0 in stage 1.0 (TID 591). 1624 bytes result sent to driver 2020-02-14 22:42:39 TaskSetManager: INFO: Starting task 591.0 in stage 1.0 (TID 592, localhost, executor driver, partition 591, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:42:39 TaskSetManager: INFO: Finished task 590.0 in stage 1.0 (TID 591) in 57843 ms on localhost (executor driver) (591/882) 2020-02-14 22:42:39 Executor: INFO: Running task 591.0 in stage 1.0 (TID 592) 2020-02-14 22:42:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19830669312+33554432 2020-02-14 22:42:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:43:45 Executor: INFO: Finished task 591.0 in stage 1.0 (TID 592). 1624 bytes result sent to driver 2020-02-14 22:43:45 TaskSetManager: INFO: Starting task 592.0 in stage 1.0 (TID 593, localhost, executor driver, partition 592, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:43:45 TaskSetManager: INFO: Finished task 591.0 in stage 1.0 (TID 592) in 66058 ms on localhost (executor driver) (592/882) 2020-02-14 22:43:45 Executor: INFO: Running task 592.0 in stage 1.0 (TID 593) 2020-02-14 22:43:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19864223744+33554432 2020-02-14 22:43:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:44:46 Executor: INFO: Finished task 592.0 in stage 1.0 (TID 593). 1633 bytes result sent to driver 2020-02-14 22:44:46 TaskSetManager: INFO: Starting task 593.0 in stage 1.0 (TID 594, localhost, executor driver, partition 593, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:44:46 TaskSetManager: INFO: Finished task 592.0 in stage 1.0 (TID 593) in 61366 ms on localhost (executor driver) (593/882) 2020-02-14 22:44:46 Executor: INFO: Running task 593.0 in stage 1.0 (TID 594) 2020-02-14 22:44:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19897778176+33554432 2020-02-14 22:44:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:45:48 Executor: INFO: Finished task 593.0 in stage 1.0 (TID 594). 1624 bytes result sent to driver 2020-02-14 22:45:48 TaskSetManager: INFO: Starting task 594.0 in stage 1.0 (TID 595, localhost, executor driver, partition 594, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:45:48 TaskSetManager: INFO: Finished task 593.0 in stage 1.0 (TID 594) in 61944 ms on localhost (executor driver) (594/882) 2020-02-14 22:45:48 Executor: INFO: Running task 594.0 in stage 1.0 (TID 595) 2020-02-14 22:45:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19931332608+33554432 2020-02-14 22:45:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:46:50 Executor: INFO: Finished task 594.0 in stage 1.0 (TID 595). 1698 bytes result sent to driver 2020-02-14 22:46:50 TaskSetManager: INFO: Starting task 595.0 in stage 1.0 (TID 596, localhost, executor driver, partition 595, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:46:50 TaskSetManager: INFO: Finished task 594.0 in stage 1.0 (TID 595) in 62072 ms on localhost (executor driver) (595/882) 2020-02-14 22:46:50 Executor: INFO: Running task 595.0 in stage 1.0 (TID 596) 2020-02-14 22:46:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19964887040+33554432 2020-02-14 22:46:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:47:46 Executor: INFO: Finished task 595.0 in stage 1.0 (TID 596). 1626 bytes result sent to driver 2020-02-14 22:47:46 TaskSetManager: INFO: Starting task 596.0 in stage 1.0 (TID 597, localhost, executor driver, partition 596, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:47:46 TaskSetManager: INFO: Finished task 595.0 in stage 1.0 (TID 596) in 55558 ms on localhost (executor driver) (596/882) 2020-02-14 22:47:46 Executor: INFO: Running task 596.0 in stage 1.0 (TID 597) 2020-02-14 22:47:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:19998441472+33554432 2020-02-14 22:47:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:48:27 Executor: INFO: Finished task 596.0 in stage 1.0 (TID 597). 1657 bytes result sent to driver 2020-02-14 22:48:27 TaskSetManager: INFO: Starting task 597.0 in stage 1.0 (TID 598, localhost, executor driver, partition 597, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:48:27 TaskSetManager: INFO: Finished task 596.0 in stage 1.0 (TID 597) in 41741 ms on localhost (executor driver) (597/882) 2020-02-14 22:48:27 Executor: INFO: Running task 597.0 in stage 1.0 (TID 598) 2020-02-14 22:48:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20031995904+33554432 2020-02-14 22:48:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:49:18 Executor: INFO: Finished task 597.0 in stage 1.0 (TID 598). 1624 bytes result sent to driver 2020-02-14 22:49:18 TaskSetManager: INFO: Starting task 598.0 in stage 1.0 (TID 599, localhost, executor driver, partition 598, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:49:18 TaskSetManager: INFO: Finished task 597.0 in stage 1.0 (TID 598) in 50926 ms on localhost (executor driver) (598/882) 2020-02-14 22:49:18 Executor: INFO: Running task 598.0 in stage 1.0 (TID 599) 2020-02-14 22:49:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20065550336+33554432 2020-02-14 22:49:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:50:09 Executor: INFO: Finished task 598.0 in stage 1.0 (TID 599). 1624 bytes result sent to driver 2020-02-14 22:50:09 TaskSetManager: INFO: Starting task 599.0 in stage 1.0 (TID 600, localhost, executor driver, partition 599, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:50:09 TaskSetManager: INFO: Finished task 598.0 in stage 1.0 (TID 599) in 50182 ms on localhost (executor driver) (599/882) 2020-02-14 22:50:09 Executor: INFO: Running task 599.0 in stage 1.0 (TID 600) 2020-02-14 22:50:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20099104768+33554432 2020-02-14 22:50:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:51:02 Executor: INFO: Finished task 599.0 in stage 1.0 (TID 600). 1681 bytes result sent to driver 2020-02-14 22:51:02 TaskSetManager: INFO: Starting task 600.0 in stage 1.0 (TID 601, localhost, executor driver, partition 600, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:51:02 TaskSetManager: INFO: Finished task 599.0 in stage 1.0 (TID 600) in 53391 ms on localhost (executor driver) (600/882) 2020-02-14 22:51:02 Executor: INFO: Running task 600.0 in stage 1.0 (TID 601) 2020-02-14 22:51:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20132659200+33554432 2020-02-14 22:51:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:51:45 Executor: INFO: Finished task 600.0 in stage 1.0 (TID 601). 1624 bytes result sent to driver 2020-02-14 22:51:45 TaskSetManager: INFO: Starting task 601.0 in stage 1.0 (TID 602, localhost, executor driver, partition 601, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:51:45 TaskSetManager: INFO: Finished task 600.0 in stage 1.0 (TID 601) in 42920 ms on localhost (executor driver) (601/882) 2020-02-14 22:51:45 Executor: INFO: Running task 601.0 in stage 1.0 (TID 602) 2020-02-14 22:51:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20166213632+33554432 2020-02-14 22:51:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:52:40 Executor: INFO: Finished task 601.0 in stage 1.0 (TID 602). 1624 bytes result sent to driver 2020-02-14 22:52:40 TaskSetManager: INFO: Starting task 602.0 in stage 1.0 (TID 603, localhost, executor driver, partition 602, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:52:40 TaskSetManager: INFO: Finished task 601.0 in stage 1.0 (TID 602) in 55217 ms on localhost (executor driver) (602/882) 2020-02-14 22:52:40 Executor: INFO: Running task 602.0 in stage 1.0 (TID 603) 2020-02-14 22:52:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20199768064+33554432 2020-02-14 22:52:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:53:52 Executor: INFO: Finished task 602.0 in stage 1.0 (TID 603). 1624 bytes result sent to driver 2020-02-14 22:53:52 TaskSetManager: INFO: Starting task 603.0 in stage 1.0 (TID 604, localhost, executor driver, partition 603, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:53:52 TaskSetManager: INFO: Finished task 602.0 in stage 1.0 (TID 603) in 72094 ms on localhost (executor driver) (603/882) 2020-02-14 22:53:52 Executor: INFO: Running task 603.0 in stage 1.0 (TID 604) 2020-02-14 22:53:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20233322496+33554432 2020-02-14 22:53:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:54:47 Executor: INFO: Finished task 603.0 in stage 1.0 (TID 604). 1625 bytes result sent to driver 2020-02-14 22:54:47 TaskSetManager: INFO: Starting task 604.0 in stage 1.0 (TID 605, localhost, executor driver, partition 604, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:54:47 TaskSetManager: INFO: Finished task 603.0 in stage 1.0 (TID 604) in 54949 ms on localhost (executor driver) (604/882) 2020-02-14 22:54:47 Executor: INFO: Running task 604.0 in stage 1.0 (TID 605) 2020-02-14 22:54:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20266876928+33554432 2020-02-14 22:54:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:55:40 Executor: INFO: Finished task 604.0 in stage 1.0 (TID 605). 1631 bytes result sent to driver 2020-02-14 22:55:40 TaskSetManager: INFO: Starting task 605.0 in stage 1.0 (TID 606, localhost, executor driver, partition 605, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:55:40 TaskSetManager: INFO: Finished task 604.0 in stage 1.0 (TID 605) in 52541 ms on localhost (executor driver) (605/882) 2020-02-14 22:55:40 Executor: INFO: Running task 605.0 in stage 1.0 (TID 606) 2020-02-14 22:55:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20300431360+33554432 2020-02-14 22:55:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:56:32 Executor: INFO: Finished task 605.0 in stage 1.0 (TID 606). 1624 bytes result sent to driver 2020-02-14 22:56:32 TaskSetManager: INFO: Starting task 606.0 in stage 1.0 (TID 607, localhost, executor driver, partition 606, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:56:32 TaskSetManager: INFO: Finished task 605.0 in stage 1.0 (TID 606) in 52159 ms on localhost (executor driver) (606/882) 2020-02-14 22:56:32 Executor: INFO: Running task 606.0 in stage 1.0 (TID 607) 2020-02-14 22:56:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20333985792+33554432 2020-02-14 22:56:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:57:40 Executor: INFO: Finished task 606.0 in stage 1.0 (TID 607). 1628 bytes result sent to driver 2020-02-14 22:57:40 TaskSetManager: INFO: Starting task 607.0 in stage 1.0 (TID 608, localhost, executor driver, partition 607, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:57:40 TaskSetManager: INFO: Finished task 606.0 in stage 1.0 (TID 607) in 67979 ms on localhost (executor driver) (607/882) 2020-02-14 22:57:40 Executor: INFO: Running task 607.0 in stage 1.0 (TID 608) 2020-02-14 22:57:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20367540224+33554432 2020-02-14 22:57:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:58:47 Executor: INFO: Finished task 607.0 in stage 1.0 (TID 608). 1624 bytes result sent to driver 2020-02-14 22:58:47 TaskSetManager: INFO: Starting task 608.0 in stage 1.0 (TID 609, localhost, executor driver, partition 608, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:58:47 TaskSetManager: INFO: Finished task 607.0 in stage 1.0 (TID 608) in 66673 ms on localhost (executor driver) (608/882) 2020-02-14 22:58:47 Executor: INFO: Running task 608.0 in stage 1.0 (TID 609) 2020-02-14 22:58:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20401094656+33554432 2020-02-14 22:58:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 22:59:54 Executor: INFO: Finished task 608.0 in stage 1.0 (TID 609). 1624 bytes result sent to driver 2020-02-14 22:59:54 TaskSetManager: INFO: Starting task 609.0 in stage 1.0 (TID 610, localhost, executor driver, partition 609, PROCESS_LOCAL, 7933 bytes) 2020-02-14 22:59:54 TaskSetManager: INFO: Finished task 608.0 in stage 1.0 (TID 609) in 67525 ms on localhost (executor driver) (609/882) 2020-02-14 22:59:54 Executor: INFO: Running task 609.0 in stage 1.0 (TID 610) 2020-02-14 22:59:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20434649088+33554432 2020-02-14 22:59:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:00:56 Executor: INFO: Finished task 609.0 in stage 1.0 (TID 610). 1624 bytes result sent to driver 2020-02-14 23:00:56 TaskSetManager: INFO: Starting task 610.0 in stage 1.0 (TID 611, localhost, executor driver, partition 610, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:00:56 TaskSetManager: INFO: Finished task 609.0 in stage 1.0 (TID 610) in 62397 ms on localhost (executor driver) (610/882) 2020-02-14 23:00:56 Executor: INFO: Running task 610.0 in stage 1.0 (TID 611) 2020-02-14 23:00:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20468203520+33554432 2020-02-14 23:00:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:01:59 Executor: INFO: Finished task 610.0 in stage 1.0 (TID 611). 1631 bytes result sent to driver 2020-02-14 23:01:59 TaskSetManager: INFO: Starting task 611.0 in stage 1.0 (TID 612, localhost, executor driver, partition 611, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:01:59 TaskSetManager: INFO: Finished task 610.0 in stage 1.0 (TID 611) in 63041 ms on localhost (executor driver) (611/882) 2020-02-14 23:01:59 Executor: INFO: Running task 611.0 in stage 1.0 (TID 612) 2020-02-14 23:01:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20501757952+33554432 2020-02-14 23:01:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:02:54 Executor: INFO: Finished task 611.0 in stage 1.0 (TID 612). 1667 bytes result sent to driver 2020-02-14 23:02:54 TaskSetManager: INFO: Starting task 612.0 in stage 1.0 (TID 613, localhost, executor driver, partition 612, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:02:54 TaskSetManager: INFO: Finished task 611.0 in stage 1.0 (TID 612) in 54599 ms on localhost (executor driver) (612/882) 2020-02-14 23:02:54 Executor: INFO: Running task 612.0 in stage 1.0 (TID 613) 2020-02-14 23:02:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20535312384+33554432 2020-02-14 23:02:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:03:46 Executor: INFO: Finished task 612.0 in stage 1.0 (TID 613). 1628 bytes result sent to driver 2020-02-14 23:03:46 TaskSetManager: INFO: Starting task 613.0 in stage 1.0 (TID 614, localhost, executor driver, partition 613, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:03:46 TaskSetManager: INFO: Finished task 612.0 in stage 1.0 (TID 613) in 51769 ms on localhost (executor driver) (613/882) 2020-02-14 23:03:46 Executor: INFO: Running task 613.0 in stage 1.0 (TID 614) 2020-02-14 23:03:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20568866816+33554432 2020-02-14 23:03:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:04:34 Executor: INFO: Finished task 613.0 in stage 1.0 (TID 614). 1624 bytes result sent to driver 2020-02-14 23:04:34 TaskSetManager: INFO: Starting task 614.0 in stage 1.0 (TID 615, localhost, executor driver, partition 614, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:04:34 TaskSetManager: INFO: Finished task 613.0 in stage 1.0 (TID 614) in 48141 ms on localhost (executor driver) (614/882) 2020-02-14 23:04:34 Executor: INFO: Running task 614.0 in stage 1.0 (TID 615) 2020-02-14 23:04:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20602421248+33554432 2020-02-14 23:04:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:05:30 Executor: INFO: Finished task 614.0 in stage 1.0 (TID 615). 1627 bytes result sent to driver 2020-02-14 23:05:30 TaskSetManager: INFO: Starting task 615.0 in stage 1.0 (TID 616, localhost, executor driver, partition 615, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:05:30 TaskSetManager: INFO: Finished task 614.0 in stage 1.0 (TID 615) in 56192 ms on localhost (executor driver) (615/882) 2020-02-14 23:05:30 Executor: INFO: Running task 615.0 in stage 1.0 (TID 616) 2020-02-14 23:05:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20635975680+33554432 2020-02-14 23:05:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:06:10 Executor: INFO: Finished task 615.0 in stage 1.0 (TID 616). 1695 bytes result sent to driver 2020-02-14 23:06:10 TaskSetManager: INFO: Starting task 616.0 in stage 1.0 (TID 617, localhost, executor driver, partition 616, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:06:10 TaskSetManager: INFO: Finished task 615.0 in stage 1.0 (TID 616) in 40091 ms on localhost (executor driver) (616/882) 2020-02-14 23:06:10 Executor: INFO: Running task 616.0 in stage 1.0 (TID 617) 2020-02-14 23:06:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20669530112+33554432 2020-02-14 23:06:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:06:58 Executor: INFO: Finished task 616.0 in stage 1.0 (TID 617). 1634 bytes result sent to driver 2020-02-14 23:06:58 TaskSetManager: INFO: Starting task 617.0 in stage 1.0 (TID 618, localhost, executor driver, partition 617, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:06:58 TaskSetManager: INFO: Finished task 616.0 in stage 1.0 (TID 617) in 48028 ms on localhost (executor driver) (617/882) 2020-02-14 23:06:58 Executor: INFO: Running task 617.0 in stage 1.0 (TID 618) 2020-02-14 23:06:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20703084544+33554432 2020-02-14 23:06:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:07:59 Executor: INFO: Finished task 617.0 in stage 1.0 (TID 618). 1624 bytes result sent to driver 2020-02-14 23:07:59 TaskSetManager: INFO: Starting task 618.0 in stage 1.0 (TID 619, localhost, executor driver, partition 618, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:07:59 TaskSetManager: INFO: Finished task 617.0 in stage 1.0 (TID 618) in 61112 ms on localhost (executor driver) (618/882) 2020-02-14 23:07:59 Executor: INFO: Running task 618.0 in stage 1.0 (TID 619) 2020-02-14 23:07:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20736638976+33554432 2020-02-14 23:07:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:08:57 Executor: INFO: Finished task 618.0 in stage 1.0 (TID 619). 1626 bytes result sent to driver 2020-02-14 23:08:57 TaskSetManager: INFO: Starting task 619.0 in stage 1.0 (TID 620, localhost, executor driver, partition 619, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:08:57 TaskSetManager: INFO: Finished task 618.0 in stage 1.0 (TID 619) in 57314 ms on localhost (executor driver) (619/882) 2020-02-14 23:08:57 Executor: INFO: Running task 619.0 in stage 1.0 (TID 620) 2020-02-14 23:08:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20770193408+33554432 2020-02-14 23:08:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:09:55 Executor: INFO: Finished task 619.0 in stage 1.0 (TID 620). 1625 bytes result sent to driver 2020-02-14 23:09:55 TaskSetManager: INFO: Starting task 620.0 in stage 1.0 (TID 621, localhost, executor driver, partition 620, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:09:55 TaskSetManager: INFO: Finished task 619.0 in stage 1.0 (TID 620) in 58125 ms on localhost (executor driver) (620/882) 2020-02-14 23:09:55 Executor: INFO: Running task 620.0 in stage 1.0 (TID 621) 2020-02-14 23:09:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20803747840+33554432 2020-02-14 23:09:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:10:45 Executor: INFO: Finished task 620.0 in stage 1.0 (TID 621). 1645 bytes result sent to driver 2020-02-14 23:10:45 TaskSetManager: INFO: Starting task 621.0 in stage 1.0 (TID 622, localhost, executor driver, partition 621, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:10:45 TaskSetManager: INFO: Finished task 620.0 in stage 1.0 (TID 621) in 49875 ms on localhost (executor driver) (621/882) 2020-02-14 23:10:45 Executor: INFO: Running task 621.0 in stage 1.0 (TID 622) 2020-02-14 23:10:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20837302272+33554432 2020-02-14 23:10:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:11:38 Executor: INFO: Finished task 621.0 in stage 1.0 (TID 622). 1625 bytes result sent to driver 2020-02-14 23:11:38 TaskSetManager: INFO: Starting task 622.0 in stage 1.0 (TID 623, localhost, executor driver, partition 622, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:11:38 TaskSetManager: INFO: Finished task 621.0 in stage 1.0 (TID 622) in 53129 ms on localhost (executor driver) (622/882) 2020-02-14 23:11:38 Executor: INFO: Running task 622.0 in stage 1.0 (TID 623) 2020-02-14 23:11:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20870856704+33554432 2020-02-14 23:11:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:12:31 Executor: INFO: Finished task 622.0 in stage 1.0 (TID 623). 1627 bytes result sent to driver 2020-02-14 23:12:31 TaskSetManager: INFO: Starting task 623.0 in stage 1.0 (TID 624, localhost, executor driver, partition 623, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:12:31 TaskSetManager: INFO: Finished task 622.0 in stage 1.0 (TID 623) in 53646 ms on localhost (executor driver) (623/882) 2020-02-14 23:12:31 Executor: INFO: Running task 623.0 in stage 1.0 (TID 624) 2020-02-14 23:12:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20904411136+33554432 2020-02-14 23:12:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:13:36 Executor: INFO: Finished task 623.0 in stage 1.0 (TID 624). 1624 bytes result sent to driver 2020-02-14 23:13:36 TaskSetManager: INFO: Starting task 624.0 in stage 1.0 (TID 625, localhost, executor driver, partition 624, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:13:36 TaskSetManager: INFO: Finished task 623.0 in stage 1.0 (TID 624) in 64410 ms on localhost (executor driver) (624/882) 2020-02-14 23:13:36 Executor: INFO: Running task 624.0 in stage 1.0 (TID 625) 2020-02-14 23:13:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20937965568+33554432 2020-02-14 23:13:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:14:43 Executor: INFO: Finished task 624.0 in stage 1.0 (TID 625). 1683 bytes result sent to driver 2020-02-14 23:14:43 TaskSetManager: INFO: Starting task 625.0 in stage 1.0 (TID 626, localhost, executor driver, partition 625, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:14:43 TaskSetManager: INFO: Finished task 624.0 in stage 1.0 (TID 625) in 67172 ms on localhost (executor driver) (625/882) 2020-02-14 23:14:43 Executor: INFO: Running task 625.0 in stage 1.0 (TID 626) 2020-02-14 23:14:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:20971520000+33554432 2020-02-14 23:14:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:15:42 Executor: INFO: Finished task 625.0 in stage 1.0 (TID 626). 1651 bytes result sent to driver 2020-02-14 23:15:42 TaskSetManager: INFO: Starting task 626.0 in stage 1.0 (TID 627, localhost, executor driver, partition 626, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:15:42 TaskSetManager: INFO: Finished task 625.0 in stage 1.0 (TID 626) in 58808 ms on localhost (executor driver) (626/882) 2020-02-14 23:15:42 Executor: INFO: Running task 626.0 in stage 1.0 (TID 627) 2020-02-14 23:15:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21005074432+33554432 2020-02-14 23:15:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:16:32 Executor: INFO: Finished task 626.0 in stage 1.0 (TID 627). 1630 bytes result sent to driver 2020-02-14 23:16:32 TaskSetManager: INFO: Starting task 627.0 in stage 1.0 (TID 628, localhost, executor driver, partition 627, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:16:32 TaskSetManager: INFO: Finished task 626.0 in stage 1.0 (TID 627) in 50069 ms on localhost (executor driver) (627/882) 2020-02-14 23:16:32 Executor: INFO: Running task 627.0 in stage 1.0 (TID 628) 2020-02-14 23:16:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21038628864+33554432 2020-02-14 23:16:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:17:21 Executor: INFO: Finished task 627.0 in stage 1.0 (TID 628). 1682 bytes result sent to driver 2020-02-14 23:17:21 TaskSetManager: INFO: Starting task 628.0 in stage 1.0 (TID 629, localhost, executor driver, partition 628, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:17:21 TaskSetManager: INFO: Finished task 627.0 in stage 1.0 (TID 628) in 48700 ms on localhost (executor driver) (628/882) 2020-02-14 23:17:21 Executor: INFO: Running task 628.0 in stage 1.0 (TID 629) 2020-02-14 23:17:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21072183296+33554432 2020-02-14 23:17:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:18:11 Executor: INFO: Finished task 628.0 in stage 1.0 (TID 629). 1643 bytes result sent to driver 2020-02-14 23:18:11 TaskSetManager: INFO: Starting task 629.0 in stage 1.0 (TID 630, localhost, executor driver, partition 629, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:18:11 TaskSetManager: INFO: Finished task 628.0 in stage 1.0 (TID 629) in 50744 ms on localhost (executor driver) (629/882) 2020-02-14 23:18:11 Executor: INFO: Running task 629.0 in stage 1.0 (TID 630) 2020-02-14 23:18:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21105737728+33554432 2020-02-14 23:18:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:19:00 Executor: INFO: Finished task 629.0 in stage 1.0 (TID 630). 1667 bytes result sent to driver 2020-02-14 23:19:00 TaskSetManager: INFO: Starting task 630.0 in stage 1.0 (TID 631, localhost, executor driver, partition 630, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:19:00 TaskSetManager: INFO: Finished task 629.0 in stage 1.0 (TID 630) in 49004 ms on localhost (executor driver) (630/882) 2020-02-14 23:19:00 Executor: INFO: Running task 630.0 in stage 1.0 (TID 631) 2020-02-14 23:19:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21139292160+33554432 2020-02-14 23:19:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:19:53 Executor: INFO: Finished task 630.0 in stage 1.0 (TID 631). 1674 bytes result sent to driver 2020-02-14 23:19:53 TaskSetManager: INFO: Starting task 631.0 in stage 1.0 (TID 632, localhost, executor driver, partition 631, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:19:53 TaskSetManager: INFO: Finished task 630.0 in stage 1.0 (TID 631) in 52690 ms on localhost (executor driver) (631/882) 2020-02-14 23:19:53 Executor: INFO: Running task 631.0 in stage 1.0 (TID 632) 2020-02-14 23:19:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21172846592+33554432 2020-02-14 23:19:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:20:48 Executor: INFO: Finished task 631.0 in stage 1.0 (TID 632). 1625 bytes result sent to driver 2020-02-14 23:20:48 TaskSetManager: INFO: Starting task 632.0 in stage 1.0 (TID 633, localhost, executor driver, partition 632, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:20:48 TaskSetManager: INFO: Finished task 631.0 in stage 1.0 (TID 632) in 54937 ms on localhost (executor driver) (632/882) 2020-02-14 23:20:48 Executor: INFO: Running task 632.0 in stage 1.0 (TID 633) 2020-02-14 23:20:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21206401024+33554432 2020-02-14 23:20:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:21:54 Executor: INFO: Finished task 632.0 in stage 1.0 (TID 633). 1650 bytes result sent to driver 2020-02-14 23:21:54 TaskSetManager: INFO: Starting task 633.0 in stage 1.0 (TID 634, localhost, executor driver, partition 633, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:21:54 TaskSetManager: INFO: Finished task 632.0 in stage 1.0 (TID 633) in 66010 ms on localhost (executor driver) (633/882) 2020-02-14 23:21:54 Executor: INFO: Running task 633.0 in stage 1.0 (TID 634) 2020-02-14 23:21:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21239955456+33554432 2020-02-14 23:21:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:22:53 Executor: INFO: Finished task 633.0 in stage 1.0 (TID 634). 1624 bytes result sent to driver 2020-02-14 23:22:53 TaskSetManager: INFO: Starting task 634.0 in stage 1.0 (TID 635, localhost, executor driver, partition 634, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:22:53 TaskSetManager: INFO: Finished task 633.0 in stage 1.0 (TID 634) in 59225 ms on localhost (executor driver) (634/882) 2020-02-14 23:22:53 Executor: INFO: Running task 634.0 in stage 1.0 (TID 635) 2020-02-14 23:22:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21273509888+33554432 2020-02-14 23:22:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:23:49 Executor: INFO: Finished task 634.0 in stage 1.0 (TID 635). 1624 bytes result sent to driver 2020-02-14 23:23:49 TaskSetManager: INFO: Starting task 635.0 in stage 1.0 (TID 636, localhost, executor driver, partition 635, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:23:49 TaskSetManager: INFO: Finished task 634.0 in stage 1.0 (TID 635) in 56013 ms on localhost (executor driver) (635/882) 2020-02-14 23:23:49 Executor: INFO: Running task 635.0 in stage 1.0 (TID 636) 2020-02-14 23:23:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21307064320+33554432 2020-02-14 23:23:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:24:43 Executor: INFO: Finished task 635.0 in stage 1.0 (TID 636). 1625 bytes result sent to driver 2020-02-14 23:24:43 TaskSetManager: INFO: Starting task 636.0 in stage 1.0 (TID 637, localhost, executor driver, partition 636, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:24:43 TaskSetManager: INFO: Finished task 635.0 in stage 1.0 (TID 636) in 54132 ms on localhost (executor driver) (636/882) 2020-02-14 23:24:43 Executor: INFO: Running task 636.0 in stage 1.0 (TID 637) 2020-02-14 23:24:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21340618752+33554432 2020-02-14 23:24:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:25:43 Executor: INFO: Finished task 636.0 in stage 1.0 (TID 637). 1624 bytes result sent to driver 2020-02-14 23:25:43 TaskSetManager: INFO: Starting task 637.0 in stage 1.0 (TID 638, localhost, executor driver, partition 637, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:25:43 TaskSetManager: INFO: Finished task 636.0 in stage 1.0 (TID 637) in 59654 ms on localhost (executor driver) (637/882) 2020-02-14 23:25:43 Executor: INFO: Running task 637.0 in stage 1.0 (TID 638) 2020-02-14 23:25:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21374173184+33554432 2020-02-14 23:25:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:26:42 Executor: INFO: Finished task 637.0 in stage 1.0 (TID 638). 1690 bytes result sent to driver 2020-02-14 23:26:42 TaskSetManager: INFO: Starting task 638.0 in stage 1.0 (TID 639, localhost, executor driver, partition 638, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:26:42 TaskSetManager: INFO: Finished task 637.0 in stage 1.0 (TID 638) in 59158 ms on localhost (executor driver) (638/882) 2020-02-14 23:26:42 Executor: INFO: Running task 638.0 in stage 1.0 (TID 639) 2020-02-14 23:26:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21407727616+33554432 2020-02-14 23:26:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:27:43 Executor: INFO: Finished task 638.0 in stage 1.0 (TID 639). 1627 bytes result sent to driver 2020-02-14 23:27:43 TaskSetManager: INFO: Starting task 639.0 in stage 1.0 (TID 640, localhost, executor driver, partition 639, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:27:43 TaskSetManager: INFO: Finished task 638.0 in stage 1.0 (TID 639) in 60975 ms on localhost (executor driver) (639/882) 2020-02-14 23:27:43 Executor: INFO: Running task 639.0 in stage 1.0 (TID 640) 2020-02-14 23:27:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21441282048+33554432 2020-02-14 23:27:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:28:46 Executor: INFO: Finished task 639.0 in stage 1.0 (TID 640). 1624 bytes result sent to driver 2020-02-14 23:28:46 TaskSetManager: INFO: Starting task 640.0 in stage 1.0 (TID 641, localhost, executor driver, partition 640, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:28:46 TaskSetManager: INFO: Finished task 639.0 in stage 1.0 (TID 640) in 63016 ms on localhost (executor driver) (640/882) 2020-02-14 23:28:46 Executor: INFO: Running task 640.0 in stage 1.0 (TID 641) 2020-02-14 23:28:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21474836480+33554432 2020-02-14 23:28:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:29:36 Executor: INFO: Finished task 640.0 in stage 1.0 (TID 641). 1652 bytes result sent to driver 2020-02-14 23:29:36 TaskSetManager: INFO: Starting task 641.0 in stage 1.0 (TID 642, localhost, executor driver, partition 641, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:29:36 TaskSetManager: INFO: Finished task 640.0 in stage 1.0 (TID 641) in 49354 ms on localhost (executor driver) (641/882) 2020-02-14 23:29:36 Executor: INFO: Running task 641.0 in stage 1.0 (TID 642) 2020-02-14 23:29:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21508390912+33554432 2020-02-14 23:29:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:30:26 Executor: INFO: Finished task 641.0 in stage 1.0 (TID 642). 1739 bytes result sent to driver 2020-02-14 23:30:26 TaskSetManager: INFO: Starting task 642.0 in stage 1.0 (TID 643, localhost, executor driver, partition 642, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:30:26 TaskSetManager: INFO: Finished task 641.0 in stage 1.0 (TID 642) in 50417 ms on localhost (executor driver) (642/882) 2020-02-14 23:30:26 Executor: INFO: Running task 642.0 in stage 1.0 (TID 643) 2020-02-14 23:30:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21541945344+33554432 2020-02-14 23:30:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:31:13 Executor: INFO: Finished task 642.0 in stage 1.0 (TID 643). 1627 bytes result sent to driver 2020-02-14 23:31:13 TaskSetManager: INFO: Starting task 643.0 in stage 1.0 (TID 644, localhost, executor driver, partition 643, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:31:13 TaskSetManager: INFO: Finished task 642.0 in stage 1.0 (TID 643) in 46682 ms on localhost (executor driver) (643/882) 2020-02-14 23:31:13 Executor: INFO: Running task 643.0 in stage 1.0 (TID 644) 2020-02-14 23:31:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21575499776+33554432 2020-02-14 23:31:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:32:18 Executor: INFO: Finished task 643.0 in stage 1.0 (TID 644). 1667 bytes result sent to driver 2020-02-14 23:32:18 TaskSetManager: INFO: Starting task 644.0 in stage 1.0 (TID 645, localhost, executor driver, partition 644, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:32:18 TaskSetManager: INFO: Finished task 643.0 in stage 1.0 (TID 644) in 65010 ms on localhost (executor driver) (644/882) 2020-02-14 23:32:18 Executor: INFO: Running task 644.0 in stage 1.0 (TID 645) 2020-02-14 23:32:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21609054208+33554432 2020-02-14 23:32:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:33:18 Executor: INFO: Finished task 644.0 in stage 1.0 (TID 645). 1678 bytes result sent to driver 2020-02-14 23:33:18 TaskSetManager: INFO: Starting task 645.0 in stage 1.0 (TID 646, localhost, executor driver, partition 645, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:33:18 TaskSetManager: INFO: Finished task 644.0 in stage 1.0 (TID 645) in 59956 ms on localhost (executor driver) (645/882) 2020-02-14 23:33:18 Executor: INFO: Running task 645.0 in stage 1.0 (TID 646) 2020-02-14 23:33:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21642608640+33554432 2020-02-14 23:33:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:34:02 Executor: INFO: Finished task 645.0 in stage 1.0 (TID 646). 1632 bytes result sent to driver 2020-02-14 23:34:02 TaskSetManager: INFO: Starting task 646.0 in stage 1.0 (TID 647, localhost, executor driver, partition 646, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:34:02 TaskSetManager: INFO: Finished task 645.0 in stage 1.0 (TID 646) in 44166 ms on localhost (executor driver) (646/882) 2020-02-14 23:34:02 Executor: INFO: Running task 646.0 in stage 1.0 (TID 647) 2020-02-14 23:34:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21676163072+33554432 2020-02-14 23:34:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:35:05 Executor: INFO: Finished task 646.0 in stage 1.0 (TID 647). 1628 bytes result sent to driver 2020-02-14 23:35:05 TaskSetManager: INFO: Starting task 647.0 in stage 1.0 (TID 648, localhost, executor driver, partition 647, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:35:05 TaskSetManager: INFO: Finished task 646.0 in stage 1.0 (TID 647) in 63059 ms on localhost (executor driver) (647/882) 2020-02-14 23:35:05 Executor: INFO: Running task 647.0 in stage 1.0 (TID 648) 2020-02-14 23:35:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21709717504+33554432 2020-02-14 23:35:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:35:57 Executor: INFO: Finished task 647.0 in stage 1.0 (TID 648). 1655 bytes result sent to driver 2020-02-14 23:35:57 TaskSetManager: INFO: Starting task 648.0 in stage 1.0 (TID 649, localhost, executor driver, partition 648, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:35:57 TaskSetManager: INFO: Finished task 647.0 in stage 1.0 (TID 648) in 52502 ms on localhost (executor driver) (648/882) 2020-02-14 23:35:57 Executor: INFO: Running task 648.0 in stage 1.0 (TID 649) 2020-02-14 23:35:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21743271936+33554432 2020-02-14 23:35:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:36:52 Executor: INFO: Finished task 648.0 in stage 1.0 (TID 649). 1626 bytes result sent to driver 2020-02-14 23:36:52 TaskSetManager: INFO: Starting task 649.0 in stage 1.0 (TID 650, localhost, executor driver, partition 649, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:36:52 TaskSetManager: INFO: Finished task 648.0 in stage 1.0 (TID 649) in 54986 ms on localhost (executor driver) (649/882) 2020-02-14 23:36:52 Executor: INFO: Running task 649.0 in stage 1.0 (TID 650) 2020-02-14 23:36:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21776826368+33554432 2020-02-14 23:36:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:37:50 Executor: INFO: Finished task 649.0 in stage 1.0 (TID 650). 1627 bytes result sent to driver 2020-02-14 23:37:50 TaskSetManager: INFO: Starting task 650.0 in stage 1.0 (TID 651, localhost, executor driver, partition 650, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:37:50 TaskSetManager: INFO: Finished task 649.0 in stage 1.0 (TID 650) in 58072 ms on localhost (executor driver) (650/882) 2020-02-14 23:37:50 Executor: INFO: Running task 650.0 in stage 1.0 (TID 651) 2020-02-14 23:37:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21810380800+33554432 2020-02-14 23:37:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:38:46 Executor: INFO: Finished task 650.0 in stage 1.0 (TID 651). 1651 bytes result sent to driver 2020-02-14 23:38:46 TaskSetManager: INFO: Starting task 651.0 in stage 1.0 (TID 652, localhost, executor driver, partition 651, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:38:46 TaskSetManager: INFO: Finished task 650.0 in stage 1.0 (TID 651) in 55473 ms on localhost (executor driver) (651/882) 2020-02-14 23:38:46 Executor: INFO: Running task 651.0 in stage 1.0 (TID 652) 2020-02-14 23:38:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21843935232+33554432 2020-02-14 23:38:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:39:38 Executor: INFO: Finished task 651.0 in stage 1.0 (TID 652). 1750 bytes result sent to driver 2020-02-14 23:39:38 TaskSetManager: INFO: Starting task 652.0 in stage 1.0 (TID 653, localhost, executor driver, partition 652, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:39:38 TaskSetManager: INFO: Finished task 651.0 in stage 1.0 (TID 652) in 52324 ms on localhost (executor driver) (652/882) 2020-02-14 23:39:38 Executor: INFO: Running task 652.0 in stage 1.0 (TID 653) 2020-02-14 23:39:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21877489664+33554432 2020-02-14 23:39:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:40:32 Executor: INFO: Finished task 652.0 in stage 1.0 (TID 653). 1685 bytes result sent to driver 2020-02-14 23:40:32 TaskSetManager: INFO: Starting task 653.0 in stage 1.0 (TID 654, localhost, executor driver, partition 653, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:40:32 TaskSetManager: INFO: Finished task 652.0 in stage 1.0 (TID 653) in 53514 ms on localhost (executor driver) (653/882) 2020-02-14 23:40:32 Executor: INFO: Running task 653.0 in stage 1.0 (TID 654) 2020-02-14 23:40:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21911044096+33554432 2020-02-14 23:40:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:41:25 Executor: INFO: Finished task 653.0 in stage 1.0 (TID 654). 1625 bytes result sent to driver 2020-02-14 23:41:25 TaskSetManager: INFO: Starting task 654.0 in stage 1.0 (TID 655, localhost, executor driver, partition 654, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:41:25 TaskSetManager: INFO: Finished task 653.0 in stage 1.0 (TID 654) in 53059 ms on localhost (executor driver) (654/882) 2020-02-14 23:41:25 Executor: INFO: Running task 654.0 in stage 1.0 (TID 655) 2020-02-14 23:41:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21944598528+33554432 2020-02-14 23:41:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:42:21 Executor: INFO: Finished task 654.0 in stage 1.0 (TID 655). 1624 bytes result sent to driver 2020-02-14 23:42:21 TaskSetManager: INFO: Starting task 655.0 in stage 1.0 (TID 656, localhost, executor driver, partition 655, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:42:21 TaskSetManager: INFO: Finished task 654.0 in stage 1.0 (TID 655) in 55935 ms on localhost (executor driver) (655/882) 2020-02-14 23:42:21 Executor: INFO: Running task 655.0 in stage 1.0 (TID 656) 2020-02-14 23:42:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:21978152960+33554432 2020-02-14 23:42:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:43:15 Executor: INFO: Finished task 655.0 in stage 1.0 (TID 656). 1668 bytes result sent to driver 2020-02-14 23:43:15 TaskSetManager: INFO: Starting task 656.0 in stage 1.0 (TID 657, localhost, executor driver, partition 656, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:43:15 TaskSetManager: INFO: Finished task 655.0 in stage 1.0 (TID 656) in 54571 ms on localhost (executor driver) (656/882) 2020-02-14 23:43:15 Executor: INFO: Running task 656.0 in stage 1.0 (TID 657) 2020-02-14 23:43:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22011707392+33554432 2020-02-14 23:43:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:44:10 Executor: INFO: Finished task 656.0 in stage 1.0 (TID 657). 1624 bytes result sent to driver 2020-02-14 23:44:10 TaskSetManager: INFO: Starting task 657.0 in stage 1.0 (TID 658, localhost, executor driver, partition 657, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:44:10 TaskSetManager: INFO: Finished task 656.0 in stage 1.0 (TID 657) in 54952 ms on localhost (executor driver) (657/882) 2020-02-14 23:44:10 Executor: INFO: Running task 657.0 in stage 1.0 (TID 658) 2020-02-14 23:44:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22045261824+33554432 2020-02-14 23:44:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:45:11 Executor: INFO: Finished task 657.0 in stage 1.0 (TID 658). 1624 bytes result sent to driver 2020-02-14 23:45:11 TaskSetManager: INFO: Starting task 658.0 in stage 1.0 (TID 659, localhost, executor driver, partition 658, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:45:11 TaskSetManager: INFO: Finished task 657.0 in stage 1.0 (TID 658) in 60879 ms on localhost (executor driver) (658/882) 2020-02-14 23:45:11 Executor: INFO: Running task 658.0 in stage 1.0 (TID 659) 2020-02-14 23:45:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22078816256+33554432 2020-02-14 23:45:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:46:08 Executor: INFO: Finished task 658.0 in stage 1.0 (TID 659). 1630 bytes result sent to driver 2020-02-14 23:46:08 TaskSetManager: INFO: Starting task 659.0 in stage 1.0 (TID 660, localhost, executor driver, partition 659, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:46:08 TaskSetManager: INFO: Finished task 658.0 in stage 1.0 (TID 659) in 57235 ms on localhost (executor driver) (659/882) 2020-02-14 23:46:08 Executor: INFO: Running task 659.0 in stage 1.0 (TID 660) 2020-02-14 23:46:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22112370688+33554432 2020-02-14 23:46:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:47:00 Executor: INFO: Finished task 659.0 in stage 1.0 (TID 660). 1667 bytes result sent to driver 2020-02-14 23:47:00 TaskSetManager: INFO: Starting task 660.0 in stage 1.0 (TID 661, localhost, executor driver, partition 660, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:47:00 TaskSetManager: INFO: Finished task 659.0 in stage 1.0 (TID 660) in 51657 ms on localhost (executor driver) (660/882) 2020-02-14 23:47:00 Executor: INFO: Running task 660.0 in stage 1.0 (TID 661) 2020-02-14 23:47:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22145925120+33554432 2020-02-14 23:47:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:47:54 Executor: INFO: Finished task 660.0 in stage 1.0 (TID 661). 1679 bytes result sent to driver 2020-02-14 23:47:54 TaskSetManager: INFO: Starting task 661.0 in stage 1.0 (TID 662, localhost, executor driver, partition 661, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:47:54 TaskSetManager: INFO: Finished task 660.0 in stage 1.0 (TID 661) in 54035 ms on localhost (executor driver) (661/882) 2020-02-14 23:47:54 Executor: INFO: Running task 661.0 in stage 1.0 (TID 662) 2020-02-14 23:47:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22179479552+33554432 2020-02-14 23:47:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:48:52 Executor: INFO: Finished task 661.0 in stage 1.0 (TID 662). 1701 bytes result sent to driver 2020-02-14 23:48:52 TaskSetManager: INFO: Starting task 662.0 in stage 1.0 (TID 663, localhost, executor driver, partition 662, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:48:52 TaskSetManager: INFO: Finished task 661.0 in stage 1.0 (TID 662) in 57595 ms on localhost (executor driver) (662/882) 2020-02-14 23:48:52 Executor: INFO: Running task 662.0 in stage 1.0 (TID 663) 2020-02-14 23:48:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22213033984+33554432 2020-02-14 23:48:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:49:49 Executor: INFO: Finished task 662.0 in stage 1.0 (TID 663). 1624 bytes result sent to driver 2020-02-14 23:49:49 TaskSetManager: INFO: Starting task 663.0 in stage 1.0 (TID 664, localhost, executor driver, partition 663, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:49:49 TaskSetManager: INFO: Finished task 662.0 in stage 1.0 (TID 663) in 57668 ms on localhost (executor driver) (663/882) 2020-02-14 23:49:49 Executor: INFO: Running task 663.0 in stage 1.0 (TID 664) 2020-02-14 23:49:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22246588416+33554432 2020-02-14 23:49:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:50:46 Executor: INFO: Finished task 663.0 in stage 1.0 (TID 664). 1627 bytes result sent to driver 2020-02-14 23:50:46 TaskSetManager: INFO: Starting task 664.0 in stage 1.0 (TID 665, localhost, executor driver, partition 664, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:50:46 TaskSetManager: INFO: Finished task 663.0 in stage 1.0 (TID 664) in 56911 ms on localhost (executor driver) (664/882) 2020-02-14 23:50:46 Executor: INFO: Running task 664.0 in stage 1.0 (TID 665) 2020-02-14 23:50:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22280142848+33554432 2020-02-14 23:50:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:51:46 Executor: INFO: Finished task 664.0 in stage 1.0 (TID 665). 1624 bytes result sent to driver 2020-02-14 23:51:46 TaskSetManager: INFO: Starting task 665.0 in stage 1.0 (TID 666, localhost, executor driver, partition 665, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:51:46 TaskSetManager: INFO: Finished task 664.0 in stage 1.0 (TID 665) in 59819 ms on localhost (executor driver) (665/882) 2020-02-14 23:51:46 Executor: INFO: Running task 665.0 in stage 1.0 (TID 666) 2020-02-14 23:51:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22313697280+33554432 2020-02-14 23:51:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:52:38 Executor: INFO: Finished task 665.0 in stage 1.0 (TID 666). 1625 bytes result sent to driver 2020-02-14 23:52:38 TaskSetManager: INFO: Starting task 666.0 in stage 1.0 (TID 667, localhost, executor driver, partition 666, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:52:38 TaskSetManager: INFO: Finished task 665.0 in stage 1.0 (TID 666) in 51757 ms on localhost (executor driver) (666/882) 2020-02-14 23:52:38 Executor: INFO: Running task 666.0 in stage 1.0 (TID 667) 2020-02-14 23:52:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22347251712+33554432 2020-02-14 23:52:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:53:35 Executor: INFO: Finished task 666.0 in stage 1.0 (TID 667). 1657 bytes result sent to driver 2020-02-14 23:53:35 TaskSetManager: INFO: Starting task 667.0 in stage 1.0 (TID 668, localhost, executor driver, partition 667, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:53:35 TaskSetManager: INFO: Finished task 666.0 in stage 1.0 (TID 667) in 57074 ms on localhost (executor driver) (667/882) 2020-02-14 23:53:35 Executor: INFO: Running task 667.0 in stage 1.0 (TID 668) 2020-02-14 23:53:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22380806144+33554432 2020-02-14 23:53:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:54:34 Executor: INFO: Finished task 667.0 in stage 1.0 (TID 668). 1630 bytes result sent to driver 2020-02-14 23:54:34 TaskSetManager: INFO: Starting task 668.0 in stage 1.0 (TID 669, localhost, executor driver, partition 668, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:54:34 TaskSetManager: INFO: Finished task 667.0 in stage 1.0 (TID 668) in 59642 ms on localhost (executor driver) (668/882) 2020-02-14 23:54:34 Executor: INFO: Running task 668.0 in stage 1.0 (TID 669) 2020-02-14 23:54:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22414360576+33554432 2020-02-14 23:54:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:55:28 Executor: INFO: Finished task 668.0 in stage 1.0 (TID 669). 1624 bytes result sent to driver 2020-02-14 23:55:28 TaskSetManager: INFO: Starting task 669.0 in stage 1.0 (TID 670, localhost, executor driver, partition 669, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:55:28 TaskSetManager: INFO: Finished task 668.0 in stage 1.0 (TID 669) in 53132 ms on localhost (executor driver) (669/882) 2020-02-14 23:55:28 Executor: INFO: Running task 669.0 in stage 1.0 (TID 670) 2020-02-14 23:55:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22447915008+33554432 2020-02-14 23:55:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:56:15 Executor: INFO: Finished task 669.0 in stage 1.0 (TID 670). 1652 bytes result sent to driver 2020-02-14 23:56:15 TaskSetManager: INFO: Starting task 670.0 in stage 1.0 (TID 671, localhost, executor driver, partition 670, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:56:15 TaskSetManager: INFO: Finished task 669.0 in stage 1.0 (TID 670) in 47285 ms on localhost (executor driver) (670/882) 2020-02-14 23:56:15 Executor: INFO: Running task 670.0 in stage 1.0 (TID 671) 2020-02-14 23:56:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22481469440+33554432 2020-02-14 23:56:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:57:11 Executor: INFO: Finished task 670.0 in stage 1.0 (TID 671). 1624 bytes result sent to driver 2020-02-14 23:57:11 TaskSetManager: INFO: Starting task 671.0 in stage 1.0 (TID 672, localhost, executor driver, partition 671, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:57:11 TaskSetManager: INFO: Finished task 670.0 in stage 1.0 (TID 671) in 55991 ms on localhost (executor driver) (671/882) 2020-02-14 23:57:11 Executor: INFO: Running task 671.0 in stage 1.0 (TID 672) 2020-02-14 23:57:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22515023872+33554432 2020-02-14 23:57:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:58:04 Executor: INFO: Finished task 671.0 in stage 1.0 (TID 672). 1627 bytes result sent to driver 2020-02-14 23:58:04 TaskSetManager: INFO: Starting task 672.0 in stage 1.0 (TID 673, localhost, executor driver, partition 672, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:58:04 TaskSetManager: INFO: Finished task 671.0 in stage 1.0 (TID 672) in 52893 ms on localhost (executor driver) (672/882) 2020-02-14 23:58:04 Executor: INFO: Running task 672.0 in stage 1.0 (TID 673) 2020-02-14 23:58:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22548578304+33554432 2020-02-14 23:58:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:58:49 Executor: INFO: Finished task 672.0 in stage 1.0 (TID 673). 1738 bytes result sent to driver 2020-02-14 23:58:49 TaskSetManager: INFO: Starting task 673.0 in stage 1.0 (TID 674, localhost, executor driver, partition 673, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:58:49 TaskSetManager: INFO: Finished task 672.0 in stage 1.0 (TID 673) in 44853 ms on localhost (executor driver) (673/882) 2020-02-14 23:58:49 Executor: INFO: Running task 673.0 in stage 1.0 (TID 674) 2020-02-14 23:58:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22582132736+33554432 2020-02-14 23:58:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-14 23:59:47 Executor: INFO: Finished task 673.0 in stage 1.0 (TID 674). 1624 bytes result sent to driver 2020-02-14 23:59:47 TaskSetManager: INFO: Starting task 674.0 in stage 1.0 (TID 675, localhost, executor driver, partition 674, PROCESS_LOCAL, 7933 bytes) 2020-02-14 23:59:47 TaskSetManager: INFO: Finished task 673.0 in stage 1.0 (TID 674) in 58401 ms on localhost (executor driver) (674/882) 2020-02-14 23:59:47 Executor: INFO: Running task 674.0 in stage 1.0 (TID 675) 2020-02-14 23:59:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22615687168+33554432 2020-02-14 23:59:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:00:42 Executor: INFO: Finished task 674.0 in stage 1.0 (TID 675). 1624 bytes result sent to driver 2020-02-15 00:00:42 TaskSetManager: INFO: Starting task 675.0 in stage 1.0 (TID 676, localhost, executor driver, partition 675, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:00:42 TaskSetManager: INFO: Finished task 674.0 in stage 1.0 (TID 675) in 54678 ms on localhost (executor driver) (675/882) 2020-02-15 00:00:42 Executor: INFO: Running task 675.0 in stage 1.0 (TID 676) 2020-02-15 00:00:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22649241600+33554432 2020-02-15 00:00:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:01:39 Executor: INFO: Finished task 675.0 in stage 1.0 (TID 676). 1624 bytes result sent to driver 2020-02-15 00:01:39 TaskSetManager: INFO: Starting task 676.0 in stage 1.0 (TID 677, localhost, executor driver, partition 676, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:01:39 TaskSetManager: INFO: Finished task 675.0 in stage 1.0 (TID 676) in 57086 ms on localhost (executor driver) (676/882) 2020-02-15 00:01:39 Executor: INFO: Running task 676.0 in stage 1.0 (TID 677) 2020-02-15 00:01:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22682796032+33554432 2020-02-15 00:01:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:02:40 Executor: INFO: Finished task 676.0 in stage 1.0 (TID 677). 1627 bytes result sent to driver 2020-02-15 00:02:40 TaskSetManager: INFO: Starting task 677.0 in stage 1.0 (TID 678, localhost, executor driver, partition 677, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:02:40 TaskSetManager: INFO: Finished task 676.0 in stage 1.0 (TID 677) in 60804 ms on localhost (executor driver) (677/882) 2020-02-15 00:02:40 Executor: INFO: Running task 677.0 in stage 1.0 (TID 678) 2020-02-15 00:02:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22716350464+33554432 2020-02-15 00:02:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:03:37 Executor: INFO: Finished task 677.0 in stage 1.0 (TID 678). 1624 bytes result sent to driver 2020-02-15 00:03:37 TaskSetManager: INFO: Starting task 678.0 in stage 1.0 (TID 679, localhost, executor driver, partition 678, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:03:37 TaskSetManager: INFO: Finished task 677.0 in stage 1.0 (TID 678) in 57424 ms on localhost (executor driver) (678/882) 2020-02-15 00:03:37 Executor: INFO: Running task 678.0 in stage 1.0 (TID 679) 2020-02-15 00:03:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22749904896+33554432 2020-02-15 00:03:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:04:39 Executor: INFO: Finished task 678.0 in stage 1.0 (TID 679). 1626 bytes result sent to driver 2020-02-15 00:04:39 TaskSetManager: INFO: Starting task 679.0 in stage 1.0 (TID 680, localhost, executor driver, partition 679, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:04:39 TaskSetManager: INFO: Finished task 678.0 in stage 1.0 (TID 679) in 61671 ms on localhost (executor driver) (679/882) 2020-02-15 00:04:39 Executor: INFO: Running task 679.0 in stage 1.0 (TID 680) 2020-02-15 00:04:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22783459328+33554432 2020-02-15 00:04:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:05:38 Executor: INFO: Finished task 679.0 in stage 1.0 (TID 680). 1624 bytes result sent to driver 2020-02-15 00:05:38 TaskSetManager: INFO: Starting task 680.0 in stage 1.0 (TID 681, localhost, executor driver, partition 680, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:05:38 TaskSetManager: INFO: Finished task 679.0 in stage 1.0 (TID 680) in 59686 ms on localhost (executor driver) (680/882) 2020-02-15 00:05:38 Executor: INFO: Running task 680.0 in stage 1.0 (TID 681) 2020-02-15 00:05:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22817013760+33554432 2020-02-15 00:05:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:06:37 Executor: INFO: Finished task 680.0 in stage 1.0 (TID 681). 1624 bytes result sent to driver 2020-02-15 00:06:37 TaskSetManager: INFO: Starting task 681.0 in stage 1.0 (TID 682, localhost, executor driver, partition 681, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:06:37 TaskSetManager: INFO: Finished task 680.0 in stage 1.0 (TID 681) in 58742 ms on localhost (executor driver) (681/882) 2020-02-15 00:06:37 Executor: INFO: Running task 681.0 in stage 1.0 (TID 682) 2020-02-15 00:06:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22850568192+33554432 2020-02-15 00:06:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:06:46 Executor: INFO: Finished task 681.0 in stage 1.0 (TID 682). 1623 bytes result sent to driver 2020-02-15 00:06:46 TaskSetManager: INFO: Starting task 682.0 in stage 1.0 (TID 683, localhost, executor driver, partition 682, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:06:46 TaskSetManager: INFO: Finished task 681.0 in stage 1.0 (TID 682) in 9364 ms on localhost (executor driver) (682/882) 2020-02-15 00:06:46 Executor: INFO: Running task 682.0 in stage 1.0 (TID 683) 2020-02-15 00:06:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22884122624+33554432 2020-02-15 00:06:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:07:08 Executor: INFO: Finished task 682.0 in stage 1.0 (TID 683). 1624 bytes result sent to driver 2020-02-15 00:07:08 TaskSetManager: INFO: Starting task 683.0 in stage 1.0 (TID 684, localhost, executor driver, partition 683, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:07:08 TaskSetManager: INFO: Finished task 682.0 in stage 1.0 (TID 683) in 21457 ms on localhost (executor driver) (683/882) 2020-02-15 00:07:08 Executor: INFO: Running task 683.0 in stage 1.0 (TID 684) 2020-02-15 00:07:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22917677056+33554432 2020-02-15 00:07:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:08:10 Executor: INFO: Finished task 683.0 in stage 1.0 (TID 684). 1624 bytes result sent to driver 2020-02-15 00:08:10 TaskSetManager: INFO: Starting task 684.0 in stage 1.0 (TID 685, localhost, executor driver, partition 684, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:08:10 TaskSetManager: INFO: Finished task 683.0 in stage 1.0 (TID 684) in 61914 ms on localhost (executor driver) (684/882) 2020-02-15 00:08:10 Executor: INFO: Running task 684.0 in stage 1.0 (TID 685) 2020-02-15 00:08:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22951231488+33554432 2020-02-15 00:08:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:09:07 Executor: INFO: Finished task 684.0 in stage 1.0 (TID 685). 1624 bytes result sent to driver 2020-02-15 00:09:07 TaskSetManager: INFO: Starting task 685.0 in stage 1.0 (TID 686, localhost, executor driver, partition 685, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:09:07 TaskSetManager: INFO: Finished task 684.0 in stage 1.0 (TID 685) in 57465 ms on localhost (executor driver) (685/882) 2020-02-15 00:09:07 Executor: INFO: Running task 685.0 in stage 1.0 (TID 686) 2020-02-15 00:09:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:22984785920+33554432 2020-02-15 00:09:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:10:02 Executor: INFO: Finished task 685.0 in stage 1.0 (TID 686). 1688 bytes result sent to driver 2020-02-15 00:10:02 TaskSetManager: INFO: Starting task 686.0 in stage 1.0 (TID 687, localhost, executor driver, partition 686, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:10:02 TaskSetManager: INFO: Finished task 685.0 in stage 1.0 (TID 686) in 54830 ms on localhost (executor driver) (686/882) 2020-02-15 00:10:02 Executor: INFO: Running task 686.0 in stage 1.0 (TID 687) 2020-02-15 00:10:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23018340352+33554432 2020-02-15 00:10:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:11:02 Executor: INFO: Finished task 686.0 in stage 1.0 (TID 687). 1634 bytes result sent to driver 2020-02-15 00:11:02 TaskSetManager: INFO: Starting task 687.0 in stage 1.0 (TID 688, localhost, executor driver, partition 687, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:11:02 TaskSetManager: INFO: Finished task 686.0 in stage 1.0 (TID 687) in 60337 ms on localhost (executor driver) (687/882) 2020-02-15 00:11:02 Executor: INFO: Running task 687.0 in stage 1.0 (TID 688) 2020-02-15 00:11:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23051894784+33554432 2020-02-15 00:11:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:12:01 Executor: INFO: Finished task 687.0 in stage 1.0 (TID 688). 1624 bytes result sent to driver 2020-02-15 00:12:01 TaskSetManager: INFO: Starting task 688.0 in stage 1.0 (TID 689, localhost, executor driver, partition 688, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:12:01 TaskSetManager: INFO: Finished task 687.0 in stage 1.0 (TID 688) in 58373 ms on localhost (executor driver) (688/882) 2020-02-15 00:12:01 Executor: INFO: Running task 688.0 in stage 1.0 (TID 689) 2020-02-15 00:12:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23085449216+33554432 2020-02-15 00:12:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:12:57 Executor: INFO: Finished task 688.0 in stage 1.0 (TID 689). 1676 bytes result sent to driver 2020-02-15 00:12:57 TaskSetManager: INFO: Starting task 689.0 in stage 1.0 (TID 690, localhost, executor driver, partition 689, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:12:57 TaskSetManager: INFO: Finished task 688.0 in stage 1.0 (TID 689) in 56217 ms on localhost (executor driver) (689/882) 2020-02-15 00:12:57 Executor: INFO: Running task 689.0 in stage 1.0 (TID 690) 2020-02-15 00:12:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23119003648+33554432 2020-02-15 00:12:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:13:55 Executor: INFO: Finished task 689.0 in stage 1.0 (TID 690). 1624 bytes result sent to driver 2020-02-15 00:13:55 TaskSetManager: INFO: Starting task 690.0 in stage 1.0 (TID 691, localhost, executor driver, partition 690, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:13:55 TaskSetManager: INFO: Finished task 689.0 in stage 1.0 (TID 690) in 58416 ms on localhost (executor driver) (690/882) 2020-02-15 00:13:55 Executor: INFO: Running task 690.0 in stage 1.0 (TID 691) 2020-02-15 00:13:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23152558080+33554432 2020-02-15 00:13:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:14:52 Executor: INFO: Finished task 690.0 in stage 1.0 (TID 691). 1672 bytes result sent to driver 2020-02-15 00:14:52 TaskSetManager: INFO: Starting task 691.0 in stage 1.0 (TID 692, localhost, executor driver, partition 691, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:14:52 TaskSetManager: INFO: Finished task 690.0 in stage 1.0 (TID 691) in 56328 ms on localhost (executor driver) (691/882) 2020-02-15 00:14:52 Executor: INFO: Running task 691.0 in stage 1.0 (TID 692) 2020-02-15 00:14:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23186112512+33554432 2020-02-15 00:14:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:15:48 Executor: INFO: Finished task 691.0 in stage 1.0 (TID 692). 1705 bytes result sent to driver 2020-02-15 00:15:48 TaskSetManager: INFO: Starting task 692.0 in stage 1.0 (TID 693, localhost, executor driver, partition 692, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:15:48 TaskSetManager: INFO: Finished task 691.0 in stage 1.0 (TID 692) in 56026 ms on localhost (executor driver) (692/882) 2020-02-15 00:15:48 Executor: INFO: Running task 692.0 in stage 1.0 (TID 693) 2020-02-15 00:15:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23219666944+33554432 2020-02-15 00:15:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:16:44 Executor: INFO: Finished task 692.0 in stage 1.0 (TID 693). 1624 bytes result sent to driver 2020-02-15 00:16:44 TaskSetManager: INFO: Starting task 693.0 in stage 1.0 (TID 694, localhost, executor driver, partition 693, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:16:44 TaskSetManager: INFO: Finished task 692.0 in stage 1.0 (TID 693) in 55768 ms on localhost (executor driver) (693/882) 2020-02-15 00:16:44 Executor: INFO: Running task 693.0 in stage 1.0 (TID 694) 2020-02-15 00:16:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23253221376+33554432 2020-02-15 00:16:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:17:30 Executor: INFO: Finished task 693.0 in stage 1.0 (TID 694). 1624 bytes result sent to driver 2020-02-15 00:17:30 TaskSetManager: INFO: Starting task 694.0 in stage 1.0 (TID 695, localhost, executor driver, partition 694, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:17:30 TaskSetManager: INFO: Finished task 693.0 in stage 1.0 (TID 694) in 46712 ms on localhost (executor driver) (694/882) 2020-02-15 00:17:30 Executor: INFO: Running task 694.0 in stage 1.0 (TID 695) 2020-02-15 00:17:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23286775808+33554432 2020-02-15 00:17:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:18:20 Executor: INFO: Finished task 694.0 in stage 1.0 (TID 695). 1624 bytes result sent to driver 2020-02-15 00:18:20 TaskSetManager: INFO: Starting task 695.0 in stage 1.0 (TID 696, localhost, executor driver, partition 695, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:18:20 TaskSetManager: INFO: Finished task 694.0 in stage 1.0 (TID 695) in 49244 ms on localhost (executor driver) (695/882) 2020-02-15 00:18:20 Executor: INFO: Running task 695.0 in stage 1.0 (TID 696) 2020-02-15 00:18:20 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23320330240+33554432 2020-02-15 00:18:20 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:19:03 Executor: INFO: Finished task 695.0 in stage 1.0 (TID 696). 1624 bytes result sent to driver 2020-02-15 00:19:03 TaskSetManager: INFO: Starting task 696.0 in stage 1.0 (TID 697, localhost, executor driver, partition 696, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:19:03 TaskSetManager: INFO: Finished task 695.0 in stage 1.0 (TID 696) in 43038 ms on localhost (executor driver) (696/882) 2020-02-15 00:19:03 Executor: INFO: Running task 696.0 in stage 1.0 (TID 697) 2020-02-15 00:19:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23353884672+33554432 2020-02-15 00:19:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:19:42 Executor: INFO: Finished task 696.0 in stage 1.0 (TID 697). 1626 bytes result sent to driver 2020-02-15 00:19:42 TaskSetManager: INFO: Starting task 697.0 in stage 1.0 (TID 698, localhost, executor driver, partition 697, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:19:42 TaskSetManager: INFO: Finished task 696.0 in stage 1.0 (TID 697) in 39630 ms on localhost (executor driver) (697/882) 2020-02-15 00:19:42 Executor: INFO: Running task 697.0 in stage 1.0 (TID 698) 2020-02-15 00:19:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23387439104+33554432 2020-02-15 00:19:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:20:35 Executor: INFO: Finished task 697.0 in stage 1.0 (TID 698). 1624 bytes result sent to driver 2020-02-15 00:20:35 TaskSetManager: INFO: Starting task 698.0 in stage 1.0 (TID 699, localhost, executor driver, partition 698, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:20:35 TaskSetManager: INFO: Finished task 697.0 in stage 1.0 (TID 698) in 52832 ms on localhost (executor driver) (698/882) 2020-02-15 00:20:35 Executor: INFO: Running task 698.0 in stage 1.0 (TID 699) 2020-02-15 00:20:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23420993536+33554432 2020-02-15 00:20:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:21:33 Executor: INFO: Finished task 698.0 in stage 1.0 (TID 699). 1638 bytes result sent to driver 2020-02-15 00:21:33 TaskSetManager: INFO: Starting task 699.0 in stage 1.0 (TID 700, localhost, executor driver, partition 699, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:21:33 TaskSetManager: INFO: Finished task 698.0 in stage 1.0 (TID 699) in 58214 ms on localhost (executor driver) (699/882) 2020-02-15 00:21:33 Executor: INFO: Running task 699.0 in stage 1.0 (TID 700) 2020-02-15 00:21:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23454547968+33554432 2020-02-15 00:21:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:22:41 Executor: INFO: Finished task 699.0 in stage 1.0 (TID 700). 1624 bytes result sent to driver 2020-02-15 00:22:41 TaskSetManager: INFO: Starting task 700.0 in stage 1.0 (TID 701, localhost, executor driver, partition 700, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:22:41 TaskSetManager: INFO: Finished task 699.0 in stage 1.0 (TID 700) in 67735 ms on localhost (executor driver) (700/882) 2020-02-15 00:22:41 Executor: INFO: Running task 700.0 in stage 1.0 (TID 701) 2020-02-15 00:22:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23488102400+33554432 2020-02-15 00:22:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:23:36 Executor: INFO: Finished task 700.0 in stage 1.0 (TID 701). 1638 bytes result sent to driver 2020-02-15 00:23:36 TaskSetManager: INFO: Starting task 701.0 in stage 1.0 (TID 702, localhost, executor driver, partition 701, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:23:36 TaskSetManager: INFO: Finished task 700.0 in stage 1.0 (TID 701) in 54985 ms on localhost (executor driver) (701/882) 2020-02-15 00:23:36 Executor: INFO: Running task 701.0 in stage 1.0 (TID 702) 2020-02-15 00:23:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23521656832+33554432 2020-02-15 00:23:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:24:19 Executor: INFO: Finished task 701.0 in stage 1.0 (TID 702). 1698 bytes result sent to driver 2020-02-15 00:24:19 TaskSetManager: INFO: Starting task 702.0 in stage 1.0 (TID 703, localhost, executor driver, partition 702, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:24:19 TaskSetManager: INFO: Finished task 701.0 in stage 1.0 (TID 702) in 42646 ms on localhost (executor driver) (702/882) 2020-02-15 00:24:19 Executor: INFO: Running task 702.0 in stage 1.0 (TID 703) 2020-02-15 00:24:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23555211264+33554432 2020-02-15 00:24:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:25:09 Executor: INFO: Finished task 702.0 in stage 1.0 (TID 703). 1652 bytes result sent to driver 2020-02-15 00:25:09 TaskSetManager: INFO: Starting task 703.0 in stage 1.0 (TID 704, localhost, executor driver, partition 703, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:25:09 TaskSetManager: INFO: Finished task 702.0 in stage 1.0 (TID 703) in 49924 ms on localhost (executor driver) (703/882) 2020-02-15 00:25:09 Executor: INFO: Running task 703.0 in stage 1.0 (TID 704) 2020-02-15 00:25:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23588765696+33554432 2020-02-15 00:25:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:26:03 Executor: INFO: Finished task 703.0 in stage 1.0 (TID 704). 1635 bytes result sent to driver 2020-02-15 00:26:03 TaskSetManager: INFO: Starting task 704.0 in stage 1.0 (TID 705, localhost, executor driver, partition 704, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:26:03 TaskSetManager: INFO: Finished task 703.0 in stage 1.0 (TID 704) in 54348 ms on localhost (executor driver) (704/882) 2020-02-15 00:26:03 Executor: INFO: Running task 704.0 in stage 1.0 (TID 705) 2020-02-15 00:26:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23622320128+33554432 2020-02-15 00:26:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:26:54 Executor: INFO: Finished task 704.0 in stage 1.0 (TID 705). 1625 bytes result sent to driver 2020-02-15 00:26:54 TaskSetManager: INFO: Starting task 705.0 in stage 1.0 (TID 706, localhost, executor driver, partition 705, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:26:54 TaskSetManager: INFO: Finished task 704.0 in stage 1.0 (TID 705) in 51549 ms on localhost (executor driver) (705/882) 2020-02-15 00:26:54 Executor: INFO: Running task 705.0 in stage 1.0 (TID 706) 2020-02-15 00:26:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23655874560+33554432 2020-02-15 00:26:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:27:38 Executor: INFO: Finished task 705.0 in stage 1.0 (TID 706). 1624 bytes result sent to driver 2020-02-15 00:27:38 TaskSetManager: INFO: Starting task 706.0 in stage 1.0 (TID 707, localhost, executor driver, partition 706, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:27:38 TaskSetManager: INFO: Finished task 705.0 in stage 1.0 (TID 706) in 43621 ms on localhost (executor driver) (706/882) 2020-02-15 00:27:38 Executor: INFO: Running task 706.0 in stage 1.0 (TID 707) 2020-02-15 00:27:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23689428992+33554432 2020-02-15 00:27:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:28:39 Executor: INFO: Finished task 706.0 in stage 1.0 (TID 707). 1626 bytes result sent to driver 2020-02-15 00:28:39 TaskSetManager: INFO: Starting task 707.0 in stage 1.0 (TID 708, localhost, executor driver, partition 707, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:28:39 TaskSetManager: INFO: Finished task 706.0 in stage 1.0 (TID 707) in 61312 ms on localhost (executor driver) (707/882) 2020-02-15 00:28:39 Executor: INFO: Running task 707.0 in stage 1.0 (TID 708) 2020-02-15 00:28:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23722983424+33554432 2020-02-15 00:28:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:29:30 Executor: INFO: Finished task 707.0 in stage 1.0 (TID 708). 1624 bytes result sent to driver 2020-02-15 00:29:30 TaskSetManager: INFO: Starting task 708.0 in stage 1.0 (TID 709, localhost, executor driver, partition 708, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:29:30 TaskSetManager: INFO: Finished task 707.0 in stage 1.0 (TID 708) in 50312 ms on localhost (executor driver) (708/882) 2020-02-15 00:29:30 Executor: INFO: Running task 708.0 in stage 1.0 (TID 709) 2020-02-15 00:29:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23756537856+33554432 2020-02-15 00:29:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:30:08 Executor: INFO: Finished task 708.0 in stage 1.0 (TID 709). 1638 bytes result sent to driver 2020-02-15 00:30:08 TaskSetManager: INFO: Starting task 709.0 in stage 1.0 (TID 710, localhost, executor driver, partition 709, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:30:08 TaskSetManager: INFO: Finished task 708.0 in stage 1.0 (TID 709) in 38354 ms on localhost (executor driver) (709/882) 2020-02-15 00:30:08 Executor: INFO: Running task 709.0 in stage 1.0 (TID 710) 2020-02-15 00:30:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23790092288+33554432 2020-02-15 00:30:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:30:46 Executor: INFO: Finished task 709.0 in stage 1.0 (TID 710). 1634 bytes result sent to driver 2020-02-15 00:30:46 TaskSetManager: INFO: Starting task 710.0 in stage 1.0 (TID 711, localhost, executor driver, partition 710, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:30:46 TaskSetManager: INFO: Finished task 709.0 in stage 1.0 (TID 710) in 37556 ms on localhost (executor driver) (710/882) 2020-02-15 00:30:46 Executor: INFO: Running task 710.0 in stage 1.0 (TID 711) 2020-02-15 00:30:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23823646720+33554432 2020-02-15 00:30:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:31:32 Executor: INFO: Finished task 710.0 in stage 1.0 (TID 711). 1640 bytes result sent to driver 2020-02-15 00:31:32 TaskSetManager: INFO: Starting task 711.0 in stage 1.0 (TID 712, localhost, executor driver, partition 711, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:31:32 TaskSetManager: INFO: Finished task 710.0 in stage 1.0 (TID 711) in 46019 ms on localhost (executor driver) (711/882) 2020-02-15 00:31:32 Executor: INFO: Running task 711.0 in stage 1.0 (TID 712) 2020-02-15 00:31:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23857201152+33554432 2020-02-15 00:31:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:32:27 Executor: INFO: Finished task 711.0 in stage 1.0 (TID 712). 1636 bytes result sent to driver 2020-02-15 00:32:27 TaskSetManager: INFO: Starting task 712.0 in stage 1.0 (TID 713, localhost, executor driver, partition 712, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:32:27 TaskSetManager: INFO: Finished task 711.0 in stage 1.0 (TID 712) in 55318 ms on localhost (executor driver) (712/882) 2020-02-15 00:32:27 Executor: INFO: Running task 712.0 in stage 1.0 (TID 713) 2020-02-15 00:32:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23890755584+33554432 2020-02-15 00:32:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:33:26 Executor: INFO: Finished task 712.0 in stage 1.0 (TID 713). 1645 bytes result sent to driver 2020-02-15 00:33:26 TaskSetManager: INFO: Starting task 713.0 in stage 1.0 (TID 714, localhost, executor driver, partition 713, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:33:26 TaskSetManager: INFO: Finished task 712.0 in stage 1.0 (TID 713) in 58780 ms on localhost (executor driver) (713/882) 2020-02-15 00:33:26 Executor: INFO: Running task 713.0 in stage 1.0 (TID 714) 2020-02-15 00:33:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23924310016+33554432 2020-02-15 00:33:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:34:28 Executor: INFO: Finished task 713.0 in stage 1.0 (TID 714). 1652 bytes result sent to driver 2020-02-15 00:34:28 TaskSetManager: INFO: Starting task 714.0 in stage 1.0 (TID 715, localhost, executor driver, partition 714, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:34:28 TaskSetManager: INFO: Finished task 713.0 in stage 1.0 (TID 714) in 62581 ms on localhost (executor driver) (714/882) 2020-02-15 00:34:28 Executor: INFO: Running task 714.0 in stage 1.0 (TID 715) 2020-02-15 00:34:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23957864448+33554432 2020-02-15 00:34:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:35:13 Executor: INFO: Finished task 714.0 in stage 1.0 (TID 715). 1663 bytes result sent to driver 2020-02-15 00:35:13 TaskSetManager: INFO: Starting task 715.0 in stage 1.0 (TID 716, localhost, executor driver, partition 715, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:35:13 TaskSetManager: INFO: Finished task 714.0 in stage 1.0 (TID 715) in 44600 ms on localhost (executor driver) (715/882) 2020-02-15 00:35:13 Executor: INFO: Running task 715.0 in stage 1.0 (TID 716) 2020-02-15 00:35:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:23991418880+33554432 2020-02-15 00:35:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:36:07 Executor: INFO: Finished task 715.0 in stage 1.0 (TID 716). 1627 bytes result sent to driver 2020-02-15 00:36:07 TaskSetManager: INFO: Starting task 716.0 in stage 1.0 (TID 717, localhost, executor driver, partition 716, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:36:07 TaskSetManager: INFO: Finished task 715.0 in stage 1.0 (TID 716) in 53788 ms on localhost (executor driver) (716/882) 2020-02-15 00:36:07 Executor: INFO: Running task 716.0 in stage 1.0 (TID 717) 2020-02-15 00:36:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24024973312+33554432 2020-02-15 00:36:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:36:58 Executor: INFO: Finished task 716.0 in stage 1.0 (TID 717). 1639 bytes result sent to driver 2020-02-15 00:36:58 TaskSetManager: INFO: Starting task 717.0 in stage 1.0 (TID 718, localhost, executor driver, partition 717, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:36:58 TaskSetManager: INFO: Finished task 716.0 in stage 1.0 (TID 717) in 50897 ms on localhost (executor driver) (717/882) 2020-02-15 00:36:58 Executor: INFO: Running task 717.0 in stage 1.0 (TID 718) 2020-02-15 00:36:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24058527744+33554432 2020-02-15 00:36:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:37:56 Executor: INFO: Finished task 717.0 in stage 1.0 (TID 718). 1684 bytes result sent to driver 2020-02-15 00:37:56 TaskSetManager: INFO: Starting task 718.0 in stage 1.0 (TID 719, localhost, executor driver, partition 718, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:37:56 TaskSetManager: INFO: Finished task 717.0 in stage 1.0 (TID 718) in 58134 ms on localhost (executor driver) (718/882) 2020-02-15 00:37:56 Executor: INFO: Running task 718.0 in stage 1.0 (TID 719) 2020-02-15 00:37:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24092082176+33554432 2020-02-15 00:37:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:38:48 Executor: INFO: Finished task 718.0 in stage 1.0 (TID 719). 1636 bytes result sent to driver 2020-02-15 00:38:48 TaskSetManager: INFO: Starting task 719.0 in stage 1.0 (TID 720, localhost, executor driver, partition 719, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:38:48 TaskSetManager: INFO: Finished task 718.0 in stage 1.0 (TID 719) in 52295 ms on localhost (executor driver) (719/882) 2020-02-15 00:38:48 Executor: INFO: Running task 719.0 in stage 1.0 (TID 720) 2020-02-15 00:38:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24125636608+33554432 2020-02-15 00:38:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:39:43 Executor: INFO: Finished task 719.0 in stage 1.0 (TID 720). 1627 bytes result sent to driver 2020-02-15 00:39:43 TaskSetManager: INFO: Starting task 720.0 in stage 1.0 (TID 721, localhost, executor driver, partition 720, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:39:43 TaskSetManager: INFO: Finished task 719.0 in stage 1.0 (TID 720) in 55380 ms on localhost (executor driver) (720/882) 2020-02-15 00:39:43 Executor: INFO: Running task 720.0 in stage 1.0 (TID 721) 2020-02-15 00:39:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24159191040+33554432 2020-02-15 00:39:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:40:49 Executor: INFO: Finished task 720.0 in stage 1.0 (TID 721). 1633 bytes result sent to driver 2020-02-15 00:40:49 TaskSetManager: INFO: Starting task 721.0 in stage 1.0 (TID 722, localhost, executor driver, partition 721, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:40:49 TaskSetManager: INFO: Finished task 720.0 in stage 1.0 (TID 721) in 65644 ms on localhost (executor driver) (721/882) 2020-02-15 00:40:49 Executor: INFO: Running task 721.0 in stage 1.0 (TID 722) 2020-02-15 00:40:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24192745472+33554432 2020-02-15 00:40:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:41:40 Executor: INFO: Finished task 721.0 in stage 1.0 (TID 722). 1628 bytes result sent to driver 2020-02-15 00:41:40 TaskSetManager: INFO: Starting task 722.0 in stage 1.0 (TID 723, localhost, executor driver, partition 722, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:41:40 TaskSetManager: INFO: Finished task 721.0 in stage 1.0 (TID 722) in 50576 ms on localhost (executor driver) (722/882) 2020-02-15 00:41:40 Executor: INFO: Running task 722.0 in stage 1.0 (TID 723) 2020-02-15 00:41:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24226299904+33554432 2020-02-15 00:41:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:42:35 Executor: INFO: Finished task 722.0 in stage 1.0 (TID 723). 1635 bytes result sent to driver 2020-02-15 00:42:35 TaskSetManager: INFO: Starting task 723.0 in stage 1.0 (TID 724, localhost, executor driver, partition 723, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:42:35 TaskSetManager: INFO: Finished task 722.0 in stage 1.0 (TID 723) in 55197 ms on localhost (executor driver) (723/882) 2020-02-15 00:42:35 Executor: INFO: Running task 723.0 in stage 1.0 (TID 724) 2020-02-15 00:42:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24259854336+33554432 2020-02-15 00:42:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:43:40 Executor: INFO: Finished task 723.0 in stage 1.0 (TID 724). 1624 bytes result sent to driver 2020-02-15 00:43:40 TaskSetManager: INFO: Starting task 724.0 in stage 1.0 (TID 725, localhost, executor driver, partition 724, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:43:40 TaskSetManager: INFO: Finished task 723.0 in stage 1.0 (TID 724) in 65101 ms on localhost (executor driver) (724/882) 2020-02-15 00:43:40 Executor: INFO: Running task 724.0 in stage 1.0 (TID 725) 2020-02-15 00:43:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24293408768+33554432 2020-02-15 00:43:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:44:37 Executor: INFO: Finished task 724.0 in stage 1.0 (TID 725). 1631 bytes result sent to driver 2020-02-15 00:44:37 TaskSetManager: INFO: Starting task 725.0 in stage 1.0 (TID 726, localhost, executor driver, partition 725, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:44:37 TaskSetManager: INFO: Finished task 724.0 in stage 1.0 (TID 725) in 57291 ms on localhost (executor driver) (725/882) 2020-02-15 00:44:37 Executor: INFO: Running task 725.0 in stage 1.0 (TID 726) 2020-02-15 00:44:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24326963200+33554432 2020-02-15 00:44:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:45:46 Executor: INFO: Finished task 725.0 in stage 1.0 (TID 726). 1633 bytes result sent to driver 2020-02-15 00:45:46 TaskSetManager: INFO: Starting task 726.0 in stage 1.0 (TID 727, localhost, executor driver, partition 726, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:45:46 TaskSetManager: INFO: Finished task 725.0 in stage 1.0 (TID 726) in 68725 ms on localhost (executor driver) (726/882) 2020-02-15 00:45:46 Executor: INFO: Running task 726.0 in stage 1.0 (TID 727) 2020-02-15 00:45:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24360517632+33554432 2020-02-15 00:45:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:46:46 Executor: INFO: Finished task 726.0 in stage 1.0 (TID 727). 1624 bytes result sent to driver 2020-02-15 00:46:46 TaskSetManager: INFO: Starting task 727.0 in stage 1.0 (TID 728, localhost, executor driver, partition 727, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:46:46 TaskSetManager: INFO: Finished task 726.0 in stage 1.0 (TID 727) in 60527 ms on localhost (executor driver) (727/882) 2020-02-15 00:46:46 Executor: INFO: Running task 727.0 in stage 1.0 (TID 728) 2020-02-15 00:46:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24394072064+33554432 2020-02-15 00:46:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:47:46 Executor: INFO: Finished task 727.0 in stage 1.0 (TID 728). 1624 bytes result sent to driver 2020-02-15 00:47:46 TaskSetManager: INFO: Starting task 728.0 in stage 1.0 (TID 729, localhost, executor driver, partition 728, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:47:46 TaskSetManager: INFO: Finished task 727.0 in stage 1.0 (TID 728) in 59673 ms on localhost (executor driver) (728/882) 2020-02-15 00:47:46 Executor: INFO: Running task 728.0 in stage 1.0 (TID 729) 2020-02-15 00:47:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24427626496+33554432 2020-02-15 00:47:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:48:53 Executor: INFO: Finished task 728.0 in stage 1.0 (TID 729). 1624 bytes result sent to driver 2020-02-15 00:48:53 TaskSetManager: INFO: Starting task 729.0 in stage 1.0 (TID 730, localhost, executor driver, partition 729, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:48:53 TaskSetManager: INFO: Finished task 728.0 in stage 1.0 (TID 729) in 66391 ms on localhost (executor driver) (729/882) 2020-02-15 00:48:53 Executor: INFO: Running task 729.0 in stage 1.0 (TID 730) 2020-02-15 00:48:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24461180928+33554432 2020-02-15 00:48:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:49:39 Executor: INFO: Finished task 729.0 in stage 1.0 (TID 730). 1626 bytes result sent to driver 2020-02-15 00:49:39 TaskSetManager: INFO: Starting task 730.0 in stage 1.0 (TID 731, localhost, executor driver, partition 730, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:49:39 TaskSetManager: INFO: Finished task 729.0 in stage 1.0 (TID 730) in 46501 ms on localhost (executor driver) (730/882) 2020-02-15 00:49:39 Executor: INFO: Running task 730.0 in stage 1.0 (TID 731) 2020-02-15 00:49:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24494735360+33554432 2020-02-15 00:49:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:50:32 Executor: INFO: Finished task 730.0 in stage 1.0 (TID 731). 1624 bytes result sent to driver 2020-02-15 00:50:32 TaskSetManager: INFO: Starting task 731.0 in stage 1.0 (TID 732, localhost, executor driver, partition 731, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:50:32 TaskSetManager: INFO: Finished task 730.0 in stage 1.0 (TID 731) in 52828 ms on localhost (executor driver) (731/882) 2020-02-15 00:50:32 Executor: INFO: Running task 731.0 in stage 1.0 (TID 732) 2020-02-15 00:50:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24528289792+33554432 2020-02-15 00:50:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:51:28 Executor: INFO: Finished task 731.0 in stage 1.0 (TID 732). 1624 bytes result sent to driver 2020-02-15 00:51:28 TaskSetManager: INFO: Starting task 732.0 in stage 1.0 (TID 733, localhost, executor driver, partition 732, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:51:28 TaskSetManager: INFO: Finished task 731.0 in stage 1.0 (TID 732) in 55792 ms on localhost (executor driver) (732/882) 2020-02-15 00:51:28 Executor: INFO: Running task 732.0 in stage 1.0 (TID 733) 2020-02-15 00:51:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24561844224+33554432 2020-02-15 00:51:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:52:25 Executor: INFO: Finished task 732.0 in stage 1.0 (TID 733). 1627 bytes result sent to driver 2020-02-15 00:52:25 TaskSetManager: INFO: Starting task 733.0 in stage 1.0 (TID 734, localhost, executor driver, partition 733, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:52:25 TaskSetManager: INFO: Finished task 732.0 in stage 1.0 (TID 733) in 57212 ms on localhost (executor driver) (733/882) 2020-02-15 00:52:25 Executor: INFO: Running task 733.0 in stage 1.0 (TID 734) 2020-02-15 00:52:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24595398656+33554432 2020-02-15 00:52:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:53:22 Executor: INFO: Finished task 733.0 in stage 1.0 (TID 734). 1626 bytes result sent to driver 2020-02-15 00:53:22 TaskSetManager: INFO: Starting task 734.0 in stage 1.0 (TID 735, localhost, executor driver, partition 734, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:53:22 TaskSetManager: INFO: Finished task 733.0 in stage 1.0 (TID 734) in 57481 ms on localhost (executor driver) (734/882) 2020-02-15 00:53:22 Executor: INFO: Running task 734.0 in stage 1.0 (TID 735) 2020-02-15 00:53:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24628953088+33554432 2020-02-15 00:53:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:54:11 Executor: INFO: Finished task 734.0 in stage 1.0 (TID 735). 1624 bytes result sent to driver 2020-02-15 00:54:11 TaskSetManager: INFO: Starting task 735.0 in stage 1.0 (TID 736, localhost, executor driver, partition 735, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:54:11 TaskSetManager: INFO: Finished task 734.0 in stage 1.0 (TID 735) in 48369 ms on localhost (executor driver) (735/882) 2020-02-15 00:54:11 Executor: INFO: Running task 735.0 in stage 1.0 (TID 736) 2020-02-15 00:54:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24662507520+33554432 2020-02-15 00:54:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:55:06 Executor: INFO: Finished task 735.0 in stage 1.0 (TID 736). 1625 bytes result sent to driver 2020-02-15 00:55:06 TaskSetManager: INFO: Starting task 736.0 in stage 1.0 (TID 737, localhost, executor driver, partition 736, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:55:06 TaskSetManager: INFO: Finished task 735.0 in stage 1.0 (TID 736) in 54945 ms on localhost (executor driver) (736/882) 2020-02-15 00:55:06 Executor: INFO: Running task 736.0 in stage 1.0 (TID 737) 2020-02-15 00:55:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24696061952+33554432 2020-02-15 00:55:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:55:58 Executor: INFO: Finished task 736.0 in stage 1.0 (TID 737). 1677 bytes result sent to driver 2020-02-15 00:55:58 TaskSetManager: INFO: Starting task 737.0 in stage 1.0 (TID 738, localhost, executor driver, partition 737, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:55:58 TaskSetManager: INFO: Finished task 736.0 in stage 1.0 (TID 737) in 52409 ms on localhost (executor driver) (737/882) 2020-02-15 00:55:58 Executor: INFO: Running task 737.0 in stage 1.0 (TID 738) 2020-02-15 00:55:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24729616384+33554432 2020-02-15 00:55:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:56:49 Executor: INFO: Finished task 737.0 in stage 1.0 (TID 738). 1626 bytes result sent to driver 2020-02-15 00:56:49 TaskSetManager: INFO: Starting task 738.0 in stage 1.0 (TID 739, localhost, executor driver, partition 738, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:56:49 TaskSetManager: INFO: Finished task 737.0 in stage 1.0 (TID 738) in 51362 ms on localhost (executor driver) (738/882) 2020-02-15 00:56:49 Executor: INFO: Running task 738.0 in stage 1.0 (TID 739) 2020-02-15 00:56:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24763170816+33554432 2020-02-15 00:56:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:57:28 Executor: INFO: Finished task 738.0 in stage 1.0 (TID 739). 1624 bytes result sent to driver 2020-02-15 00:57:28 TaskSetManager: INFO: Starting task 739.0 in stage 1.0 (TID 740, localhost, executor driver, partition 739, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:57:28 TaskSetManager: INFO: Finished task 738.0 in stage 1.0 (TID 739) in 38209 ms on localhost (executor driver) (739/882) 2020-02-15 00:57:28 Executor: INFO: Running task 739.0 in stage 1.0 (TID 740) 2020-02-15 00:57:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24796725248+33554432 2020-02-15 00:57:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:58:14 Executor: INFO: Finished task 739.0 in stage 1.0 (TID 740). 1633 bytes result sent to driver 2020-02-15 00:58:14 TaskSetManager: INFO: Starting task 740.0 in stage 1.0 (TID 741, localhost, executor driver, partition 740, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:58:14 TaskSetManager: INFO: Finished task 739.0 in stage 1.0 (TID 740) in 46853 ms on localhost (executor driver) (740/882) 2020-02-15 00:58:14 Executor: INFO: Running task 740.0 in stage 1.0 (TID 741) 2020-02-15 00:58:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24830279680+33554432 2020-02-15 00:58:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:59:11 Executor: INFO: Finished task 740.0 in stage 1.0 (TID 741). 1628 bytes result sent to driver 2020-02-15 00:59:11 TaskSetManager: INFO: Starting task 741.0 in stage 1.0 (TID 742, localhost, executor driver, partition 741, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:59:11 TaskSetManager: INFO: Finished task 740.0 in stage 1.0 (TID 741) in 56596 ms on localhost (executor driver) (741/882) 2020-02-15 00:59:11 Executor: INFO: Running task 741.0 in stage 1.0 (TID 742) 2020-02-15 00:59:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24863834112+33554432 2020-02-15 00:59:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 00:59:40 Executor: INFO: Finished task 741.0 in stage 1.0 (TID 742). 1628 bytes result sent to driver 2020-02-15 00:59:40 TaskSetManager: INFO: Starting task 742.0 in stage 1.0 (TID 743, localhost, executor driver, partition 742, PROCESS_LOCAL, 7933 bytes) 2020-02-15 00:59:40 TaskSetManager: INFO: Finished task 741.0 in stage 1.0 (TID 742) in 28512 ms on localhost (executor driver) (742/882) 2020-02-15 00:59:40 Executor: INFO: Running task 742.0 in stage 1.0 (TID 743) 2020-02-15 00:59:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24897388544+33554432 2020-02-15 00:59:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:00:28 Executor: INFO: Finished task 742.0 in stage 1.0 (TID 743). 1635 bytes result sent to driver 2020-02-15 01:00:28 TaskSetManager: INFO: Starting task 743.0 in stage 1.0 (TID 744, localhost, executor driver, partition 743, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:00:28 TaskSetManager: INFO: Finished task 742.0 in stage 1.0 (TID 743) in 48048 ms on localhost (executor driver) (743/882) 2020-02-15 01:00:28 Executor: INFO: Running task 743.0 in stage 1.0 (TID 744) 2020-02-15 01:00:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24930942976+33554432 2020-02-15 01:00:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:01:20 Executor: INFO: Finished task 743.0 in stage 1.0 (TID 744). 1763 bytes result sent to driver 2020-02-15 01:01:20 TaskSetManager: INFO: Starting task 744.0 in stage 1.0 (TID 745, localhost, executor driver, partition 744, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:01:20 TaskSetManager: INFO: Finished task 743.0 in stage 1.0 (TID 744) in 52124 ms on localhost (executor driver) (744/882) 2020-02-15 01:01:20 Executor: INFO: Running task 744.0 in stage 1.0 (TID 745) 2020-02-15 01:01:20 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24964497408+33554432 2020-02-15 01:01:20 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:02:27 Executor: INFO: Finished task 744.0 in stage 1.0 (TID 745). 1641 bytes result sent to driver 2020-02-15 01:02:27 TaskSetManager: INFO: Starting task 745.0 in stage 1.0 (TID 746, localhost, executor driver, partition 745, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:02:27 TaskSetManager: INFO: Finished task 744.0 in stage 1.0 (TID 745) in 66851 ms on localhost (executor driver) (745/882) 2020-02-15 01:02:27 Executor: INFO: Running task 745.0 in stage 1.0 (TID 746) 2020-02-15 01:02:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:24998051840+33554432 2020-02-15 01:02:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:03:31 Executor: INFO: Finished task 745.0 in stage 1.0 (TID 746). 1625 bytes result sent to driver 2020-02-15 01:03:31 TaskSetManager: INFO: Starting task 746.0 in stage 1.0 (TID 747, localhost, executor driver, partition 746, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:03:31 TaskSetManager: INFO: Finished task 745.0 in stage 1.0 (TID 746) in 64855 ms on localhost (executor driver) (746/882) 2020-02-15 01:03:31 Executor: INFO: Running task 746.0 in stage 1.0 (TID 747) 2020-02-15 01:03:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25031606272+33554432 2020-02-15 01:03:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:04:30 Executor: INFO: Finished task 746.0 in stage 1.0 (TID 747). 1723 bytes result sent to driver 2020-02-15 01:04:30 TaskSetManager: INFO: Starting task 747.0 in stage 1.0 (TID 748, localhost, executor driver, partition 747, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:04:30 TaskSetManager: INFO: Finished task 746.0 in stage 1.0 (TID 747) in 58495 ms on localhost (executor driver) (747/882) 2020-02-15 01:04:30 Executor: INFO: Running task 747.0 in stage 1.0 (TID 748) 2020-02-15 01:04:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25065160704+33554432 2020-02-15 01:04:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:05:22 Executor: INFO: Finished task 747.0 in stage 1.0 (TID 748). 1624 bytes result sent to driver 2020-02-15 01:05:22 TaskSetManager: INFO: Starting task 748.0 in stage 1.0 (TID 749, localhost, executor driver, partition 748, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:05:22 TaskSetManager: INFO: Finished task 747.0 in stage 1.0 (TID 748) in 52442 ms on localhost (executor driver) (748/882) 2020-02-15 01:05:22 Executor: INFO: Running task 748.0 in stage 1.0 (TID 749) 2020-02-15 01:05:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25098715136+33554432 2020-02-15 01:05:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:06:21 Executor: INFO: Finished task 748.0 in stage 1.0 (TID 749). 1624 bytes result sent to driver 2020-02-15 01:06:21 TaskSetManager: INFO: Starting task 749.0 in stage 1.0 (TID 750, localhost, executor driver, partition 749, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:06:21 TaskSetManager: INFO: Finished task 748.0 in stage 1.0 (TID 749) in 58955 ms on localhost (executor driver) (749/882) 2020-02-15 01:06:21 Executor: INFO: Running task 749.0 in stage 1.0 (TID 750) 2020-02-15 01:06:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25132269568+33554432 2020-02-15 01:06:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:07:24 Executor: INFO: Finished task 749.0 in stage 1.0 (TID 750). 1626 bytes result sent to driver 2020-02-15 01:07:24 TaskSetManager: INFO: Starting task 750.0 in stage 1.0 (TID 751, localhost, executor driver, partition 750, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:07:24 TaskSetManager: INFO: Finished task 749.0 in stage 1.0 (TID 750) in 62459 ms on localhost (executor driver) (750/882) 2020-02-15 01:07:24 Executor: INFO: Running task 750.0 in stage 1.0 (TID 751) 2020-02-15 01:07:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25165824000+33554432 2020-02-15 01:07:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:08:26 Executor: INFO: Finished task 750.0 in stage 1.0 (TID 751). 1624 bytes result sent to driver 2020-02-15 01:08:26 TaskSetManager: INFO: Starting task 751.0 in stage 1.0 (TID 752, localhost, executor driver, partition 751, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:08:26 TaskSetManager: INFO: Finished task 750.0 in stage 1.0 (TID 751) in 62666 ms on localhost (executor driver) (751/882) 2020-02-15 01:08:26 Executor: INFO: Running task 751.0 in stage 1.0 (TID 752) 2020-02-15 01:08:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25199378432+33554432 2020-02-15 01:08:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:09:28 Executor: INFO: Finished task 751.0 in stage 1.0 (TID 752). 1624 bytes result sent to driver 2020-02-15 01:09:28 TaskSetManager: INFO: Starting task 752.0 in stage 1.0 (TID 753, localhost, executor driver, partition 752, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:09:28 TaskSetManager: INFO: Finished task 751.0 in stage 1.0 (TID 752) in 61620 ms on localhost (executor driver) (752/882) 2020-02-15 01:09:28 Executor: INFO: Running task 752.0 in stage 1.0 (TID 753) 2020-02-15 01:09:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25232932864+33554432 2020-02-15 01:09:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:10:32 Executor: INFO: Finished task 752.0 in stage 1.0 (TID 753). 1625 bytes result sent to driver 2020-02-15 01:10:32 TaskSetManager: INFO: Starting task 753.0 in stage 1.0 (TID 754, localhost, executor driver, partition 753, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:10:32 TaskSetManager: INFO: Finished task 752.0 in stage 1.0 (TID 753) in 63416 ms on localhost (executor driver) (753/882) 2020-02-15 01:10:32 Executor: INFO: Running task 753.0 in stage 1.0 (TID 754) 2020-02-15 01:10:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25266487296+33554432 2020-02-15 01:10:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:11:36 Executor: INFO: Finished task 753.0 in stage 1.0 (TID 754). 1627 bytes result sent to driver 2020-02-15 01:11:36 TaskSetManager: INFO: Starting task 754.0 in stage 1.0 (TID 755, localhost, executor driver, partition 754, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:11:36 TaskSetManager: INFO: Finished task 753.0 in stage 1.0 (TID 754) in 64856 ms on localhost (executor driver) (754/882) 2020-02-15 01:11:36 Executor: INFO: Running task 754.0 in stage 1.0 (TID 755) 2020-02-15 01:11:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25300041728+33554432 2020-02-15 01:11:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:12:35 Executor: INFO: Finished task 754.0 in stage 1.0 (TID 755). 1629 bytes result sent to driver 2020-02-15 01:12:35 TaskSetManager: INFO: Starting task 755.0 in stage 1.0 (TID 756, localhost, executor driver, partition 755, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:12:35 TaskSetManager: INFO: Finished task 754.0 in stage 1.0 (TID 755) in 58611 ms on localhost (executor driver) (755/882) 2020-02-15 01:12:35 Executor: INFO: Running task 755.0 in stage 1.0 (TID 756) 2020-02-15 01:12:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25333596160+33554432 2020-02-15 01:12:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:13:28 Executor: INFO: Finished task 755.0 in stage 1.0 (TID 756). 1629 bytes result sent to driver 2020-02-15 01:13:28 TaskSetManager: INFO: Starting task 756.0 in stage 1.0 (TID 757, localhost, executor driver, partition 756, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:13:28 TaskSetManager: INFO: Finished task 755.0 in stage 1.0 (TID 756) in 52854 ms on localhost (executor driver) (756/882) 2020-02-15 01:13:28 Executor: INFO: Running task 756.0 in stage 1.0 (TID 757) 2020-02-15 01:13:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25367150592+33554432 2020-02-15 01:13:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:14:30 Executor: INFO: Finished task 756.0 in stage 1.0 (TID 757). 1624 bytes result sent to driver 2020-02-15 01:14:30 TaskSetManager: INFO: Starting task 757.0 in stage 1.0 (TID 758, localhost, executor driver, partition 757, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:14:30 TaskSetManager: INFO: Finished task 756.0 in stage 1.0 (TID 757) in 61684 ms on localhost (executor driver) (757/882) 2020-02-15 01:14:30 Executor: INFO: Running task 757.0 in stage 1.0 (TID 758) 2020-02-15 01:14:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25400705024+33554432 2020-02-15 01:14:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:15:32 Executor: INFO: Finished task 757.0 in stage 1.0 (TID 758). 1624 bytes result sent to driver 2020-02-15 01:15:32 TaskSetManager: INFO: Starting task 758.0 in stage 1.0 (TID 759, localhost, executor driver, partition 758, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:15:32 TaskSetManager: INFO: Finished task 757.0 in stage 1.0 (TID 758) in 62327 ms on localhost (executor driver) (758/882) 2020-02-15 01:15:32 Executor: INFO: Running task 758.0 in stage 1.0 (TID 759) 2020-02-15 01:15:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25434259456+33554432 2020-02-15 01:15:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:16:27 Executor: INFO: Finished task 758.0 in stage 1.0 (TID 759). 1646 bytes result sent to driver 2020-02-15 01:16:27 TaskSetManager: INFO: Starting task 759.0 in stage 1.0 (TID 760, localhost, executor driver, partition 759, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:16:27 TaskSetManager: INFO: Finished task 758.0 in stage 1.0 (TID 759) in 55184 ms on localhost (executor driver) (759/882) 2020-02-15 01:16:27 Executor: INFO: Running task 759.0 in stage 1.0 (TID 760) 2020-02-15 01:16:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25467813888+33554432 2020-02-15 01:16:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:17:25 Executor: INFO: Finished task 759.0 in stage 1.0 (TID 760). 1626 bytes result sent to driver 2020-02-15 01:17:25 TaskSetManager: INFO: Starting task 760.0 in stage 1.0 (TID 761, localhost, executor driver, partition 760, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:17:25 TaskSetManager: INFO: Finished task 759.0 in stage 1.0 (TID 760) in 57855 ms on localhost (executor driver) (760/882) 2020-02-15 01:17:25 Executor: INFO: Running task 760.0 in stage 1.0 (TID 761) 2020-02-15 01:17:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25501368320+33554432 2020-02-15 01:17:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:18:26 Executor: INFO: Finished task 760.0 in stage 1.0 (TID 761). 1627 bytes result sent to driver 2020-02-15 01:18:26 TaskSetManager: INFO: Starting task 761.0 in stage 1.0 (TID 762, localhost, executor driver, partition 761, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:18:26 TaskSetManager: INFO: Finished task 760.0 in stage 1.0 (TID 761) in 61279 ms on localhost (executor driver) (761/882) 2020-02-15 01:18:26 Executor: INFO: Running task 761.0 in stage 1.0 (TID 762) 2020-02-15 01:18:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25534922752+33554432 2020-02-15 01:18:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:19:25 Executor: INFO: Finished task 761.0 in stage 1.0 (TID 762). 1624 bytes result sent to driver 2020-02-15 01:19:25 TaskSetManager: INFO: Starting task 762.0 in stage 1.0 (TID 763, localhost, executor driver, partition 762, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:19:25 TaskSetManager: INFO: Finished task 761.0 in stage 1.0 (TID 762) in 58779 ms on localhost (executor driver) (762/882) 2020-02-15 01:19:25 Executor: INFO: Running task 762.0 in stage 1.0 (TID 763) 2020-02-15 01:19:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25568477184+33554432 2020-02-15 01:19:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:20:27 Executor: INFO: Finished task 762.0 in stage 1.0 (TID 763). 1660 bytes result sent to driver 2020-02-15 01:20:27 TaskSetManager: INFO: Starting task 763.0 in stage 1.0 (TID 764, localhost, executor driver, partition 763, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:20:27 TaskSetManager: INFO: Finished task 762.0 in stage 1.0 (TID 763) in 62123 ms on localhost (executor driver) (763/882) 2020-02-15 01:20:27 Executor: INFO: Running task 763.0 in stage 1.0 (TID 764) 2020-02-15 01:20:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25602031616+33554432 2020-02-15 01:20:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:21:24 Executor: INFO: Finished task 763.0 in stage 1.0 (TID 764). 1658 bytes result sent to driver 2020-02-15 01:21:24 TaskSetManager: INFO: Starting task 764.0 in stage 1.0 (TID 765, localhost, executor driver, partition 764, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:21:24 TaskSetManager: INFO: Finished task 763.0 in stage 1.0 (TID 764) in 57014 ms on localhost (executor driver) (764/882) 2020-02-15 01:21:24 Executor: INFO: Running task 764.0 in stage 1.0 (TID 765) 2020-02-15 01:21:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25635586048+33554432 2020-02-15 01:21:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:22:28 Executor: INFO: Finished task 764.0 in stage 1.0 (TID 765). 1634 bytes result sent to driver 2020-02-15 01:22:28 TaskSetManager: INFO: Starting task 765.0 in stage 1.0 (TID 766, localhost, executor driver, partition 765, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:22:28 TaskSetManager: INFO: Finished task 764.0 in stage 1.0 (TID 765) in 64047 ms on localhost (executor driver) (765/882) 2020-02-15 01:22:28 Executor: INFO: Running task 765.0 in stage 1.0 (TID 766) 2020-02-15 01:22:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25669140480+33554432 2020-02-15 01:22:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:23:16 Executor: INFO: Finished task 765.0 in stage 1.0 (TID 766). 1630 bytes result sent to driver 2020-02-15 01:23:16 TaskSetManager: INFO: Starting task 766.0 in stage 1.0 (TID 767, localhost, executor driver, partition 766, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:23:16 TaskSetManager: INFO: Finished task 765.0 in stage 1.0 (TID 766) in 48157 ms on localhost (executor driver) (766/882) 2020-02-15 01:23:16 Executor: INFO: Running task 766.0 in stage 1.0 (TID 767) 2020-02-15 01:23:16 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25702694912+33554432 2020-02-15 01:23:16 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:24:00 Executor: INFO: Finished task 766.0 in stage 1.0 (TID 767). 1624 bytes result sent to driver 2020-02-15 01:24:00 TaskSetManager: INFO: Starting task 767.0 in stage 1.0 (TID 768, localhost, executor driver, partition 767, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:24:00 TaskSetManager: INFO: Finished task 766.0 in stage 1.0 (TID 767) in 43402 ms on localhost (executor driver) (767/882) 2020-02-15 01:24:00 Executor: INFO: Running task 767.0 in stage 1.0 (TID 768) 2020-02-15 01:24:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25736249344+33554432 2020-02-15 01:24:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:24:50 Executor: INFO: Finished task 767.0 in stage 1.0 (TID 768). 1624 bytes result sent to driver 2020-02-15 01:24:50 TaskSetManager: INFO: Starting task 768.0 in stage 1.0 (TID 769, localhost, executor driver, partition 768, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:24:50 TaskSetManager: INFO: Finished task 767.0 in stage 1.0 (TID 768) in 50700 ms on localhost (executor driver) (768/882) 2020-02-15 01:24:50 Executor: INFO: Running task 768.0 in stage 1.0 (TID 769) 2020-02-15 01:24:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25769803776+33554432 2020-02-15 01:24:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:25:49 Executor: INFO: Finished task 768.0 in stage 1.0 (TID 769). 1624 bytes result sent to driver 2020-02-15 01:25:49 TaskSetManager: INFO: Starting task 769.0 in stage 1.0 (TID 770, localhost, executor driver, partition 769, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:25:49 TaskSetManager: INFO: Finished task 768.0 in stage 1.0 (TID 769) in 58927 ms on localhost (executor driver) (769/882) 2020-02-15 01:25:49 Executor: INFO: Running task 769.0 in stage 1.0 (TID 770) 2020-02-15 01:25:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25803358208+33554432 2020-02-15 01:25:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:26:53 Executor: INFO: Finished task 769.0 in stage 1.0 (TID 770). 1624 bytes result sent to driver 2020-02-15 01:26:53 TaskSetManager: INFO: Starting task 770.0 in stage 1.0 (TID 771, localhost, executor driver, partition 770, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:26:53 TaskSetManager: INFO: Finished task 769.0 in stage 1.0 (TID 770) in 63546 ms on localhost (executor driver) (770/882) 2020-02-15 01:26:53 Executor: INFO: Running task 770.0 in stage 1.0 (TID 771) 2020-02-15 01:26:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25836912640+33554432 2020-02-15 01:26:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:27:58 Executor: INFO: Finished task 770.0 in stage 1.0 (TID 771). 1654 bytes result sent to driver 2020-02-15 01:27:58 TaskSetManager: INFO: Starting task 771.0 in stage 1.0 (TID 772, localhost, executor driver, partition 771, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:27:58 TaskSetManager: INFO: Finished task 770.0 in stage 1.0 (TID 771) in 64974 ms on localhost (executor driver) (771/882) 2020-02-15 01:27:58 Executor: INFO: Running task 771.0 in stage 1.0 (TID 772) 2020-02-15 01:27:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25870467072+33554432 2020-02-15 01:27:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:29:02 Executor: INFO: Finished task 771.0 in stage 1.0 (TID 772). 1659 bytes result sent to driver 2020-02-15 01:29:02 TaskSetManager: INFO: Starting task 772.0 in stage 1.0 (TID 773, localhost, executor driver, partition 772, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:29:02 TaskSetManager: INFO: Finished task 771.0 in stage 1.0 (TID 772) in 64259 ms on localhost (executor driver) (772/882) 2020-02-15 01:29:02 Executor: INFO: Running task 772.0 in stage 1.0 (TID 773) 2020-02-15 01:29:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25904021504+33554432 2020-02-15 01:29:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:30:07 Executor: INFO: Finished task 772.0 in stage 1.0 (TID 773). 1624 bytes result sent to driver 2020-02-15 01:30:07 TaskSetManager: INFO: Starting task 773.0 in stage 1.0 (TID 774, localhost, executor driver, partition 773, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:30:07 TaskSetManager: INFO: Finished task 772.0 in stage 1.0 (TID 773) in 65122 ms on localhost (executor driver) (773/882) 2020-02-15 01:30:07 Executor: INFO: Running task 773.0 in stage 1.0 (TID 774) 2020-02-15 01:30:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25937575936+33554432 2020-02-15 01:30:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:31:04 Executor: INFO: Finished task 773.0 in stage 1.0 (TID 774). 1638 bytes result sent to driver 2020-02-15 01:31:04 TaskSetManager: INFO: Starting task 774.0 in stage 1.0 (TID 775, localhost, executor driver, partition 774, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:31:04 TaskSetManager: INFO: Finished task 773.0 in stage 1.0 (TID 774) in 56339 ms on localhost (executor driver) (774/882) 2020-02-15 01:31:04 Executor: INFO: Running task 774.0 in stage 1.0 (TID 775) 2020-02-15 01:31:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:25971130368+33554432 2020-02-15 01:31:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:31:57 Executor: INFO: Finished task 774.0 in stage 1.0 (TID 775). 1624 bytes result sent to driver 2020-02-15 01:31:57 TaskSetManager: INFO: Starting task 775.0 in stage 1.0 (TID 776, localhost, executor driver, partition 775, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:31:57 TaskSetManager: INFO: Finished task 774.0 in stage 1.0 (TID 775) in 53473 ms on localhost (executor driver) (775/882) 2020-02-15 01:31:57 Executor: INFO: Running task 775.0 in stage 1.0 (TID 776) 2020-02-15 01:31:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26004684800+33554432 2020-02-15 01:31:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:32:48 Executor: INFO: Finished task 775.0 in stage 1.0 (TID 776). 1624 bytes result sent to driver 2020-02-15 01:32:48 TaskSetManager: INFO: Starting task 776.0 in stage 1.0 (TID 777, localhost, executor driver, partition 776, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:32:48 TaskSetManager: INFO: Finished task 775.0 in stage 1.0 (TID 776) in 51077 ms on localhost (executor driver) (776/882) 2020-02-15 01:32:48 Executor: INFO: Running task 776.0 in stage 1.0 (TID 777) 2020-02-15 01:32:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26038239232+33554432 2020-02-15 01:32:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:33:44 Executor: INFO: Finished task 776.0 in stage 1.0 (TID 777). 1624 bytes result sent to driver 2020-02-15 01:33:44 TaskSetManager: INFO: Starting task 777.0 in stage 1.0 (TID 778, localhost, executor driver, partition 777, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:33:44 TaskSetManager: INFO: Finished task 776.0 in stage 1.0 (TID 777) in 56170 ms on localhost (executor driver) (777/882) 2020-02-15 01:33:44 Executor: INFO: Running task 777.0 in stage 1.0 (TID 778) 2020-02-15 01:33:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26071793664+33554432 2020-02-15 01:33:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:34:46 Executor: INFO: Finished task 777.0 in stage 1.0 (TID 778). 1651 bytes result sent to driver 2020-02-15 01:34:46 TaskSetManager: INFO: Starting task 778.0 in stage 1.0 (TID 779, localhost, executor driver, partition 778, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:34:46 TaskSetManager: INFO: Finished task 777.0 in stage 1.0 (TID 778) in 61871 ms on localhost (executor driver) (778/882) 2020-02-15 01:34:46 Executor: INFO: Running task 778.0 in stage 1.0 (TID 779) 2020-02-15 01:34:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26105348096+33554432 2020-02-15 01:34:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:35:47 Executor: INFO: Finished task 778.0 in stage 1.0 (TID 779). 1624 bytes result sent to driver 2020-02-15 01:35:47 TaskSetManager: INFO: Starting task 779.0 in stage 1.0 (TID 780, localhost, executor driver, partition 779, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:35:47 TaskSetManager: INFO: Finished task 778.0 in stage 1.0 (TID 779) in 61032 ms on localhost (executor driver) (779/882) 2020-02-15 01:35:47 Executor: INFO: Running task 779.0 in stage 1.0 (TID 780) 2020-02-15 01:35:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26138902528+33554432 2020-02-15 01:35:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:36:34 Executor: INFO: Finished task 779.0 in stage 1.0 (TID 780). 1635 bytes result sent to driver 2020-02-15 01:36:34 TaskSetManager: INFO: Starting task 780.0 in stage 1.0 (TID 781, localhost, executor driver, partition 780, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:36:34 TaskSetManager: INFO: Finished task 779.0 in stage 1.0 (TID 780) in 47243 ms on localhost (executor driver) (780/882) 2020-02-15 01:36:34 Executor: INFO: Running task 780.0 in stage 1.0 (TID 781) 2020-02-15 01:36:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26172456960+33554432 2020-02-15 01:36:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:37:11 Executor: INFO: Finished task 780.0 in stage 1.0 (TID 781). 1634 bytes result sent to driver 2020-02-15 01:37:11 TaskSetManager: INFO: Starting task 781.0 in stage 1.0 (TID 782, localhost, executor driver, partition 781, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:37:11 TaskSetManager: INFO: Finished task 780.0 in stage 1.0 (TID 781) in 36992 ms on localhost (executor driver) (781/882) 2020-02-15 01:37:11 Executor: INFO: Running task 781.0 in stage 1.0 (TID 782) 2020-02-15 01:37:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26206011392+33554432 2020-02-15 01:37:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:37:55 Executor: INFO: Finished task 781.0 in stage 1.0 (TID 782). 1625 bytes result sent to driver 2020-02-15 01:37:55 TaskSetManager: INFO: Starting task 782.0 in stage 1.0 (TID 783, localhost, executor driver, partition 782, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:37:55 TaskSetManager: INFO: Finished task 781.0 in stage 1.0 (TID 782) in 43514 ms on localhost (executor driver) (782/882) 2020-02-15 01:37:55 Executor: INFO: Running task 782.0 in stage 1.0 (TID 783) 2020-02-15 01:37:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26239565824+33554432 2020-02-15 01:37:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:38:49 Executor: INFO: Finished task 782.0 in stage 1.0 (TID 783). 1633 bytes result sent to driver 2020-02-15 01:38:49 TaskSetManager: INFO: Starting task 783.0 in stage 1.0 (TID 784, localhost, executor driver, partition 783, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:38:49 TaskSetManager: INFO: Finished task 782.0 in stage 1.0 (TID 783) in 54243 ms on localhost (executor driver) (783/882) 2020-02-15 01:38:49 Executor: INFO: Running task 783.0 in stage 1.0 (TID 784) 2020-02-15 01:38:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26273120256+33554432 2020-02-15 01:38:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:39:51 Executor: INFO: Finished task 783.0 in stage 1.0 (TID 784). 1712 bytes result sent to driver 2020-02-15 01:39:51 TaskSetManager: INFO: Starting task 784.0 in stage 1.0 (TID 785, localhost, executor driver, partition 784, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:39:51 TaskSetManager: INFO: Finished task 783.0 in stage 1.0 (TID 784) in 61543 ms on localhost (executor driver) (784/882) 2020-02-15 01:39:51 Executor: INFO: Running task 784.0 in stage 1.0 (TID 785) 2020-02-15 01:39:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26306674688+33554432 2020-02-15 01:39:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:40:45 Executor: INFO: Finished task 784.0 in stage 1.0 (TID 785). 1721 bytes result sent to driver 2020-02-15 01:40:45 TaskSetManager: INFO: Starting task 785.0 in stage 1.0 (TID 786, localhost, executor driver, partition 785, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:40:45 TaskSetManager: INFO: Finished task 784.0 in stage 1.0 (TID 785) in 54128 ms on localhost (executor driver) (785/882) 2020-02-15 01:40:45 Executor: INFO: Running task 785.0 in stage 1.0 (TID 786) 2020-02-15 01:40:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26340229120+33554432 2020-02-15 01:40:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:41:39 Executor: INFO: Finished task 785.0 in stage 1.0 (TID 786). 1658 bytes result sent to driver 2020-02-15 01:41:39 TaskSetManager: INFO: Starting task 786.0 in stage 1.0 (TID 787, localhost, executor driver, partition 786, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:41:39 TaskSetManager: INFO: Finished task 785.0 in stage 1.0 (TID 786) in 53830 ms on localhost (executor driver) (786/882) 2020-02-15 01:41:39 Executor: INFO: Running task 786.0 in stage 1.0 (TID 787) 2020-02-15 01:41:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26373783552+33554432 2020-02-15 01:41:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:42:22 Executor: INFO: Finished task 786.0 in stage 1.0 (TID 787). 1627 bytes result sent to driver 2020-02-15 01:42:22 TaskSetManager: INFO: Starting task 787.0 in stage 1.0 (TID 788, localhost, executor driver, partition 787, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:42:22 TaskSetManager: INFO: Finished task 786.0 in stage 1.0 (TID 787) in 43456 ms on localhost (executor driver) (787/882) 2020-02-15 01:42:22 Executor: INFO: Running task 787.0 in stage 1.0 (TID 788) 2020-02-15 01:42:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26407337984+33554432 2020-02-15 01:42:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:43:07 Executor: INFO: Finished task 787.0 in stage 1.0 (TID 788). 1628 bytes result sent to driver 2020-02-15 01:43:07 TaskSetManager: INFO: Starting task 788.0 in stage 1.0 (TID 789, localhost, executor driver, partition 788, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:43:07 TaskSetManager: INFO: Finished task 787.0 in stage 1.0 (TID 788) in 44527 ms on localhost (executor driver) (788/882) 2020-02-15 01:43:07 Executor: INFO: Running task 788.0 in stage 1.0 (TID 789) 2020-02-15 01:43:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26440892416+33554432 2020-02-15 01:43:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:43:52 Executor: INFO: Finished task 788.0 in stage 1.0 (TID 789). 1633 bytes result sent to driver 2020-02-15 01:43:52 TaskSetManager: INFO: Starting task 789.0 in stage 1.0 (TID 790, localhost, executor driver, partition 789, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:43:52 TaskSetManager: INFO: Finished task 788.0 in stage 1.0 (TID 789) in 45368 ms on localhost (executor driver) (789/882) 2020-02-15 01:43:52 Executor: INFO: Running task 789.0 in stage 1.0 (TID 790) 2020-02-15 01:43:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26474446848+33554432 2020-02-15 01:43:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:44:36 Executor: INFO: Finished task 789.0 in stage 1.0 (TID 790). 1626 bytes result sent to driver 2020-02-15 01:44:36 TaskSetManager: INFO: Starting task 790.0 in stage 1.0 (TID 791, localhost, executor driver, partition 790, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:44:36 TaskSetManager: INFO: Finished task 789.0 in stage 1.0 (TID 790) in 43757 ms on localhost (executor driver) (790/882) 2020-02-15 01:44:36 Executor: INFO: Running task 790.0 in stage 1.0 (TID 791) 2020-02-15 01:44:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26508001280+33554432 2020-02-15 01:44:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:45:35 Executor: INFO: Finished task 790.0 in stage 1.0 (TID 791). 1676 bytes result sent to driver 2020-02-15 01:45:35 TaskSetManager: INFO: Starting task 791.0 in stage 1.0 (TID 792, localhost, executor driver, partition 791, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:45:35 TaskSetManager: INFO: Finished task 790.0 in stage 1.0 (TID 791) in 58904 ms on localhost (executor driver) (791/882) 2020-02-15 01:45:35 Executor: INFO: Running task 791.0 in stage 1.0 (TID 792) 2020-02-15 01:45:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26541555712+33554432 2020-02-15 01:45:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:46:33 Executor: INFO: Finished task 791.0 in stage 1.0 (TID 792). 1667 bytes result sent to driver 2020-02-15 01:46:33 TaskSetManager: INFO: Starting task 792.0 in stage 1.0 (TID 793, localhost, executor driver, partition 792, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:46:33 TaskSetManager: INFO: Finished task 791.0 in stage 1.0 (TID 792) in 58174 ms on localhost (executor driver) (792/882) 2020-02-15 01:46:33 Executor: INFO: Running task 792.0 in stage 1.0 (TID 793) 2020-02-15 01:46:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26575110144+33554432 2020-02-15 01:46:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:47:13 Executor: INFO: Finished task 792.0 in stage 1.0 (TID 793). 1767 bytes result sent to driver 2020-02-15 01:47:13 TaskSetManager: INFO: Starting task 793.0 in stage 1.0 (TID 794, localhost, executor driver, partition 793, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:47:13 TaskSetManager: INFO: Finished task 792.0 in stage 1.0 (TID 793) in 40280 ms on localhost (executor driver) (793/882) 2020-02-15 01:47:13 Executor: INFO: Running task 793.0 in stage 1.0 (TID 794) 2020-02-15 01:47:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26608664576+33554432 2020-02-15 01:47:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:47:55 Executor: INFO: Finished task 793.0 in stage 1.0 (TID 794). 1626 bytes result sent to driver 2020-02-15 01:47:55 TaskSetManager: INFO: Starting task 794.0 in stage 1.0 (TID 795, localhost, executor driver, partition 794, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:47:55 TaskSetManager: INFO: Finished task 793.0 in stage 1.0 (TID 794) in 41403 ms on localhost (executor driver) (794/882) 2020-02-15 01:47:55 Executor: INFO: Running task 794.0 in stage 1.0 (TID 795) 2020-02-15 01:47:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26642219008+33554432 2020-02-15 01:47:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:48:52 Executor: INFO: Finished task 794.0 in stage 1.0 (TID 795). 1624 bytes result sent to driver 2020-02-15 01:48:52 TaskSetManager: INFO: Starting task 795.0 in stage 1.0 (TID 796, localhost, executor driver, partition 795, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:48:52 TaskSetManager: INFO: Finished task 794.0 in stage 1.0 (TID 795) in 57040 ms on localhost (executor driver) (795/882) 2020-02-15 01:48:52 Executor: INFO: Running task 795.0 in stage 1.0 (TID 796) 2020-02-15 01:48:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26675773440+33554432 2020-02-15 01:48:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:49:46 Executor: INFO: Finished task 795.0 in stage 1.0 (TID 796). 1667 bytes result sent to driver 2020-02-15 01:49:46 TaskSetManager: INFO: Starting task 796.0 in stage 1.0 (TID 797, localhost, executor driver, partition 796, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:49:46 TaskSetManager: INFO: Finished task 795.0 in stage 1.0 (TID 796) in 54599 ms on localhost (executor driver) (796/882) 2020-02-15 01:49:46 Executor: INFO: Running task 796.0 in stage 1.0 (TID 797) 2020-02-15 01:49:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26709327872+33554432 2020-02-15 01:49:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:50:36 Executor: INFO: Finished task 796.0 in stage 1.0 (TID 797). 1680 bytes result sent to driver 2020-02-15 01:50:36 TaskSetManager: INFO: Starting task 797.0 in stage 1.0 (TID 798, localhost, executor driver, partition 797, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:50:36 TaskSetManager: INFO: Finished task 796.0 in stage 1.0 (TID 797) in 50189 ms on localhost (executor driver) (797/882) 2020-02-15 01:50:36 Executor: INFO: Running task 797.0 in stage 1.0 (TID 798) 2020-02-15 01:50:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26742882304+33554432 2020-02-15 01:50:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:51:40 Executor: INFO: Finished task 797.0 in stage 1.0 (TID 798). 1624 bytes result sent to driver 2020-02-15 01:51:40 TaskSetManager: INFO: Starting task 798.0 in stage 1.0 (TID 799, localhost, executor driver, partition 798, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:51:40 TaskSetManager: INFO: Finished task 797.0 in stage 1.0 (TID 798) in 64026 ms on localhost (executor driver) (798/882) 2020-02-15 01:51:40 Executor: INFO: Running task 798.0 in stage 1.0 (TID 799) 2020-02-15 01:51:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26776436736+33554432 2020-02-15 01:51:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:52:26 Executor: INFO: Finished task 798.0 in stage 1.0 (TID 799). 1638 bytes result sent to driver 2020-02-15 01:52:26 TaskSetManager: INFO: Starting task 799.0 in stage 1.0 (TID 800, localhost, executor driver, partition 799, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:52:26 TaskSetManager: INFO: Finished task 798.0 in stage 1.0 (TID 799) in 45266 ms on localhost (executor driver) (799/882) 2020-02-15 01:52:26 Executor: INFO: Running task 799.0 in stage 1.0 (TID 800) 2020-02-15 01:52:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26809991168+33554432 2020-02-15 01:52:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:53:30 Executor: INFO: Finished task 799.0 in stage 1.0 (TID 800). 1624 bytes result sent to driver 2020-02-15 01:53:30 TaskSetManager: INFO: Starting task 800.0 in stage 1.0 (TID 801, localhost, executor driver, partition 800, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:53:30 TaskSetManager: INFO: Finished task 799.0 in stage 1.0 (TID 800) in 63952 ms on localhost (executor driver) (800/882) 2020-02-15 01:53:30 Executor: INFO: Running task 800.0 in stage 1.0 (TID 801) 2020-02-15 01:53:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26843545600+33554432 2020-02-15 01:53:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:54:25 Executor: INFO: Finished task 800.0 in stage 1.0 (TID 801). 1656 bytes result sent to driver 2020-02-15 01:54:25 TaskSetManager: INFO: Starting task 801.0 in stage 1.0 (TID 802, localhost, executor driver, partition 801, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:54:25 TaskSetManager: INFO: Finished task 800.0 in stage 1.0 (TID 801) in 55764 ms on localhost (executor driver) (801/882) 2020-02-15 01:54:25 Executor: INFO: Running task 801.0 in stage 1.0 (TID 802) 2020-02-15 01:54:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26877100032+33554432 2020-02-15 01:54:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:55:13 Executor: INFO: Finished task 801.0 in stage 1.0 (TID 802). 1694 bytes result sent to driver 2020-02-15 01:55:13 TaskSetManager: INFO: Starting task 802.0 in stage 1.0 (TID 803, localhost, executor driver, partition 802, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:55:13 TaskSetManager: INFO: Finished task 801.0 in stage 1.0 (TID 802) in 47171 ms on localhost (executor driver) (802/882) 2020-02-15 01:55:13 Executor: INFO: Running task 802.0 in stage 1.0 (TID 803) 2020-02-15 01:55:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26910654464+33554432 2020-02-15 01:55:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:56:02 Executor: INFO: Finished task 802.0 in stage 1.0 (TID 803). 1638 bytes result sent to driver 2020-02-15 01:56:02 TaskSetManager: INFO: Starting task 803.0 in stage 1.0 (TID 804, localhost, executor driver, partition 803, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:56:02 TaskSetManager: INFO: Finished task 802.0 in stage 1.0 (TID 803) in 49868 ms on localhost (executor driver) (803/882) 2020-02-15 01:56:02 Executor: INFO: Running task 803.0 in stage 1.0 (TID 804) 2020-02-15 01:56:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26944208896+33554432 2020-02-15 01:56:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:57:05 Executor: INFO: Finished task 803.0 in stage 1.0 (TID 804). 1878 bytes result sent to driver 2020-02-15 01:57:05 TaskSetManager: INFO: Starting task 804.0 in stage 1.0 (TID 805, localhost, executor driver, partition 804, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:57:05 TaskSetManager: INFO: Finished task 803.0 in stage 1.0 (TID 804) in 62493 ms on localhost (executor driver) (804/882) 2020-02-15 01:57:05 Executor: INFO: Running task 804.0 in stage 1.0 (TID 805) 2020-02-15 01:57:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:26977763328+33554432 2020-02-15 01:57:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:58:03 Executor: INFO: Finished task 804.0 in stage 1.0 (TID 805). 1624 bytes result sent to driver 2020-02-15 01:58:03 TaskSetManager: INFO: Starting task 805.0 in stage 1.0 (TID 806, localhost, executor driver, partition 805, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:58:03 TaskSetManager: INFO: Finished task 804.0 in stage 1.0 (TID 805) in 58458 ms on localhost (executor driver) (805/882) 2020-02-15 01:58:03 Executor: INFO: Running task 805.0 in stage 1.0 (TID 806) 2020-02-15 01:58:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27011317760+33554432 2020-02-15 01:58:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:58:53 Executor: INFO: Finished task 805.0 in stage 1.0 (TID 806). 1624 bytes result sent to driver 2020-02-15 01:58:53 TaskSetManager: INFO: Starting task 806.0 in stage 1.0 (TID 807, localhost, executor driver, partition 806, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:58:53 TaskSetManager: INFO: Finished task 805.0 in stage 1.0 (TID 806) in 49781 ms on localhost (executor driver) (806/882) 2020-02-15 01:58:53 Executor: INFO: Running task 806.0 in stage 1.0 (TID 807) 2020-02-15 01:58:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27044872192+33554432 2020-02-15 01:58:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 01:59:55 Executor: INFO: Finished task 806.0 in stage 1.0 (TID 807). 1624 bytes result sent to driver 2020-02-15 01:59:55 TaskSetManager: INFO: Starting task 807.0 in stage 1.0 (TID 808, localhost, executor driver, partition 807, PROCESS_LOCAL, 7933 bytes) 2020-02-15 01:59:55 TaskSetManager: INFO: Finished task 806.0 in stage 1.0 (TID 807) in 61572 ms on localhost (executor driver) (807/882) 2020-02-15 01:59:55 Executor: INFO: Running task 807.0 in stage 1.0 (TID 808) 2020-02-15 01:59:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27078426624+33554432 2020-02-15 01:59:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:00:30 Executor: INFO: Finished task 807.0 in stage 1.0 (TID 808). 1627 bytes result sent to driver 2020-02-15 02:00:30 TaskSetManager: INFO: Starting task 808.0 in stage 1.0 (TID 809, localhost, executor driver, partition 808, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:00:30 TaskSetManager: INFO: Finished task 807.0 in stage 1.0 (TID 808) in 35235 ms on localhost (executor driver) (808/882) 2020-02-15 02:00:30 Executor: INFO: Running task 808.0 in stage 1.0 (TID 809) 2020-02-15 02:00:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27111981056+33554432 2020-02-15 02:00:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:01:24 Executor: INFO: Finished task 808.0 in stage 1.0 (TID 809). 1627 bytes result sent to driver 2020-02-15 02:01:24 TaskSetManager: INFO: Starting task 809.0 in stage 1.0 (TID 810, localhost, executor driver, partition 809, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:01:24 TaskSetManager: INFO: Finished task 808.0 in stage 1.0 (TID 809) in 53790 ms on localhost (executor driver) (809/882) 2020-02-15 02:01:24 Executor: INFO: Running task 809.0 in stage 1.0 (TID 810) 2020-02-15 02:01:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27145535488+33554432 2020-02-15 02:01:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:02:17 Executor: INFO: Finished task 809.0 in stage 1.0 (TID 810). 1644 bytes result sent to driver 2020-02-15 02:02:17 TaskSetManager: INFO: Starting task 810.0 in stage 1.0 (TID 811, localhost, executor driver, partition 810, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:02:17 TaskSetManager: INFO: Finished task 809.0 in stage 1.0 (TID 810) in 53120 ms on localhost (executor driver) (810/882) 2020-02-15 02:02:17 Executor: INFO: Running task 810.0 in stage 1.0 (TID 811) 2020-02-15 02:02:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27179089920+33554432 2020-02-15 02:02:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:03:15 Executor: INFO: Finished task 810.0 in stage 1.0 (TID 811). 1624 bytes result sent to driver 2020-02-15 02:03:15 TaskSetManager: INFO: Starting task 811.0 in stage 1.0 (TID 812, localhost, executor driver, partition 811, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:03:15 TaskSetManager: INFO: Finished task 810.0 in stage 1.0 (TID 811) in 58351 ms on localhost (executor driver) (811/882) 2020-02-15 02:03:15 Executor: INFO: Running task 811.0 in stage 1.0 (TID 812) 2020-02-15 02:03:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27212644352+33554432 2020-02-15 02:03:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:04:15 Executor: INFO: Finished task 811.0 in stage 1.0 (TID 812). 1624 bytes result sent to driver 2020-02-15 02:04:15 TaskSetManager: INFO: Starting task 812.0 in stage 1.0 (TID 813, localhost, executor driver, partition 812, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:04:15 TaskSetManager: INFO: Finished task 811.0 in stage 1.0 (TID 812) in 59707 ms on localhost (executor driver) (812/882) 2020-02-15 02:04:15 Executor: INFO: Running task 812.0 in stage 1.0 (TID 813) 2020-02-15 02:04:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27246198784+33554432 2020-02-15 02:04:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:05:07 Executor: INFO: Finished task 812.0 in stage 1.0 (TID 813). 1636 bytes result sent to driver 2020-02-15 02:05:07 TaskSetManager: INFO: Starting task 813.0 in stage 1.0 (TID 814, localhost, executor driver, partition 813, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:05:07 TaskSetManager: INFO: Finished task 812.0 in stage 1.0 (TID 813) in 52258 ms on localhost (executor driver) (813/882) 2020-02-15 02:05:07 Executor: INFO: Running task 813.0 in stage 1.0 (TID 814) 2020-02-15 02:05:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27279753216+33554432 2020-02-15 02:05:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:06:06 Executor: INFO: Finished task 813.0 in stage 1.0 (TID 814). 1645 bytes result sent to driver 2020-02-15 02:06:06 TaskSetManager: INFO: Starting task 814.0 in stage 1.0 (TID 815, localhost, executor driver, partition 814, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:06:06 TaskSetManager: INFO: Finished task 813.0 in stage 1.0 (TID 814) in 58984 ms on localhost (executor driver) (814/882) 2020-02-15 02:06:06 Executor: INFO: Running task 814.0 in stage 1.0 (TID 815) 2020-02-15 02:06:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27313307648+33554432 2020-02-15 02:06:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:07:08 Executor: INFO: Finished task 814.0 in stage 1.0 (TID 815). 1671 bytes result sent to driver 2020-02-15 02:07:08 TaskSetManager: INFO: Starting task 815.0 in stage 1.0 (TID 816, localhost, executor driver, partition 815, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:07:08 TaskSetManager: INFO: Finished task 814.0 in stage 1.0 (TID 815) in 62285 ms on localhost (executor driver) (815/882) 2020-02-15 02:07:08 Executor: INFO: Running task 815.0 in stage 1.0 (TID 816) 2020-02-15 02:07:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27346862080+33554432 2020-02-15 02:07:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:08:04 Executor: INFO: Finished task 815.0 in stage 1.0 (TID 816). 1667 bytes result sent to driver 2020-02-15 02:08:04 TaskSetManager: INFO: Starting task 816.0 in stage 1.0 (TID 817, localhost, executor driver, partition 816, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:08:04 TaskSetManager: INFO: Finished task 815.0 in stage 1.0 (TID 816) in 55698 ms on localhost (executor driver) (816/882) 2020-02-15 02:08:04 Executor: INFO: Running task 816.0 in stage 1.0 (TID 817) 2020-02-15 02:08:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27380416512+33554432 2020-02-15 02:08:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:09:05 Executor: INFO: Finished task 816.0 in stage 1.0 (TID 817). 1624 bytes result sent to driver 2020-02-15 02:09:05 TaskSetManager: INFO: Starting task 817.0 in stage 1.0 (TID 818, localhost, executor driver, partition 817, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:09:05 TaskSetManager: INFO: Finished task 816.0 in stage 1.0 (TID 817) in 60578 ms on localhost (executor driver) (817/882) 2020-02-15 02:09:05 Executor: INFO: Running task 817.0 in stage 1.0 (TID 818) 2020-02-15 02:09:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27413970944+33554432 2020-02-15 02:09:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:10:08 Executor: INFO: Finished task 817.0 in stage 1.0 (TID 818). 1624 bytes result sent to driver 2020-02-15 02:10:08 TaskSetManager: INFO: Starting task 818.0 in stage 1.0 (TID 819, localhost, executor driver, partition 818, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:10:08 TaskSetManager: INFO: Finished task 817.0 in stage 1.0 (TID 818) in 63106 ms on localhost (executor driver) (818/882) 2020-02-15 02:10:08 Executor: INFO: Running task 818.0 in stage 1.0 (TID 819) 2020-02-15 02:10:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27447525376+33554432 2020-02-15 02:10:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:11:04 Executor: INFO: Finished task 818.0 in stage 1.0 (TID 819). 1624 bytes result sent to driver 2020-02-15 02:11:04 TaskSetManager: INFO: Starting task 819.0 in stage 1.0 (TID 820, localhost, executor driver, partition 819, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:11:04 TaskSetManager: INFO: Finished task 818.0 in stage 1.0 (TID 819) in 55977 ms on localhost (executor driver) (819/882) 2020-02-15 02:11:04 Executor: INFO: Running task 819.0 in stage 1.0 (TID 820) 2020-02-15 02:11:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27481079808+33554432 2020-02-15 02:11:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:12:02 Executor: INFO: Finished task 819.0 in stage 1.0 (TID 820). 1692 bytes result sent to driver 2020-02-15 02:12:02 TaskSetManager: INFO: Starting task 820.0 in stage 1.0 (TID 821, localhost, executor driver, partition 820, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:12:02 TaskSetManager: INFO: Finished task 819.0 in stage 1.0 (TID 820) in 58006 ms on localhost (executor driver) (820/882) 2020-02-15 02:12:02 Executor: INFO: Running task 820.0 in stage 1.0 (TID 821) 2020-02-15 02:12:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27514634240+33554432 2020-02-15 02:12:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:12:59 Executor: INFO: Finished task 820.0 in stage 1.0 (TID 821). 1624 bytes result sent to driver 2020-02-15 02:12:59 TaskSetManager: INFO: Starting task 821.0 in stage 1.0 (TID 822, localhost, executor driver, partition 821, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:12:59 TaskSetManager: INFO: Finished task 820.0 in stage 1.0 (TID 821) in 57223 ms on localhost (executor driver) (821/882) 2020-02-15 02:12:59 Executor: INFO: Running task 821.0 in stage 1.0 (TID 822) 2020-02-15 02:12:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27548188672+33554432 2020-02-15 02:12:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:13:45 Executor: INFO: Finished task 821.0 in stage 1.0 (TID 822). 1648 bytes result sent to driver 2020-02-15 02:13:45 TaskSetManager: INFO: Starting task 822.0 in stage 1.0 (TID 823, localhost, executor driver, partition 822, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:13:45 TaskSetManager: INFO: Finished task 821.0 in stage 1.0 (TID 822) in 45778 ms on localhost (executor driver) (822/882) 2020-02-15 02:13:45 Executor: INFO: Running task 822.0 in stage 1.0 (TID 823) 2020-02-15 02:13:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27581743104+33554432 2020-02-15 02:13:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:14:28 Executor: INFO: Finished task 822.0 in stage 1.0 (TID 823). 1632 bytes result sent to driver 2020-02-15 02:14:28 TaskSetManager: INFO: Starting task 823.0 in stage 1.0 (TID 824, localhost, executor driver, partition 823, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:14:28 TaskSetManager: INFO: Finished task 822.0 in stage 1.0 (TID 823) in 43019 ms on localhost (executor driver) (823/882) 2020-02-15 02:14:28 Executor: INFO: Running task 823.0 in stage 1.0 (TID 824) 2020-02-15 02:14:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27615297536+33554432 2020-02-15 02:14:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:15:08 Executor: INFO: Finished task 823.0 in stage 1.0 (TID 824). 1624 bytes result sent to driver 2020-02-15 02:15:08 TaskSetManager: INFO: Starting task 824.0 in stage 1.0 (TID 825, localhost, executor driver, partition 824, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:15:08 TaskSetManager: INFO: Finished task 823.0 in stage 1.0 (TID 824) in 40639 ms on localhost (executor driver) (824/882) 2020-02-15 02:15:08 Executor: INFO: Running task 824.0 in stage 1.0 (TID 825) 2020-02-15 02:15:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27648851968+33554432 2020-02-15 02:15:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:15:52 Executor: INFO: Finished task 824.0 in stage 1.0 (TID 825). 1672 bytes result sent to driver 2020-02-15 02:15:52 TaskSetManager: INFO: Starting task 825.0 in stage 1.0 (TID 826, localhost, executor driver, partition 825, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:15:52 TaskSetManager: INFO: Finished task 824.0 in stage 1.0 (TID 825) in 44045 ms on localhost (executor driver) (825/882) 2020-02-15 02:15:52 Executor: INFO: Running task 825.0 in stage 1.0 (TID 826) 2020-02-15 02:15:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27682406400+33554432 2020-02-15 02:15:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:16:39 Executor: INFO: Finished task 825.0 in stage 1.0 (TID 826). 1627 bytes result sent to driver 2020-02-15 02:16:39 TaskSetManager: INFO: Starting task 826.0 in stage 1.0 (TID 827, localhost, executor driver, partition 826, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:16:39 TaskSetManager: INFO: Finished task 825.0 in stage 1.0 (TID 826) in 46955 ms on localhost (executor driver) (826/882) 2020-02-15 02:16:39 Executor: INFO: Running task 826.0 in stage 1.0 (TID 827) 2020-02-15 02:16:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27715960832+33554432 2020-02-15 02:16:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:17:25 Executor: INFO: Finished task 826.0 in stage 1.0 (TID 827). 1715 bytes result sent to driver 2020-02-15 02:17:25 TaskSetManager: INFO: Starting task 827.0 in stage 1.0 (TID 828, localhost, executor driver, partition 827, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:17:25 TaskSetManager: INFO: Finished task 826.0 in stage 1.0 (TID 827) in 45255 ms on localhost (executor driver) (827/882) 2020-02-15 02:17:25 Executor: INFO: Running task 827.0 in stage 1.0 (TID 828) 2020-02-15 02:17:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27749515264+33554432 2020-02-15 02:17:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:18:11 Executor: INFO: Finished task 827.0 in stage 1.0 (TID 828). 1625 bytes result sent to driver 2020-02-15 02:18:11 TaskSetManager: INFO: Starting task 828.0 in stage 1.0 (TID 829, localhost, executor driver, partition 828, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:18:11 TaskSetManager: INFO: Finished task 827.0 in stage 1.0 (TID 828) in 46206 ms on localhost (executor driver) (828/882) 2020-02-15 02:18:11 Executor: INFO: Running task 828.0 in stage 1.0 (TID 829) 2020-02-15 02:18:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27783069696+33554432 2020-02-15 02:18:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:18:50 Executor: INFO: Finished task 828.0 in stage 1.0 (TID 829). 1625 bytes result sent to driver 2020-02-15 02:18:50 TaskSetManager: INFO: Starting task 829.0 in stage 1.0 (TID 830, localhost, executor driver, partition 829, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:18:50 TaskSetManager: INFO: Finished task 828.0 in stage 1.0 (TID 829) in 39265 ms on localhost (executor driver) (829/882) 2020-02-15 02:18:50 Executor: INFO: Running task 829.0 in stage 1.0 (TID 830) 2020-02-15 02:18:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27816624128+33554432 2020-02-15 02:18:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:19:40 Executor: INFO: Finished task 829.0 in stage 1.0 (TID 830). 1669 bytes result sent to driver 2020-02-15 02:19:40 TaskSetManager: INFO: Starting task 830.0 in stage 1.0 (TID 831, localhost, executor driver, partition 830, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:19:40 TaskSetManager: INFO: Finished task 829.0 in stage 1.0 (TID 830) in 49903 ms on localhost (executor driver) (830/882) 2020-02-15 02:19:40 Executor: INFO: Running task 830.0 in stage 1.0 (TID 831) 2020-02-15 02:19:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27850178560+33554432 2020-02-15 02:19:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:20:28 Executor: INFO: Finished task 830.0 in stage 1.0 (TID 831). 1626 bytes result sent to driver 2020-02-15 02:20:28 TaskSetManager: INFO: Starting task 831.0 in stage 1.0 (TID 832, localhost, executor driver, partition 831, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:20:28 TaskSetManager: INFO: Finished task 830.0 in stage 1.0 (TID 831) in 47949 ms on localhost (executor driver) (831/882) 2020-02-15 02:20:28 Executor: INFO: Running task 831.0 in stage 1.0 (TID 832) 2020-02-15 02:20:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27883732992+33554432 2020-02-15 02:20:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:21:17 Executor: INFO: Finished task 831.0 in stage 1.0 (TID 832). 1667 bytes result sent to driver 2020-02-15 02:21:17 TaskSetManager: INFO: Starting task 832.0 in stage 1.0 (TID 833, localhost, executor driver, partition 832, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:21:17 TaskSetManager: INFO: Finished task 831.0 in stage 1.0 (TID 832) in 49273 ms on localhost (executor driver) (832/882) 2020-02-15 02:21:17 Executor: INFO: Running task 832.0 in stage 1.0 (TID 833) 2020-02-15 02:21:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27917287424+33554432 2020-02-15 02:21:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:22:11 Executor: INFO: Finished task 832.0 in stage 1.0 (TID 833). 1624 bytes result sent to driver 2020-02-15 02:22:11 TaskSetManager: INFO: Starting task 833.0 in stage 1.0 (TID 834, localhost, executor driver, partition 833, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:22:11 TaskSetManager: INFO: Finished task 832.0 in stage 1.0 (TID 833) in 53740 ms on localhost (executor driver) (833/882) 2020-02-15 02:22:11 Executor: INFO: Running task 833.0 in stage 1.0 (TID 834) 2020-02-15 02:22:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27950841856+33554432 2020-02-15 02:22:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:23:01 Executor: INFO: Finished task 833.0 in stage 1.0 (TID 834). 1624 bytes result sent to driver 2020-02-15 02:23:01 TaskSetManager: INFO: Starting task 834.0 in stage 1.0 (TID 835, localhost, executor driver, partition 834, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:23:01 TaskSetManager: INFO: Finished task 833.0 in stage 1.0 (TID 834) in 49839 ms on localhost (executor driver) (834/882) 2020-02-15 02:23:01 Executor: INFO: Running task 834.0 in stage 1.0 (TID 835) 2020-02-15 02:23:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:27984396288+33554432 2020-02-15 02:23:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:24:00 Executor: INFO: Finished task 834.0 in stage 1.0 (TID 835). 1648 bytes result sent to driver 2020-02-15 02:24:00 TaskSetManager: INFO: Starting task 835.0 in stage 1.0 (TID 836, localhost, executor driver, partition 835, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:24:00 TaskSetManager: INFO: Finished task 834.0 in stage 1.0 (TID 835) in 58823 ms on localhost (executor driver) (835/882) 2020-02-15 02:24:00 Executor: INFO: Running task 835.0 in stage 1.0 (TID 836) 2020-02-15 02:24:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28017950720+33554432 2020-02-15 02:24:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:25:02 Executor: INFO: Finished task 835.0 in stage 1.0 (TID 836). 1626 bytes result sent to driver 2020-02-15 02:25:02 TaskSetManager: INFO: Starting task 836.0 in stage 1.0 (TID 837, localhost, executor driver, partition 836, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:25:02 TaskSetManager: INFO: Finished task 835.0 in stage 1.0 (TID 836) in 62731 ms on localhost (executor driver) (836/882) 2020-02-15 02:25:02 Executor: INFO: Running task 836.0 in stage 1.0 (TID 837) 2020-02-15 02:25:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28051505152+33554432 2020-02-15 02:25:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:25:57 Executor: INFO: Finished task 836.0 in stage 1.0 (TID 837). 1624 bytes result sent to driver 2020-02-15 02:25:57 TaskSetManager: INFO: Starting task 837.0 in stage 1.0 (TID 838, localhost, executor driver, partition 837, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:25:57 TaskSetManager: INFO: Finished task 836.0 in stage 1.0 (TID 837) in 54633 ms on localhost (executor driver) (837/882) 2020-02-15 02:25:57 Executor: INFO: Running task 837.0 in stage 1.0 (TID 838) 2020-02-15 02:25:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28085059584+33554432 2020-02-15 02:25:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:26:52 Executor: INFO: Finished task 837.0 in stage 1.0 (TID 838). 1629 bytes result sent to driver 2020-02-15 02:26:52 TaskSetManager: INFO: Starting task 838.0 in stage 1.0 (TID 839, localhost, executor driver, partition 838, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:26:52 TaskSetManager: INFO: Finished task 837.0 in stage 1.0 (TID 838) in 55150 ms on localhost (executor driver) (838/882) 2020-02-15 02:26:52 Executor: INFO: Running task 838.0 in stage 1.0 (TID 839) 2020-02-15 02:26:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28118614016+33554432 2020-02-15 02:26:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:27:51 Executor: INFO: Finished task 838.0 in stage 1.0 (TID 839). 1636 bytes result sent to driver 2020-02-15 02:27:51 TaskSetManager: INFO: Starting task 839.0 in stage 1.0 (TID 840, localhost, executor driver, partition 839, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:27:51 TaskSetManager: INFO: Finished task 838.0 in stage 1.0 (TID 839) in 59070 ms on localhost (executor driver) (839/882) 2020-02-15 02:27:51 Executor: INFO: Running task 839.0 in stage 1.0 (TID 840) 2020-02-15 02:27:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28152168448+33554432 2020-02-15 02:27:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:28:50 Executor: INFO: Finished task 839.0 in stage 1.0 (TID 840). 1644 bytes result sent to driver 2020-02-15 02:28:50 TaskSetManager: INFO: Starting task 840.0 in stage 1.0 (TID 841, localhost, executor driver, partition 840, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:28:50 TaskSetManager: INFO: Finished task 839.0 in stage 1.0 (TID 840) in 58886 ms on localhost (executor driver) (840/882) 2020-02-15 02:28:50 Executor: INFO: Running task 840.0 in stage 1.0 (TID 841) 2020-02-15 02:28:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28185722880+33554432 2020-02-15 02:28:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:29:46 Executor: INFO: Finished task 840.0 in stage 1.0 (TID 841). 1715 bytes result sent to driver 2020-02-15 02:29:46 TaskSetManager: INFO: Starting task 841.0 in stage 1.0 (TID 842, localhost, executor driver, partition 841, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:29:46 TaskSetManager: INFO: Finished task 840.0 in stage 1.0 (TID 841) in 55672 ms on localhost (executor driver) (841/882) 2020-02-15 02:29:46 Executor: INFO: Running task 841.0 in stage 1.0 (TID 842) 2020-02-15 02:29:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28219277312+33554432 2020-02-15 02:29:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:30:44 Executor: INFO: Finished task 841.0 in stage 1.0 (TID 842). 1669 bytes result sent to driver 2020-02-15 02:30:44 TaskSetManager: INFO: Starting task 842.0 in stage 1.0 (TID 843, localhost, executor driver, partition 842, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:30:44 TaskSetManager: INFO: Finished task 841.0 in stage 1.0 (TID 842) in 58669 ms on localhost (executor driver) (842/882) 2020-02-15 02:30:44 Executor: INFO: Running task 842.0 in stage 1.0 (TID 843) 2020-02-15 02:30:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28252831744+33554432 2020-02-15 02:30:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:31:39 Executor: INFO: Finished task 842.0 in stage 1.0 (TID 843). 1624 bytes result sent to driver 2020-02-15 02:31:39 TaskSetManager: INFO: Starting task 843.0 in stage 1.0 (TID 844, localhost, executor driver, partition 843, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:31:39 TaskSetManager: INFO: Finished task 842.0 in stage 1.0 (TID 843) in 54485 ms on localhost (executor driver) (843/882) 2020-02-15 02:31:39 Executor: INFO: Running task 843.0 in stage 1.0 (TID 844) 2020-02-15 02:31:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28286386176+33554432 2020-02-15 02:31:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:32:18 Executor: INFO: Finished task 843.0 in stage 1.0 (TID 844). 1678 bytes result sent to driver 2020-02-15 02:32:18 TaskSetManager: INFO: Starting task 844.0 in stage 1.0 (TID 845, localhost, executor driver, partition 844, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:32:18 TaskSetManager: INFO: Finished task 843.0 in stage 1.0 (TID 844) in 38754 ms on localhost (executor driver) (844/882) 2020-02-15 02:32:18 Executor: INFO: Running task 844.0 in stage 1.0 (TID 845) 2020-02-15 02:32:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28319940608+33554432 2020-02-15 02:32:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:33:04 Executor: INFO: Finished task 844.0 in stage 1.0 (TID 845). 1629 bytes result sent to driver 2020-02-15 02:33:04 TaskSetManager: INFO: Starting task 845.0 in stage 1.0 (TID 846, localhost, executor driver, partition 845, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:33:04 TaskSetManager: INFO: Finished task 844.0 in stage 1.0 (TID 845) in 46554 ms on localhost (executor driver) (845/882) 2020-02-15 02:33:04 Executor: INFO: Running task 845.0 in stage 1.0 (TID 846) 2020-02-15 02:33:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28353495040+33554432 2020-02-15 02:33:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:33:58 Executor: INFO: Finished task 845.0 in stage 1.0 (TID 846). 1624 bytes result sent to driver 2020-02-15 02:33:58 TaskSetManager: INFO: Starting task 846.0 in stage 1.0 (TID 847, localhost, executor driver, partition 846, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:33:58 TaskSetManager: INFO: Finished task 845.0 in stage 1.0 (TID 846) in 53279 ms on localhost (executor driver) (846/882) 2020-02-15 02:33:58 Executor: INFO: Running task 846.0 in stage 1.0 (TID 847) 2020-02-15 02:33:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28387049472+33554432 2020-02-15 02:33:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:34:48 Executor: INFO: Finished task 846.0 in stage 1.0 (TID 847). 1627 bytes result sent to driver 2020-02-15 02:34:48 TaskSetManager: INFO: Starting task 847.0 in stage 1.0 (TID 848, localhost, executor driver, partition 847, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:34:48 TaskSetManager: INFO: Finished task 846.0 in stage 1.0 (TID 847) in 50385 ms on localhost (executor driver) (847/882) 2020-02-15 02:34:48 Executor: INFO: Running task 847.0 in stage 1.0 (TID 848) 2020-02-15 02:34:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28420603904+33554432 2020-02-15 02:34:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:35:36 Executor: INFO: Finished task 847.0 in stage 1.0 (TID 848). 1624 bytes result sent to driver 2020-02-15 02:35:36 TaskSetManager: INFO: Starting task 848.0 in stage 1.0 (TID 849, localhost, executor driver, partition 848, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:35:36 TaskSetManager: INFO: Finished task 847.0 in stage 1.0 (TID 848) in 47906 ms on localhost (executor driver) (848/882) 2020-02-15 02:35:36 Executor: INFO: Running task 848.0 in stage 1.0 (TID 849) 2020-02-15 02:35:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28454158336+33554432 2020-02-15 02:35:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:36:39 Executor: INFO: Finished task 848.0 in stage 1.0 (TID 849). 1624 bytes result sent to driver 2020-02-15 02:36:39 TaskSetManager: INFO: Starting task 849.0 in stage 1.0 (TID 850, localhost, executor driver, partition 849, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:36:39 TaskSetManager: INFO: Finished task 848.0 in stage 1.0 (TID 849) in 62755 ms on localhost (executor driver) (849/882) 2020-02-15 02:36:39 Executor: INFO: Running task 849.0 in stage 1.0 (TID 850) 2020-02-15 02:36:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28487712768+33554432 2020-02-15 02:36:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:37:31 Executor: INFO: Finished task 849.0 in stage 1.0 (TID 850). 1657 bytes result sent to driver 2020-02-15 02:37:31 TaskSetManager: INFO: Starting task 850.0 in stage 1.0 (TID 851, localhost, executor driver, partition 850, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:37:31 TaskSetManager: INFO: Finished task 849.0 in stage 1.0 (TID 850) in 52484 ms on localhost (executor driver) (850/882) 2020-02-15 02:37:31 Executor: INFO: Running task 850.0 in stage 1.0 (TID 851) 2020-02-15 02:37:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28521267200+33554432 2020-02-15 02:37:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:38:13 Executor: INFO: Finished task 850.0 in stage 1.0 (TID 851). 1624 bytes result sent to driver 2020-02-15 02:38:13 TaskSetManager: INFO: Starting task 851.0 in stage 1.0 (TID 852, localhost, executor driver, partition 851, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:38:13 TaskSetManager: INFO: Finished task 850.0 in stage 1.0 (TID 851) in 41962 ms on localhost (executor driver) (851/882) 2020-02-15 02:38:13 Executor: INFO: Running task 851.0 in stage 1.0 (TID 852) 2020-02-15 02:38:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28554821632+33554432 2020-02-15 02:38:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:39:08 Executor: INFO: Finished task 851.0 in stage 1.0 (TID 852). 1650 bytes result sent to driver 2020-02-15 02:39:08 TaskSetManager: INFO: Starting task 852.0 in stage 1.0 (TID 853, localhost, executor driver, partition 852, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:39:08 TaskSetManager: INFO: Finished task 851.0 in stage 1.0 (TID 852) in 55356 ms on localhost (executor driver) (852/882) 2020-02-15 02:39:08 Executor: INFO: Running task 852.0 in stage 1.0 (TID 853) 2020-02-15 02:39:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28588376064+33554432 2020-02-15 02:39:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:40:10 Executor: INFO: Finished task 852.0 in stage 1.0 (TID 853). 1674 bytes result sent to driver 2020-02-15 02:40:10 TaskSetManager: INFO: Starting task 853.0 in stage 1.0 (TID 854, localhost, executor driver, partition 853, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:40:10 TaskSetManager: INFO: Finished task 852.0 in stage 1.0 (TID 853) in 61266 ms on localhost (executor driver) (853/882) 2020-02-15 02:40:10 Executor: INFO: Running task 853.0 in stage 1.0 (TID 854) 2020-02-15 02:40:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28621930496+33554432 2020-02-15 02:40:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:41:04 Executor: INFO: Finished task 853.0 in stage 1.0 (TID 854). 1630 bytes result sent to driver 2020-02-15 02:41:04 TaskSetManager: INFO: Starting task 854.0 in stage 1.0 (TID 855, localhost, executor driver, partition 854, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:41:04 TaskSetManager: INFO: Finished task 853.0 in stage 1.0 (TID 854) in 54681 ms on localhost (executor driver) (854/882) 2020-02-15 02:41:04 Executor: INFO: Running task 854.0 in stage 1.0 (TID 855) 2020-02-15 02:41:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28655484928+33554432 2020-02-15 02:41:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:41:45 Executor: INFO: Finished task 854.0 in stage 1.0 (TID 855). 1630 bytes result sent to driver 2020-02-15 02:41:45 TaskSetManager: INFO: Starting task 855.0 in stage 1.0 (TID 856, localhost, executor driver, partition 855, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:41:45 TaskSetManager: INFO: Finished task 854.0 in stage 1.0 (TID 855) in 40375 ms on localhost (executor driver) (855/882) 2020-02-15 02:41:45 Executor: INFO: Running task 855.0 in stage 1.0 (TID 856) 2020-02-15 02:41:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28689039360+33554432 2020-02-15 02:41:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:42:43 Executor: INFO: Finished task 855.0 in stage 1.0 (TID 856). 1627 bytes result sent to driver 2020-02-15 02:42:43 TaskSetManager: INFO: Starting task 856.0 in stage 1.0 (TID 857, localhost, executor driver, partition 856, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:42:43 TaskSetManager: INFO: Finished task 855.0 in stage 1.0 (TID 856) in 58708 ms on localhost (executor driver) (856/882) 2020-02-15 02:42:43 Executor: INFO: Running task 856.0 in stage 1.0 (TID 857) 2020-02-15 02:42:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28722593792+33554432 2020-02-15 02:42:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:43:31 Executor: INFO: Finished task 856.0 in stage 1.0 (TID 857). 1624 bytes result sent to driver 2020-02-15 02:43:31 TaskSetManager: INFO: Starting task 857.0 in stage 1.0 (TID 858, localhost, executor driver, partition 857, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:43:31 TaskSetManager: INFO: Finished task 856.0 in stage 1.0 (TID 857) in 47853 ms on localhost (executor driver) (857/882) 2020-02-15 02:43:31 Executor: INFO: Running task 857.0 in stage 1.0 (TID 858) 2020-02-15 02:43:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28756148224+33554432 2020-02-15 02:43:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:44:26 Executor: INFO: Finished task 857.0 in stage 1.0 (TID 858). 1667 bytes result sent to driver 2020-02-15 02:44:26 TaskSetManager: INFO: Starting task 858.0 in stage 1.0 (TID 859, localhost, executor driver, partition 858, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:44:26 TaskSetManager: INFO: Finished task 857.0 in stage 1.0 (TID 858) in 54780 ms on localhost (executor driver) (858/882) 2020-02-15 02:44:26 Executor: INFO: Running task 858.0 in stage 1.0 (TID 859) 2020-02-15 02:44:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28789702656+33554432 2020-02-15 02:44:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:45:27 Executor: INFO: Finished task 858.0 in stage 1.0 (TID 859). 1624 bytes result sent to driver 2020-02-15 02:45:27 TaskSetManager: INFO: Starting task 859.0 in stage 1.0 (TID 860, localhost, executor driver, partition 859, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:45:27 TaskSetManager: INFO: Finished task 858.0 in stage 1.0 (TID 859) in 61368 ms on localhost (executor driver) (859/882) 2020-02-15 02:45:27 Executor: INFO: Running task 859.0 in stage 1.0 (TID 860) 2020-02-15 02:45:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28823257088+33554432 2020-02-15 02:45:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:46:09 Executor: INFO: Finished task 859.0 in stage 1.0 (TID 860). 1624 bytes result sent to driver 2020-02-15 02:46:09 TaskSetManager: INFO: Starting task 860.0 in stage 1.0 (TID 861, localhost, executor driver, partition 860, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:46:09 TaskSetManager: INFO: Finished task 859.0 in stage 1.0 (TID 860) in 41452 ms on localhost (executor driver) (860/882) 2020-02-15 02:46:09 Executor: INFO: Running task 860.0 in stage 1.0 (TID 861) 2020-02-15 02:46:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28856811520+33554432 2020-02-15 02:46:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:46:59 Executor: INFO: Finished task 860.0 in stage 1.0 (TID 861). 1624 bytes result sent to driver 2020-02-15 02:46:59 TaskSetManager: INFO: Starting task 861.0 in stage 1.0 (TID 862, localhost, executor driver, partition 861, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:46:59 TaskSetManager: INFO: Finished task 860.0 in stage 1.0 (TID 861) in 50017 ms on localhost (executor driver) (861/882) 2020-02-15 02:46:59 Executor: INFO: Running task 861.0 in stage 1.0 (TID 862) 2020-02-15 02:46:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28890365952+33554432 2020-02-15 02:46:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:47:43 Executor: INFO: Finished task 861.0 in stage 1.0 (TID 862). 1673 bytes result sent to driver 2020-02-15 02:47:43 TaskSetManager: INFO: Starting task 862.0 in stage 1.0 (TID 863, localhost, executor driver, partition 862, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:47:43 TaskSetManager: INFO: Finished task 861.0 in stage 1.0 (TID 862) in 43604 ms on localhost (executor driver) (862/882) 2020-02-15 02:47:43 Executor: INFO: Running task 862.0 in stage 1.0 (TID 863) 2020-02-15 02:47:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28923920384+33554432 2020-02-15 02:47:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:48:30 Executor: INFO: Finished task 862.0 in stage 1.0 (TID 863). 1695 bytes result sent to driver 2020-02-15 02:48:30 TaskSetManager: INFO: Starting task 863.0 in stage 1.0 (TID 864, localhost, executor driver, partition 863, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:48:30 TaskSetManager: INFO: Finished task 862.0 in stage 1.0 (TID 863) in 47007 ms on localhost (executor driver) (863/882) 2020-02-15 02:48:30 Executor: INFO: Running task 863.0 in stage 1.0 (TID 864) 2020-02-15 02:48:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28957474816+33554432 2020-02-15 02:48:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:49:04 Executor: INFO: Finished task 863.0 in stage 1.0 (TID 864). 1662 bytes result sent to driver 2020-02-15 02:49:04 TaskSetManager: INFO: Starting task 864.0 in stage 1.0 (TID 865, localhost, executor driver, partition 864, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:49:04 TaskSetManager: INFO: Finished task 863.0 in stage 1.0 (TID 864) in 34826 ms on localhost (executor driver) (864/882) 2020-02-15 02:49:04 Executor: INFO: Running task 864.0 in stage 1.0 (TID 865) 2020-02-15 02:49:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:28991029248+33554432 2020-02-15 02:49:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:49:47 Executor: INFO: Finished task 864.0 in stage 1.0 (TID 865). 1626 bytes result sent to driver 2020-02-15 02:49:47 TaskSetManager: INFO: Starting task 865.0 in stage 1.0 (TID 866, localhost, executor driver, partition 865, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:49:47 TaskSetManager: INFO: Finished task 864.0 in stage 1.0 (TID 865) in 42830 ms on localhost (executor driver) (865/882) 2020-02-15 02:49:47 Executor: INFO: Running task 865.0 in stage 1.0 (TID 866) 2020-02-15 02:49:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29024583680+33554432 2020-02-15 02:49:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:50:39 Executor: INFO: Finished task 865.0 in stage 1.0 (TID 866). 1656 bytes result sent to driver 2020-02-15 02:50:39 TaskSetManager: INFO: Starting task 866.0 in stage 1.0 (TID 867, localhost, executor driver, partition 866, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:50:39 TaskSetManager: INFO: Finished task 865.0 in stage 1.0 (TID 866) in 51517 ms on localhost (executor driver) (866/882) 2020-02-15 02:50:39 Executor: INFO: Running task 866.0 in stage 1.0 (TID 867) 2020-02-15 02:50:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29058138112+33554432 2020-02-15 02:50:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:51:31 Executor: INFO: Finished task 866.0 in stage 1.0 (TID 867). 1698 bytes result sent to driver 2020-02-15 02:51:31 TaskSetManager: INFO: Starting task 867.0 in stage 1.0 (TID 868, localhost, executor driver, partition 867, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:51:31 TaskSetManager: INFO: Finished task 866.0 in stage 1.0 (TID 867) in 52647 ms on localhost (executor driver) (867/882) 2020-02-15 02:51:31 Executor: INFO: Running task 867.0 in stage 1.0 (TID 868) 2020-02-15 02:51:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29091692544+33554432 2020-02-15 02:51:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:52:16 Executor: INFO: Finished task 867.0 in stage 1.0 (TID 868). 1760 bytes result sent to driver 2020-02-15 02:52:16 TaskSetManager: INFO: Starting task 868.0 in stage 1.0 (TID 869, localhost, executor driver, partition 868, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:52:16 TaskSetManager: INFO: Finished task 867.0 in stage 1.0 (TID 868) in 44507 ms on localhost (executor driver) (868/882) 2020-02-15 02:52:16 Executor: INFO: Running task 868.0 in stage 1.0 (TID 869) 2020-02-15 02:52:16 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29125246976+33554432 2020-02-15 02:52:16 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:52:59 Executor: INFO: Finished task 868.0 in stage 1.0 (TID 869). 1667 bytes result sent to driver 2020-02-15 02:52:59 TaskSetManager: INFO: Starting task 869.0 in stage 1.0 (TID 870, localhost, executor driver, partition 869, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:52:59 TaskSetManager: INFO: Finished task 868.0 in stage 1.0 (TID 869) in 42755 ms on localhost (executor driver) (869/882) 2020-02-15 02:52:59 Executor: INFO: Running task 869.0 in stage 1.0 (TID 870) 2020-02-15 02:52:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29158801408+33554432 2020-02-15 02:52:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:53:33 Executor: INFO: Finished task 869.0 in stage 1.0 (TID 870). 1624 bytes result sent to driver 2020-02-15 02:53:33 TaskSetManager: INFO: Starting task 870.0 in stage 1.0 (TID 871, localhost, executor driver, partition 870, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:53:33 TaskSetManager: INFO: Finished task 869.0 in stage 1.0 (TID 870) in 34465 ms on localhost (executor driver) (870/882) 2020-02-15 02:53:33 Executor: INFO: Running task 870.0 in stage 1.0 (TID 871) 2020-02-15 02:53:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29192355840+33554432 2020-02-15 02:53:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:54:21 Executor: INFO: Finished task 870.0 in stage 1.0 (TID 871). 1689 bytes result sent to driver 2020-02-15 02:54:21 TaskSetManager: INFO: Starting task 871.0 in stage 1.0 (TID 872, localhost, executor driver, partition 871, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:54:21 TaskSetManager: INFO: Finished task 870.0 in stage 1.0 (TID 871) in 48220 ms on localhost (executor driver) (871/882) 2020-02-15 02:54:21 Executor: INFO: Running task 871.0 in stage 1.0 (TID 872) 2020-02-15 02:54:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29225910272+33554432 2020-02-15 02:54:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:55:03 Executor: INFO: Finished task 871.0 in stage 1.0 (TID 872). 1703 bytes result sent to driver 2020-02-15 02:55:03 TaskSetManager: INFO: Starting task 872.0 in stage 1.0 (TID 873, localhost, executor driver, partition 872, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:55:03 TaskSetManager: INFO: Finished task 871.0 in stage 1.0 (TID 872) in 42043 ms on localhost (executor driver) (872/882) 2020-02-15 02:55:03 Executor: INFO: Running task 872.0 in stage 1.0 (TID 873) 2020-02-15 02:55:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29259464704+33554432 2020-02-15 02:55:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:55:47 Executor: INFO: Finished task 872.0 in stage 1.0 (TID 873). 1624 bytes result sent to driver 2020-02-15 02:55:47 TaskSetManager: INFO: Starting task 873.0 in stage 1.0 (TID 874, localhost, executor driver, partition 873, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:55:47 TaskSetManager: INFO: Finished task 872.0 in stage 1.0 (TID 873) in 43374 ms on localhost (executor driver) (873/882) 2020-02-15 02:55:47 Executor: INFO: Running task 873.0 in stage 1.0 (TID 874) 2020-02-15 02:55:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29293019136+33554432 2020-02-15 02:55:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:56:39 Executor: INFO: Finished task 873.0 in stage 1.0 (TID 874). 1631 bytes result sent to driver 2020-02-15 02:56:39 TaskSetManager: INFO: Starting task 874.0 in stage 1.0 (TID 875, localhost, executor driver, partition 874, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:56:39 TaskSetManager: INFO: Finished task 873.0 in stage 1.0 (TID 874) in 52082 ms on localhost (executor driver) (874/882) 2020-02-15 02:56:39 Executor: INFO: Running task 874.0 in stage 1.0 (TID 875) 2020-02-15 02:56:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29326573568+33554432 2020-02-15 02:56:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:57:29 Executor: INFO: Finished task 874.0 in stage 1.0 (TID 875). 1717 bytes result sent to driver 2020-02-15 02:57:29 TaskSetManager: INFO: Starting task 875.0 in stage 1.0 (TID 876, localhost, executor driver, partition 875, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:57:29 TaskSetManager: INFO: Finished task 874.0 in stage 1.0 (TID 875) in 50571 ms on localhost (executor driver) (875/882) 2020-02-15 02:57:29 Executor: INFO: Running task 875.0 in stage 1.0 (TID 876) 2020-02-15 02:57:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29360128000+33554432 2020-02-15 02:57:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:58:21 Executor: INFO: Finished task 875.0 in stage 1.0 (TID 876). 1663 bytes result sent to driver 2020-02-15 02:58:21 TaskSetManager: INFO: Starting task 876.0 in stage 1.0 (TID 877, localhost, executor driver, partition 876, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:58:21 TaskSetManager: INFO: Finished task 875.0 in stage 1.0 (TID 876) in 51906 ms on localhost (executor driver) (876/882) 2020-02-15 02:58:21 Executor: INFO: Running task 876.0 in stage 1.0 (TID 877) 2020-02-15 02:58:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29393682432+33554432 2020-02-15 02:58:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:59:12 Executor: INFO: Finished task 876.0 in stage 1.0 (TID 877). 1625 bytes result sent to driver 2020-02-15 02:59:12 TaskSetManager: INFO: Starting task 877.0 in stage 1.0 (TID 878, localhost, executor driver, partition 877, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:59:12 TaskSetManager: INFO: Finished task 876.0 in stage 1.0 (TID 877) in 50703 ms on localhost (executor driver) (877/882) 2020-02-15 02:59:12 Executor: INFO: Running task 877.0 in stage 1.0 (TID 878) 2020-02-15 02:59:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29427236864+33554432 2020-02-15 02:59:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 02:59:59 Executor: INFO: Finished task 877.0 in stage 1.0 (TID 878). 1652 bytes result sent to driver 2020-02-15 02:59:59 TaskSetManager: INFO: Starting task 878.0 in stage 1.0 (TID 879, localhost, executor driver, partition 878, PROCESS_LOCAL, 7933 bytes) 2020-02-15 02:59:59 TaskSetManager: INFO: Finished task 877.0 in stage 1.0 (TID 878) in 46793 ms on localhost (executor driver) (878/882) 2020-02-15 02:59:59 Executor: INFO: Running task 878.0 in stage 1.0 (TID 879) 2020-02-15 02:59:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29460791296+33554432 2020-02-15 02:59:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:00:22 Executor: INFO: Finished task 878.0 in stage 1.0 (TID 879). 1641 bytes result sent to driver 2020-02-15 03:00:22 TaskSetManager: INFO: Starting task 879.0 in stage 1.0 (TID 880, localhost, executor driver, partition 879, PROCESS_LOCAL, 7933 bytes) 2020-02-15 03:00:22 TaskSetManager: INFO: Finished task 878.0 in stage 1.0 (TID 879) in 23231 ms on localhost (executor driver) (879/882) 2020-02-15 03:00:22 Executor: INFO: Running task 879.0 in stage 1.0 (TID 880) 2020-02-15 03:00:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29494345728+33554432 2020-02-15 03:00:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:00:35 Executor: INFO: Finished task 879.0 in stage 1.0 (TID 880). 1625 bytes result sent to driver 2020-02-15 03:00:35 TaskSetManager: INFO: Starting task 880.0 in stage 1.0 (TID 881, localhost, executor driver, partition 880, PROCESS_LOCAL, 7933 bytes) 2020-02-15 03:00:35 TaskSetManager: INFO: Finished task 879.0 in stage 1.0 (TID 880) in 13093 ms on localhost (executor driver) (880/882) 2020-02-15 03:00:35 Executor: INFO: Running task 880.0 in stage 1.0 (TID 881) 2020-02-15 03:00:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29527900160+33554432 2020-02-15 03:00:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:00:57 Executor: INFO: Finished task 880.0 in stage 1.0 (TID 881). 1713 bytes result sent to driver 2020-02-15 03:00:57 TaskSetManager: INFO: Starting task 881.0 in stage 1.0 (TID 882, localhost, executor driver, partition 881, PROCESS_LOCAL, 7933 bytes) 2020-02-15 03:00:57 TaskSetManager: INFO: Finished task 880.0 in stage 1.0 (TID 881) in 22120 ms on localhost (executor driver) (881/882) 2020-02-15 03:00:57 Executor: INFO: Running task 881.0 in stage 1.0 (TID 882) 2020-02-15 03:00:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:29561454592+28803425 2020-02-15 03:00:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:01:40 Executor: INFO: Finished task 881.0 in stage 1.0 (TID 882). 1702 bytes result sent to driver 2020-02-15 03:01:40 TaskSetManager: INFO: Finished task 881.0 in stage 1.0 (TID 882) in 43251 ms on localhost (executor driver) (882/882) 2020-02-15 03:01:40 TaskSchedulerImpl: INFO: Removed TaskSet 1.0, whose tasks have all completed, from pool 2020-02-15 03:01:40 DAGScheduler: INFO: ResultStage 1 (collect at ContextRDD.scala:222) finished in 45404.125 s 2020-02-15 03:01:40 DAGScheduler: INFO: Job 1 finished: collect at ContextRDD.scala:222, took 45404.293031 s 2020-02-15 03:01:41 Hail: INFO: Coerced sorted dataset 2020-02-15 03:01:42 MemoryStore: INFO: Block broadcast_9 stored as values in memory (estimated size 2.1 MB, free 408.7 MB) 2020-02-15 03:01:42 MemoryStore: INFO: Block broadcast_9_piece0 stored as bytes in memory (estimated size 58.8 KB, free 408.7 MB) 2020-02-15 03:01:42 BlockManagerInfo: INFO: Added broadcast_9_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 58.8 KB, free: 413.5 MB) 2020-02-15 03:01:42 SparkContext: INFO: Created broadcast 9 from broadcast at RVDPartitioner.scala:87 2020-02-15 03:01:42 MemoryStore: INFO: Block broadcast_10 stored as values in memory (estimated size 390.5 KB, free 408.3 MB) 2020-02-15 03:01:42 MemoryStore: INFO: Block broadcast_10_piece0 stored as bytes in memory (estimated size 17.4 KB, free 408.3 MB) 2020-02-15 03:01:42 BlockManagerInfo: INFO: Added broadcast_10_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 17.4 KB, free: 413.4 MB) 2020-02-15 03:01:42 SparkContext: INFO: Created broadcast 10 from broadcast at RepartitionedOrderedRDD2.scala:36 2020-02-15 03:01:42 root: INFO: optimize (Compile): before: IR size 18: (InsertFields (Ref global) None (newColIdx (ArrayFilter __iruid_48 (ArrayRange (I32 0) (ArrayLen (GetField __cols (Ref global))) (I32 1)) (Coalesce (ApplyIR contains (Literal Set[String] ) (GetField s (ArrayRef (GetField __cols (Ref global)) (Ref __iruid_48)))) (False))))) 2020-02-15 03:01:42 root: INFO: optimize (Compile): after: IR size 18: (InsertFields (Ref global) None (newColIdx (ArrayFilter __iruid_84 (ArrayRange (I32 0) (ArrayLen (GetField __cols (Ref global))) (I32 1)) (Coalesce (ApplyIR contains (Literal Set[String] ) (GetField s (ArrayRef (GetField __cols (Ref global)) (Ref __iruid_84)))) (False))))) 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C1. instruction count: 3 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C1.apply instruction count: 16 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C1.apply instruction count: 13 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C1.method1 instruction count: 196 2020-02-15 03:01:42 MemoryStore: INFO: Block broadcast_11 stored as values in memory (estimated size 15.2 KB, free 408.3 MB) 2020-02-15 03:01:42 MemoryStore: INFO: Block broadcast_11_piece0 stored as bytes in memory (estimated size 6.7 KB, free 408.3 MB) 2020-02-15 03:01:42 BlockManagerInfo: INFO: Added broadcast_11_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 6.7 KB, free: 413.4 MB) 2020-02-15 03:01:42 SparkContext: INFO: Created broadcast 11 from broadcast at SparkBackend.scala:26 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0. instruction count: 3 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0.apply instruction count: 46 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0.apply instruction count: 22 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0.method_1 instruction count: 507 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0.method_2 instruction count: 496 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0.method_3 instruction count: 104 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0.method_4 instruction count: 105 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0.method_5 instruction count: 79 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0.method_6 instruction count: 37 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0.setPartitionIndex instruction count: 14 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0.method_8 instruction count: 42 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0.method_9 instruction count: 169 2020-02-15 03:01:42 root: INFO: is/hail/codegen/generated/C0.addLiterals instruction count: 29 2020-02-15 03:01:43 root: INFO: couldn't lower TableMapRows: is.hail.expr.ir.agg.UnsupportedExtraction: no scans to extract in TableMapRows 2020-02-15 03:01:43 root: INFO: initop (Begin) 2020-02-15 03:01:43 root: INFO: optimize (Compile): before: IR size 1: (Begin) 2020-02-15 03:01:43 root: INFO: optimize (Compile): after: IR size 1: (Begin) 2020-02-15 03:01:43 MemoryStore: INFO: Block broadcast_12 stored as values in memory (estimated size 40.0 B, free 408.3 MB) 2020-02-15 03:01:43 MemoryStore: INFO: Block broadcast_12_piece0 stored as bytes in memory (estimated size 45.0 B, free 408.3 MB) 2020-02-15 03:01:43 BlockManagerInfo: INFO: Added broadcast_12_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 45.0 B, free: 413.4 MB) 2020-02-15 03:01:43 SparkContext: INFO: Created broadcast 12 from broadcast at SparkBackend.scala:26 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C2. instruction count: 3 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C2.apply instruction count: 15 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C2.apply instruction count: 16 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C2.setPartitionIndex instruction count: 14 2020-02-15 03:01:43 root: INFO: seqop (Begin) 2020-02-15 03:01:43 root: INFO: optimize (Compile): before: IR size 1: (Begin) 2020-02-15 03:01:43 root: INFO: optimize (Compile): after: IR size 1: (Begin) 2020-02-15 03:01:43 MemoryStore: INFO: Block broadcast_13 stored as values in memory (estimated size 40.0 B, free 408.3 MB) 2020-02-15 03:01:43 MemoryStore: INFO: Block broadcast_13_piece0 stored as bytes in memory (estimated size 45.0 B, free 408.3 MB) 2020-02-15 03:01:43 BlockManagerInfo: INFO: Added broadcast_13_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 45.0 B, free: 413.4 MB) 2020-02-15 03:01:43 SparkContext: INFO: Created broadcast 13 from broadcast at SparkBackend.scala:26 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C3. instruction count: 3 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C3.apply instruction count: 15 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C3.apply instruction count: 22 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C3.setPartitionIndex instruction count: 14 2020-02-15 03:01:43 root: INFO: optimize (Compile): before: IR size 11: (InsertFields (Ref row) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (ArrayMap __iruid_49 (GetField newColIdx (SelectFields (__cols newColIdx) (SelectFields (__cols newColIdx) (Ref global)))) (ArrayRef (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row)) (Ref __iruid_49))))) 2020-02-15 03:01:43 root: INFO: optimize (Compile): after: IR size 9: (InsertFields (Ref row) None (`the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (ArrayMap __iruid_97 (GetField newColIdx (Ref global)) (ArrayRef (GetField `the entries! [877f12a8827e18f61222c6c8c5fb04a8]` (Ref row)) (Ref __iruid_97))))) 2020-02-15 03:01:43 MemoryStore: INFO: Block broadcast_14 stored as values in memory (estimated size 40.0 B, free 408.3 MB) 2020-02-15 03:01:43 MemoryStore: INFO: Block broadcast_14_piece0 stored as bytes in memory (estimated size 45.0 B, free 408.3 MB) 2020-02-15 03:01:43 BlockManagerInfo: INFO: Added broadcast_14_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 45.0 B, free: 413.4 MB) 2020-02-15 03:01:43 SparkContext: INFO: Created broadcast 14 from broadcast at SparkBackend.scala:26 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C4. instruction count: 3 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C4.apply instruction count: 48 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C4.apply instruction count: 28 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C4.method_1 instruction count: 550 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C4.setPartitionIndex instruction count: 14 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C5. instruction count: 3 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C5.apply instruction count: 16 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C5.apply instruction count: 13 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C5.method1 instruction count: 312 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C6. instruction count: 3 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C6.apply instruction count: 42 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C6.apply instruction count: 12 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C6.method1 instruction count: 361 2020-02-15 03:01:43 MemoryStore: INFO: Block broadcast_15 stored as values in memory (estimated size 594.7 KB, free 407.7 MB) 2020-02-15 03:01:43 MemoryStore: INFO: Block broadcast_15_piece0 stored as bytes in memory (estimated size 232.6 KB, free 407.5 MB) 2020-02-15 03:01:43 BlockManagerInfo: INFO: Added broadcast_15_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 232.6 KB, free: 413.2 MB) 2020-02-15 03:01:43 SparkContext: INFO: Created broadcast 15 from broadcast at SparkBackend.scala:26 2020-02-15 03:01:43 root: INFO: optimize (Compile): before: IR size 10: (InsertFields (SelectFields (__cols) (Ref global)) ("__cols") (__cols (ArrayMap __iruid_50 (GetField newColIdx (Ref global)) (ArrayRef (GetField __cols (Ref global)) (Ref __iruid_50))))) 2020-02-15 03:01:43 root: INFO: optimize (Compile): after: IR size 10: (InsertFields (SelectFields (__cols) (Ref global)) ("__cols") (__cols (ArrayMap __iruid_101 (GetField newColIdx (Ref global)) (ArrayRef (GetField __cols (Ref global)) (Ref __iruid_101))))) 2020-02-15 03:01:43 MemoryStore: INFO: Block broadcast_16 stored as values in memory (estimated size 40.0 B, free 407.5 MB) 2020-02-15 03:01:43 MemoryStore: INFO: Block broadcast_16_piece0 stored as bytes in memory (estimated size 45.0 B, free 407.5 MB) 2020-02-15 03:01:43 BlockManagerInfo: INFO: Added broadcast_16_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 45.0 B, free: 413.2 MB) 2020-02-15 03:01:43 SparkContext: INFO: Created broadcast 16 from broadcast at SparkBackend.scala:26 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C7. instruction count: 3 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C7.apply instruction count: 95 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C7.apply instruction count: 22 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C7.method_1 instruction count: 358 2020-02-15 03:01:43 root: INFO: is/hail/codegen/generated/C7.setPartitionIndex instruction count: 14 2020-02-15 03:01:43 deprecation: INFO: mapred.output.dir is deprecated. Instead, use mapreduce.output.fileoutputformat.outputdir 2020-02-15 03:01:43 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:01:43 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:01:43 SparkContext: INFO: Starting job: runJob at SparkHadoopWriter.scala:78 2020-02-15 03:01:43 DAGScheduler: INFO: Got job 2 (runJob at SparkHadoopWriter.scala:78) with 882 output partitions 2020-02-15 03:01:43 DAGScheduler: INFO: Final stage: ResultStage 2 (runJob at SparkHadoopWriter.scala:78) 2020-02-15 03:01:43 DAGScheduler: INFO: Parents of final stage: List() 2020-02-15 03:01:43 DAGScheduler: INFO: Missing parents: List() 2020-02-15 03:01:43 DAGScheduler: INFO: Submitting ResultStage 2 (MapPartitionsRDD[17] at saveAsTextFile at RichRDD.scala:66), which has no missing parents 2020-02-15 03:01:44 MemoryStore: INFO: Block broadcast_17 stored as values in memory (estimated size 867.5 KB, free 406.6 MB) 2020-02-15 03:01:44 MemoryStore: INFO: Block broadcast_17_piece0 stored as bytes in memory (estimated size 311.0 KB, free 406.3 MB) 2020-02-15 03:01:44 BlockManagerInfo: INFO: Added broadcast_17_piece0 in memory on uger-c006.broadinstitute.org:36093 (size: 311.0 KB, free: 412.9 MB) 2020-02-15 03:01:44 SparkContext: INFO: Created broadcast 17 from broadcast at DAGScheduler.scala:1161 2020-02-15 03:01:44 DAGScheduler: INFO: Submitting 882 missing tasks from ResultStage 2 (MapPartitionsRDD[17] at saveAsTextFile at RichRDD.scala:66) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)) 2020-02-15 03:01:44 TaskSchedulerImpl: INFO: Adding task set 2.0 with 882 tasks 2020-02-15 03:01:44 TaskSetManager: INFO: Starting task 0.0 in stage 2.0 (TID 883, localhost, executor driver, partition 0, PROCESS_LOCAL, 9321 bytes) 2020-02-15 03:01:44 Executor: INFO: Running task 0.0 in stage 2.0 (TID 883) 2020-02-15 03:01:44 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:01:44 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:01:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:0+33554432 2020-02-15 03:01:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:02:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:33554432+33554432 2020-02-15 03:02:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:04:46 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000000_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000000 2020-02-15 03:04:46 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000000_0: Committed 2020-02-15 03:04:46 Executor: INFO: Finished task 0.0 in stage 2.0 (TID 883). 1002 bytes result sent to driver 2020-02-15 03:04:46 TaskSetManager: INFO: Starting task 1.0 in stage 2.0 (TID 884, localhost, executor driver, partition 1, PROCESS_LOCAL, 9136 bytes) 2020-02-15 03:04:46 TaskSetManager: INFO: Finished task 0.0 in stage 2.0 (TID 883) in 182490 ms on localhost (executor driver) (1/882) 2020-02-15 03:04:46 Executor: INFO: Running task 1.0 in stage 2.0 (TID 884) 2020-02-15 03:04:46 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:04:46 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:04:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:33554432+33554432 2020-02-15 03:04:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:07:07 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000001_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000001 2020-02-15 03:07:07 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000001_0: Committed 2020-02-15 03:07:07 Executor: INFO: Finished task 1.0 in stage 2.0 (TID 884). 959 bytes result sent to driver 2020-02-15 03:07:07 TaskSetManager: INFO: Starting task 2.0 in stage 2.0 (TID 885, localhost, executor driver, partition 2, PROCESS_LOCAL, 9321 bytes) 2020-02-15 03:07:07 TaskSetManager: INFO: Finished task 1.0 in stage 2.0 (TID 884) in 140665 ms on localhost (executor driver) (2/882) 2020-02-15 03:07:07 Executor: INFO: Running task 2.0 in stage 2.0 (TID 885) 2020-02-15 03:07:07 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:07:07 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:07:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:67108864+33554432 2020-02-15 03:07:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:10:20 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:100663296+33554432 2020-02-15 03:10:20 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:13:14 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000002_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000002 2020-02-15 03:13:14 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000002_0: Committed 2020-02-15 03:13:14 Executor: INFO: Finished task 2.0 in stage 2.0 (TID 885). 959 bytes result sent to driver 2020-02-15 03:13:14 TaskSetManager: INFO: Starting task 3.0 in stage 2.0 (TID 886, localhost, executor driver, partition 3, PROCESS_LOCAL, 8749 bytes) 2020-02-15 03:13:14 TaskSetManager: INFO: Finished task 2.0 in stage 2.0 (TID 885) in 366833 ms on localhost (executor driver) (3/882) 2020-02-15 03:13:14 Executor: INFO: Running task 3.0 in stage 2.0 (TID 886) 2020-02-15 03:13:14 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:13:14 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:13:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:100663296+33554432 2020-02-15 03:13:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:16:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:134217728+33554432 2020-02-15 03:16:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:19:03 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000003_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000003 2020-02-15 03:19:03 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000003_0: Committed 2020-02-15 03:19:03 Executor: INFO: Finished task 3.0 in stage 2.0 (TID 886). 959 bytes result sent to driver 2020-02-15 03:19:03 TaskSetManager: INFO: Starting task 4.0 in stage 2.0 (TID 887, localhost, executor driver, partition 4, PROCESS_LOCAL, 9136 bytes) 2020-02-15 03:19:03 TaskSetManager: INFO: Finished task 3.0 in stage 2.0 (TID 886) in 349829 ms on localhost (executor driver) (4/882) 2020-02-15 03:19:03 Executor: INFO: Running task 4.0 in stage 2.0 (TID 887) 2020-02-15 03:19:03 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:19:03 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:19:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:134217728+33554432 2020-02-15 03:19:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:21:59 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000004_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000004 2020-02-15 03:21:59 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000004_0: Committed 2020-02-15 03:21:59 Executor: INFO: Finished task 4.0 in stage 2.0 (TID 887). 959 bytes result sent to driver 2020-02-15 03:21:59 TaskSetManager: INFO: Starting task 5.0 in stage 2.0 (TID 888, localhost, executor driver, partition 5, PROCESS_LOCAL, 9166 bytes) 2020-02-15 03:21:59 TaskSetManager: INFO: Finished task 4.0 in stage 2.0 (TID 887) in 175592 ms on localhost (executor driver) (5/882) 2020-02-15 03:21:59 Executor: INFO: Running task 5.0 in stage 2.0 (TID 888) 2020-02-15 03:21:59 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:21:59 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:21:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:167772160+33554432 2020-02-15 03:21:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 40 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 28 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 32 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 27 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 39 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 38 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 26 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 50 2020-02-15 03:24:48 BlockManagerInfo: INFO: Removed broadcast_8_piece0 on uger-c006.broadinstitute.org:36093 in memory (size: 13.9 KB, free: 412.9 MB) 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 41 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 29 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 42 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 46 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 49 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 48 2020-02-15 03:24:48 BlockManagerInfo: INFO: Removed broadcast_6_piece0 on uger-c006.broadinstitute.org:36093 in memory (size: 253.6 KB, free: 413.2 MB) 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 37 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 43 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 35 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 47 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 34 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 30 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 31 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 45 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 36 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 44 2020-02-15 03:24:48 ContextCleaner: INFO: Cleaned accumulator 33 2020-02-15 03:25:20 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000005_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000005 2020-02-15 03:25:20 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000005_0: Committed 2020-02-15 03:25:20 Executor: INFO: Finished task 5.0 in stage 2.0 (TID 888). 1002 bytes result sent to driver 2020-02-15 03:25:20 TaskSetManager: INFO: Starting task 6.0 in stage 2.0 (TID 889, localhost, executor driver, partition 6, PROCESS_LOCAL, 9166 bytes) 2020-02-15 03:25:20 TaskSetManager: INFO: Finished task 5.0 in stage 2.0 (TID 888) in 201124 ms on localhost (executor driver) (6/882) 2020-02-15 03:25:20 Executor: INFO: Running task 6.0 in stage 2.0 (TID 889) 2020-02-15 03:25:20 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:25:20 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:25:20 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:201326592+33554432 2020-02-15 03:25:20 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:28:34 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000006_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000006 2020-02-15 03:28:34 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000006_0: Committed 2020-02-15 03:28:34 Executor: INFO: Finished task 6.0 in stage 2.0 (TID 889). 959 bytes result sent to driver 2020-02-15 03:28:34 TaskSetManager: INFO: Starting task 7.0 in stage 2.0 (TID 890, localhost, executor driver, partition 7, PROCESS_LOCAL, 9173 bytes) 2020-02-15 03:28:34 TaskSetManager: INFO: Finished task 6.0 in stage 2.0 (TID 889) in 193450 ms on localhost (executor driver) (7/882) 2020-02-15 03:28:34 Executor: INFO: Running task 7.0 in stage 2.0 (TID 890) 2020-02-15 03:28:34 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:28:34 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:28:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:234881024+33554432 2020-02-15 03:28:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:30:51 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000007_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000007 2020-02-15 03:30:51 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000007_0: Committed 2020-02-15 03:30:51 Executor: INFO: Finished task 7.0 in stage 2.0 (TID 890). 959 bytes result sent to driver 2020-02-15 03:30:51 TaskSetManager: INFO: Starting task 8.0 in stage 2.0 (TID 891, localhost, executor driver, partition 8, PROCESS_LOCAL, 9166 bytes) 2020-02-15 03:30:51 TaskSetManager: INFO: Finished task 7.0 in stage 2.0 (TID 890) in 137107 ms on localhost (executor driver) (8/882) 2020-02-15 03:30:51 Executor: INFO: Running task 8.0 in stage 2.0 (TID 891) 2020-02-15 03:30:51 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:30:51 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:30:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:268435456+33554432 2020-02-15 03:30:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:33:42 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000008_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000008 2020-02-15 03:33:42 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000008_0: Committed 2020-02-15 03:33:42 Executor: INFO: Finished task 8.0 in stage 2.0 (TID 891). 959 bytes result sent to driver 2020-02-15 03:33:42 TaskSetManager: INFO: Starting task 9.0 in stage 2.0 (TID 892, localhost, executor driver, partition 9, PROCESS_LOCAL, 9321 bytes) 2020-02-15 03:33:42 TaskSetManager: INFO: Finished task 8.0 in stage 2.0 (TID 891) in 171594 ms on localhost (executor driver) (9/882) 2020-02-15 03:33:42 Executor: INFO: Running task 9.0 in stage 2.0 (TID 892) 2020-02-15 03:33:42 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:33:42 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:33:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:301989888+33554432 2020-02-15 03:33:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:36:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:335544320+33554432 2020-02-15 03:36:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:39:28 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000009_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000009 2020-02-15 03:39:28 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000009_0: Committed 2020-02-15 03:39:28 Executor: INFO: Finished task 9.0 in stage 2.0 (TID 892). 959 bytes result sent to driver 2020-02-15 03:39:28 TaskSetManager: INFO: Starting task 10.0 in stage 2.0 (TID 893, localhost, executor driver, partition 10, PROCESS_LOCAL, 8749 bytes) 2020-02-15 03:39:28 TaskSetManager: INFO: Finished task 9.0 in stage 2.0 (TID 892) in 345536 ms on localhost (executor driver) (10/882) 2020-02-15 03:39:28 Executor: INFO: Running task 10.0 in stage 2.0 (TID 893) 2020-02-15 03:39:28 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:39:28 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:39:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:335544320+33554432 2020-02-15 03:39:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:42:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:369098752+33554432 2020-02-15 03:42:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:45:47 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000010_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000010 2020-02-15 03:45:47 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000010_0: Committed 2020-02-15 03:45:47 Executor: INFO: Finished task 10.0 in stage 2.0 (TID 893). 959 bytes result sent to driver 2020-02-15 03:45:47 TaskSetManager: INFO: Starting task 11.0 in stage 2.0 (TID 894, localhost, executor driver, partition 11, PROCESS_LOCAL, 9138 bytes) 2020-02-15 03:45:47 TaskSetManager: INFO: Finished task 10.0 in stage 2.0 (TID 893) in 379073 ms on localhost (executor driver) (11/882) 2020-02-15 03:45:47 Executor: INFO: Running task 11.0 in stage 2.0 (TID 894) 2020-02-15 03:45:47 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:45:47 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:45:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:369098752+33554432 2020-02-15 03:45:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:49:03 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000011_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000011 2020-02-15 03:49:03 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000011_0: Committed 2020-02-15 03:49:03 Executor: INFO: Finished task 11.0 in stage 2.0 (TID 894). 959 bytes result sent to driver 2020-02-15 03:49:03 TaskSetManager: INFO: Starting task 12.0 in stage 2.0 (TID 895, localhost, executor driver, partition 12, PROCESS_LOCAL, 9391 bytes) 2020-02-15 03:49:03 TaskSetManager: INFO: Finished task 11.0 in stage 2.0 (TID 894) in 195956 ms on localhost (executor driver) (12/882) 2020-02-15 03:49:03 Executor: INFO: Running task 12.0 in stage 2.0 (TID 895) 2020-02-15 03:49:03 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:49:03 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:49:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:402653184+33554432 2020-02-15 03:49:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:53:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:436207616+33554432 2020-02-15 03:53:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 03:57:13 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000012_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000012 2020-02-15 03:57:13 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000012_0: Committed 2020-02-15 03:57:13 Executor: INFO: Finished task 12.0 in stage 2.0 (TID 895). 959 bytes result sent to driver 2020-02-15 03:57:13 TaskSetManager: INFO: Starting task 13.0 in stage 2.0 (TID 896, localhost, executor driver, partition 13, PROCESS_LOCAL, 8749 bytes) 2020-02-15 03:57:13 TaskSetManager: INFO: Finished task 12.0 in stage 2.0 (TID 895) in 490130 ms on localhost (executor driver) (13/882) 2020-02-15 03:57:13 Executor: INFO: Running task 13.0 in stage 2.0 (TID 896) 2020-02-15 03:57:13 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 03:57:13 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 03:57:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:436207616+33554432 2020-02-15 03:57:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:01:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:469762048+33554432 2020-02-15 04:01:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:01:40 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000013_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000013 2020-02-15 04:01:40 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000013_0: Committed 2020-02-15 04:01:40 Executor: INFO: Finished task 13.0 in stage 2.0 (TID 896). 959 bytes result sent to driver 2020-02-15 04:01:40 TaskSetManager: INFO: Starting task 14.0 in stage 2.0 (TID 897, localhost, executor driver, partition 14, PROCESS_LOCAL, 9137 bytes) 2020-02-15 04:01:40 TaskSetManager: INFO: Finished task 13.0 in stage 2.0 (TID 896) in 267048 ms on localhost (executor driver) (14/882) 2020-02-15 04:01:40 Executor: INFO: Running task 14.0 in stage 2.0 (TID 897) 2020-02-15 04:01:40 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:01:40 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:01:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:469762048+33554432 2020-02-15 04:01:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:02:08 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000014_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000014 2020-02-15 04:02:08 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000014_0: Committed 2020-02-15 04:02:08 Executor: INFO: Finished task 14.0 in stage 2.0 (TID 897). 959 bytes result sent to driver 2020-02-15 04:02:08 TaskSetManager: INFO: Starting task 15.0 in stage 2.0 (TID 898, localhost, executor driver, partition 15, PROCESS_LOCAL, 9321 bytes) 2020-02-15 04:02:08 TaskSetManager: INFO: Finished task 14.0 in stage 2.0 (TID 897) in 27793 ms on localhost (executor driver) (15/882) 2020-02-15 04:02:08 Executor: INFO: Running task 15.0 in stage 2.0 (TID 898) 2020-02-15 04:02:08 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:02:08 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:02:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:503316480+33554432 2020-02-15 04:02:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:02:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:536870912+33554432 2020-02-15 04:02:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:03:05 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000015_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000015 2020-02-15 04:03:05 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000015_0: Committed 2020-02-15 04:03:05 Executor: INFO: Finished task 15.0 in stage 2.0 (TID 898). 959 bytes result sent to driver 2020-02-15 04:03:05 TaskSetManager: INFO: Starting task 16.0 in stage 2.0 (TID 899, localhost, executor driver, partition 16, PROCESS_LOCAL, 8749 bytes) 2020-02-15 04:03:05 TaskSetManager: INFO: Finished task 15.0 in stage 2.0 (TID 898) in 57402 ms on localhost (executor driver) (16/882) 2020-02-15 04:03:05 Executor: INFO: Running task 16.0 in stage 2.0 (TID 899) 2020-02-15 04:03:05 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:03:05 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:03:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:536870912+33554432 2020-02-15 04:03:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:03:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:570425344+33554432 2020-02-15 04:03:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:04:02 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000016_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000016 2020-02-15 04:04:02 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000016_0: Committed 2020-02-15 04:04:02 Executor: INFO: Finished task 16.0 in stage 2.0 (TID 899). 959 bytes result sent to driver 2020-02-15 04:04:02 TaskSetManager: INFO: Starting task 17.0 in stage 2.0 (TID 900, localhost, executor driver, partition 17, PROCESS_LOCAL, 9297 bytes) 2020-02-15 04:04:02 TaskSetManager: INFO: Finished task 16.0 in stage 2.0 (TID 899) in 56469 ms on localhost (executor driver) (17/882) 2020-02-15 04:04:02 Executor: INFO: Running task 17.0 in stage 2.0 (TID 900) 2020-02-15 04:04:02 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:04:02 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:04:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:570425344+33554432 2020-02-15 04:04:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:04:30 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000017_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000017 2020-02-15 04:04:30 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000017_0: Committed 2020-02-15 04:04:30 Executor: INFO: Finished task 17.0 in stage 2.0 (TID 900). 959 bytes result sent to driver 2020-02-15 04:04:30 TaskSetManager: INFO: Starting task 18.0 in stage 2.0 (TID 901, localhost, executor driver, partition 18, PROCESS_LOCAL, 9167 bytes) 2020-02-15 04:04:30 TaskSetManager: INFO: Finished task 17.0 in stage 2.0 (TID 900) in 28745 ms on localhost (executor driver) (18/882) 2020-02-15 04:04:30 Executor: INFO: Running task 18.0 in stage 2.0 (TID 901) 2020-02-15 04:04:30 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:04:30 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:04:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:603979776+33554432 2020-02-15 04:04:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:04:59 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000018_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000018 2020-02-15 04:04:59 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000018_0: Committed 2020-02-15 04:04:59 Executor: INFO: Finished task 18.0 in stage 2.0 (TID 901). 959 bytes result sent to driver 2020-02-15 04:04:59 TaskSetManager: INFO: Starting task 19.0 in stage 2.0 (TID 902, localhost, executor driver, partition 19, PROCESS_LOCAL, 9166 bytes) 2020-02-15 04:04:59 TaskSetManager: INFO: Finished task 18.0 in stage 2.0 (TID 901) in 28816 ms on localhost (executor driver) (19/882) 2020-02-15 04:04:59 Executor: INFO: Running task 19.0 in stage 2.0 (TID 902) 2020-02-15 04:04:59 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:04:59 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:04:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:637534208+33554432 2020-02-15 04:04:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:08:11 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000019_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000019 2020-02-15 04:08:11 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000019_0: Committed 2020-02-15 04:08:11 Executor: INFO: Finished task 19.0 in stage 2.0 (TID 902). 959 bytes result sent to driver 2020-02-15 04:08:11 TaskSetManager: INFO: Starting task 20.0 in stage 2.0 (TID 903, localhost, executor driver, partition 20, PROCESS_LOCAL, 9166 bytes) 2020-02-15 04:08:11 TaskSetManager: INFO: Finished task 19.0 in stage 2.0 (TID 902) in 192027 ms on localhost (executor driver) (20/882) 2020-02-15 04:08:11 Executor: INFO: Running task 20.0 in stage 2.0 (TID 903) 2020-02-15 04:08:11 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:08:11 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:08:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:671088640+33554432 2020-02-15 04:08:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:11:57 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000020_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000020 2020-02-15 04:11:57 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000020_0: Committed 2020-02-15 04:11:57 Executor: INFO: Finished task 20.0 in stage 2.0 (TID 903). 959 bytes result sent to driver 2020-02-15 04:11:57 TaskSetManager: INFO: Starting task 21.0 in stage 2.0 (TID 904, localhost, executor driver, partition 21, PROCESS_LOCAL, 9321 bytes) 2020-02-15 04:11:57 TaskSetManager: INFO: Finished task 20.0 in stage 2.0 (TID 903) in 226202 ms on localhost (executor driver) (21/882) 2020-02-15 04:11:57 Executor: INFO: Running task 21.0 in stage 2.0 (TID 904) 2020-02-15 04:11:57 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:11:57 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:11:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:704643072+33554432 2020-02-15 04:11:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:14:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:738197504+33554432 2020-02-15 04:14:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:17:49 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000021_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000021 2020-02-15 04:17:49 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000021_0: Committed 2020-02-15 04:17:49 Executor: INFO: Finished task 21.0 in stage 2.0 (TID 904). 959 bytes result sent to driver 2020-02-15 04:17:49 TaskSetManager: INFO: Starting task 22.0 in stage 2.0 (TID 905, localhost, executor driver, partition 22, PROCESS_LOCAL, 8749 bytes) 2020-02-15 04:17:49 TaskSetManager: INFO: Finished task 21.0 in stage 2.0 (TID 904) in 351986 ms on localhost (executor driver) (22/882) 2020-02-15 04:17:49 Executor: INFO: Running task 22.0 in stage 2.0 (TID 905) 2020-02-15 04:17:49 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:17:49 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:17:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:738197504+33554432 2020-02-15 04:17:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:21:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:771751936+33554432 2020-02-15 04:21:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:25:07 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000022_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000022 2020-02-15 04:25:07 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000022_0: Committed 2020-02-15 04:25:07 Executor: INFO: Finished task 22.0 in stage 2.0 (TID 905). 1002 bytes result sent to driver 2020-02-15 04:25:07 TaskSetManager: INFO: Starting task 23.0 in stage 2.0 (TID 906, localhost, executor driver, partition 23, PROCESS_LOCAL, 8749 bytes) 2020-02-15 04:25:07 TaskSetManager: INFO: Finished task 22.0 in stage 2.0 (TID 905) in 437435 ms on localhost (executor driver) (23/882) 2020-02-15 04:25:07 Executor: INFO: Running task 23.0 in stage 2.0 (TID 906) 2020-02-15 04:25:07 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:25:07 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:25:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:771751936+33554432 2020-02-15 04:25:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:28:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:805306368+33554432 2020-02-15 04:28:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:31:59 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000023_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000023 2020-02-15 04:31:59 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000023_0: Committed 2020-02-15 04:31:59 Executor: INFO: Finished task 23.0 in stage 2.0 (TID 906). 959 bytes result sent to driver 2020-02-15 04:31:59 TaskSetManager: INFO: Starting task 24.0 in stage 2.0 (TID 907, localhost, executor driver, partition 24, PROCESS_LOCAL, 9136 bytes) 2020-02-15 04:31:59 TaskSetManager: INFO: Finished task 23.0 in stage 2.0 (TID 906) in 411881 ms on localhost (executor driver) (24/882) 2020-02-15 04:31:59 Executor: INFO: Running task 24.0 in stage 2.0 (TID 907) 2020-02-15 04:31:59 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:31:59 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:31:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:805306368+33554432 2020-02-15 04:31:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:35:06 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000024_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000024 2020-02-15 04:35:06 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000024_0: Committed 2020-02-15 04:35:06 Executor: INFO: Finished task 24.0 in stage 2.0 (TID 907). 1002 bytes result sent to driver 2020-02-15 04:35:06 TaskSetManager: INFO: Starting task 25.0 in stage 2.0 (TID 908, localhost, executor driver, partition 25, PROCESS_LOCAL, 9321 bytes) 2020-02-15 04:35:06 TaskSetManager: INFO: Finished task 24.0 in stage 2.0 (TID 907) in 187712 ms on localhost (executor driver) (25/882) 2020-02-15 04:35:06 Executor: INFO: Running task 25.0 in stage 2.0 (TID 908) 2020-02-15 04:35:07 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:35:07 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:35:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:838860800+33554432 2020-02-15 04:35:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:39:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:872415232+33554432 2020-02-15 04:39:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:42:58 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000025_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000025 2020-02-15 04:42:58 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000025_0: Committed 2020-02-15 04:42:58 Executor: INFO: Finished task 25.0 in stage 2.0 (TID 908). 959 bytes result sent to driver 2020-02-15 04:42:58 TaskSetManager: INFO: Starting task 26.0 in stage 2.0 (TID 909, localhost, executor driver, partition 26, PROCESS_LOCAL, 9136 bytes) 2020-02-15 04:42:58 TaskSetManager: INFO: Finished task 25.0 in stage 2.0 (TID 908) in 471553 ms on localhost (executor driver) (26/882) 2020-02-15 04:42:58 Executor: INFO: Running task 26.0 in stage 2.0 (TID 909) 2020-02-15 04:42:58 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:42:58 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:42:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:872415232+33554432 2020-02-15 04:42:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:46:32 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000026_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000026 2020-02-15 04:46:32 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000026_0: Committed 2020-02-15 04:46:32 Executor: INFO: Finished task 26.0 in stage 2.0 (TID 909). 959 bytes result sent to driver 2020-02-15 04:46:32 TaskSetManager: INFO: Starting task 27.0 in stage 2.0 (TID 910, localhost, executor driver, partition 27, PROCESS_LOCAL, 9166 bytes) 2020-02-15 04:46:32 TaskSetManager: INFO: Finished task 26.0 in stage 2.0 (TID 909) in 214146 ms on localhost (executor driver) (27/882) 2020-02-15 04:46:32 Executor: INFO: Running task 27.0 in stage 2.0 (TID 910) 2020-02-15 04:46:32 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:46:32 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:46:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:905969664+33554432 2020-02-15 04:46:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:50:37 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000027_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000027 2020-02-15 04:50:37 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000027_0: Committed 2020-02-15 04:50:37 Executor: INFO: Finished task 27.0 in stage 2.0 (TID 910). 959 bytes result sent to driver 2020-02-15 04:50:37 TaskSetManager: INFO: Starting task 28.0 in stage 2.0 (TID 911, localhost, executor driver, partition 28, PROCESS_LOCAL, 9166 bytes) 2020-02-15 04:50:37 TaskSetManager: INFO: Finished task 27.0 in stage 2.0 (TID 910) in 244797 ms on localhost (executor driver) (28/882) 2020-02-15 04:50:37 Executor: INFO: Running task 28.0 in stage 2.0 (TID 911) 2020-02-15 04:50:37 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:50:37 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:50:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:939524096+33554432 2020-02-15 04:50:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:55:14 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000028_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000028 2020-02-15 04:55:14 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000028_0: Committed 2020-02-15 04:55:14 Executor: INFO: Finished task 28.0 in stage 2.0 (TID 911). 959 bytes result sent to driver 2020-02-15 04:55:14 TaskSetManager: INFO: Starting task 29.0 in stage 2.0 (TID 912, localhost, executor driver, partition 29, PROCESS_LOCAL, 9166 bytes) 2020-02-15 04:55:14 TaskSetManager: INFO: Finished task 28.0 in stage 2.0 (TID 911) in 276636 ms on localhost (executor driver) (29/882) 2020-02-15 04:55:14 Executor: INFO: Running task 29.0 in stage 2.0 (TID 912) 2020-02-15 04:55:14 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:55:14 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:55:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:973078528+33554432 2020-02-15 04:55:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 04:59:32 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000029_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000029 2020-02-15 04:59:32 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000029_0: Committed 2020-02-15 04:59:32 Executor: INFO: Finished task 29.0 in stage 2.0 (TID 912). 959 bytes result sent to driver 2020-02-15 04:59:32 TaskSetManager: INFO: Starting task 30.0 in stage 2.0 (TID 913, localhost, executor driver, partition 30, PROCESS_LOCAL, 9166 bytes) 2020-02-15 04:59:32 TaskSetManager: INFO: Finished task 29.0 in stage 2.0 (TID 912) in 258331 ms on localhost (executor driver) (30/882) 2020-02-15 04:59:32 Executor: INFO: Running task 30.0 in stage 2.0 (TID 913) 2020-02-15 04:59:32 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 04:59:32 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 04:59:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1006632960+33554432 2020-02-15 04:59:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:04:14 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000030_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000030 2020-02-15 05:04:14 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000030_0: Committed 2020-02-15 05:04:14 Executor: INFO: Finished task 30.0 in stage 2.0 (TID 913). 959 bytes result sent to driver 2020-02-15 05:04:14 TaskSetManager: INFO: Starting task 31.0 in stage 2.0 (TID 914, localhost, executor driver, partition 31, PROCESS_LOCAL, 9166 bytes) 2020-02-15 05:04:14 TaskSetManager: INFO: Finished task 30.0 in stage 2.0 (TID 913) in 282074 ms on localhost (executor driver) (31/882) 2020-02-15 05:04:14 Executor: INFO: Running task 31.0 in stage 2.0 (TID 914) 2020-02-15 05:04:14 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 05:04:14 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 05:04:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1040187392+33554432 2020-02-15 05:04:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:09:08 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000031_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000031 2020-02-15 05:09:08 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000031_0: Committed 2020-02-15 05:09:08 Executor: INFO: Finished task 31.0 in stage 2.0 (TID 914). 959 bytes result sent to driver 2020-02-15 05:09:08 TaskSetManager: INFO: Starting task 32.0 in stage 2.0 (TID 915, localhost, executor driver, partition 32, PROCESS_LOCAL, 9166 bytes) 2020-02-15 05:09:08 TaskSetManager: INFO: Finished task 31.0 in stage 2.0 (TID 914) in 294028 ms on localhost (executor driver) (32/882) 2020-02-15 05:09:08 Executor: INFO: Running task 32.0 in stage 2.0 (TID 915) 2020-02-15 05:09:08 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 05:09:08 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 05:09:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1073741824+33554432 2020-02-15 05:09:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:13:57 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000032_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000032 2020-02-15 05:13:57 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000032_0: Committed 2020-02-15 05:13:57 Executor: INFO: Finished task 32.0 in stage 2.0 (TID 915). 959 bytes result sent to driver 2020-02-15 05:13:57 TaskSetManager: INFO: Starting task 33.0 in stage 2.0 (TID 916, localhost, executor driver, partition 33, PROCESS_LOCAL, 9321 bytes) 2020-02-15 05:13:57 TaskSetManager: INFO: Finished task 32.0 in stage 2.0 (TID 915) in 289125 ms on localhost (executor driver) (33/882) 2020-02-15 05:13:57 Executor: INFO: Running task 33.0 in stage 2.0 (TID 916) 2020-02-15 05:13:57 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 05:13:57 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 05:13:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1107296256+33554432 2020-02-15 05:13:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:16:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1140850688+33554432 2020-02-15 05:16:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:19:58 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000033_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000033 2020-02-15 05:19:58 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000033_0: Committed 2020-02-15 05:19:58 Executor: INFO: Finished task 33.0 in stage 2.0 (TID 916). 959 bytes result sent to driver 2020-02-15 05:19:58 TaskSetManager: INFO: Starting task 34.0 in stage 2.0 (TID 917, localhost, executor driver, partition 34, PROCESS_LOCAL, 9255 bytes) 2020-02-15 05:19:58 TaskSetManager: INFO: Finished task 33.0 in stage 2.0 (TID 916) in 360778 ms on localhost (executor driver) (34/882) 2020-02-15 05:19:58 Executor: INFO: Running task 34.0 in stage 2.0 (TID 917) 2020-02-15 05:19:58 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 05:19:58 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 05:19:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1140850688+33554432 2020-02-15 05:19:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:23:22 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000034_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000034 2020-02-15 05:23:22 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000034_0: Committed 2020-02-15 05:23:22 Executor: INFO: Finished task 34.0 in stage 2.0 (TID 917). 959 bytes result sent to driver 2020-02-15 05:23:22 TaskSetManager: INFO: Starting task 35.0 in stage 2.0 (TID 918, localhost, executor driver, partition 35, PROCESS_LOCAL, 9166 bytes) 2020-02-15 05:23:22 TaskSetManager: INFO: Finished task 34.0 in stage 2.0 (TID 917) in 203862 ms on localhost (executor driver) (35/882) 2020-02-15 05:23:22 Executor: INFO: Running task 35.0 in stage 2.0 (TID 918) 2020-02-15 05:23:22 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 05:23:22 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 05:23:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1174405120+33554432 2020-02-15 05:23:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:26:19 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000035_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000035 2020-02-15 05:26:19 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000035_0: Committed 2020-02-15 05:26:19 Executor: INFO: Finished task 35.0 in stage 2.0 (TID 918). 959 bytes result sent to driver 2020-02-15 05:26:19 TaskSetManager: INFO: Starting task 36.0 in stage 2.0 (TID 919, localhost, executor driver, partition 36, PROCESS_LOCAL, 9321 bytes) 2020-02-15 05:26:19 TaskSetManager: INFO: Finished task 35.0 in stage 2.0 (TID 918) in 176922 ms on localhost (executor driver) (36/882) 2020-02-15 05:26:19 Executor: INFO: Running task 36.0 in stage 2.0 (TID 919) 2020-02-15 05:26:19 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 05:26:19 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 05:26:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1207959552+33554432 2020-02-15 05:26:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:30:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1241513984+33554432 2020-02-15 05:30:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:33:44 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000036_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000036 2020-02-15 05:33:44 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000036_0: Committed 2020-02-15 05:33:44 Executor: INFO: Finished task 36.0 in stage 2.0 (TID 919). 959 bytes result sent to driver 2020-02-15 05:33:44 TaskSetManager: INFO: Starting task 37.0 in stage 2.0 (TID 920, localhost, executor driver, partition 37, PROCESS_LOCAL, 9136 bytes) 2020-02-15 05:33:44 TaskSetManager: INFO: Finished task 36.0 in stage 2.0 (TID 919) in 445016 ms on localhost (executor driver) (37/882) 2020-02-15 05:33:44 Executor: INFO: Running task 37.0 in stage 2.0 (TID 920) 2020-02-15 05:33:44 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 05:33:44 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 05:33:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1241513984+33554432 2020-02-15 05:33:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:37:31 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000037_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000037 2020-02-15 05:37:31 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000037_0: Committed 2020-02-15 05:37:31 Executor: INFO: Finished task 37.0 in stage 2.0 (TID 920). 959 bytes result sent to driver 2020-02-15 05:37:31 TaskSetManager: INFO: Starting task 38.0 in stage 2.0 (TID 921, localhost, executor driver, partition 38, PROCESS_LOCAL, 9321 bytes) 2020-02-15 05:37:31 TaskSetManager: INFO: Finished task 37.0 in stage 2.0 (TID 920) in 227123 ms on localhost (executor driver) (38/882) 2020-02-15 05:37:31 Executor: INFO: Running task 38.0 in stage 2.0 (TID 921) 2020-02-15 05:37:31 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 05:37:31 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 05:37:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1275068416+33554432 2020-02-15 05:37:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:41:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1308622848+33554432 2020-02-15 05:41:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:44:18 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000038_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000038 2020-02-15 05:44:18 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000038_0: Committed 2020-02-15 05:44:18 Executor: INFO: Finished task 38.0 in stage 2.0 (TID 921). 959 bytes result sent to driver 2020-02-15 05:44:18 TaskSetManager: INFO: Starting task 39.0 in stage 2.0 (TID 922, localhost, executor driver, partition 39, PROCESS_LOCAL, 9136 bytes) 2020-02-15 05:44:18 TaskSetManager: INFO: Finished task 38.0 in stage 2.0 (TID 921) in 407113 ms on localhost (executor driver) (39/882) 2020-02-15 05:44:18 Executor: INFO: Running task 39.0 in stage 2.0 (TID 922) 2020-02-15 05:44:18 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 05:44:18 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 05:44:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1308622848+33554432 2020-02-15 05:44:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:47:41 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000039_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000039 2020-02-15 05:47:41 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000039_0: Committed 2020-02-15 05:47:41 Executor: INFO: Finished task 39.0 in stage 2.0 (TID 922). 959 bytes result sent to driver 2020-02-15 05:47:41 TaskSetManager: INFO: Starting task 40.0 in stage 2.0 (TID 923, localhost, executor driver, partition 40, PROCESS_LOCAL, 9166 bytes) 2020-02-15 05:47:41 TaskSetManager: INFO: Finished task 39.0 in stage 2.0 (TID 922) in 202610 ms on localhost (executor driver) (40/882) 2020-02-15 05:47:41 Executor: INFO: Running task 40.0 in stage 2.0 (TID 923) 2020-02-15 05:47:41 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 05:47:41 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 05:47:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1342177280+33554432 2020-02-15 05:47:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:52:02 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000040_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000040 2020-02-15 05:52:02 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000040_0: Committed 2020-02-15 05:52:02 Executor: INFO: Finished task 40.0 in stage 2.0 (TID 923). 959 bytes result sent to driver 2020-02-15 05:52:02 TaskSetManager: INFO: Starting task 41.0 in stage 2.0 (TID 924, localhost, executor driver, partition 41, PROCESS_LOCAL, 9321 bytes) 2020-02-15 05:52:02 TaskSetManager: INFO: Finished task 40.0 in stage 2.0 (TID 923) in 261864 ms on localhost (executor driver) (41/882) 2020-02-15 05:52:02 Executor: INFO: Running task 41.0 in stage 2.0 (TID 924) 2020-02-15 05:52:02 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 05:52:02 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 05:52:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1375731712+33554432 2020-02-15 05:52:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 05:56:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1409286144+33554432 2020-02-15 05:56:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:00:42 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000041_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000041 2020-02-15 06:00:42 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000041_0: Committed 2020-02-15 06:00:42 Executor: INFO: Finished task 41.0 in stage 2.0 (TID 924). 959 bytes result sent to driver 2020-02-15 06:00:42 TaskSetManager: INFO: Starting task 42.0 in stage 2.0 (TID 925, localhost, executor driver, partition 42, PROCESS_LOCAL, 9136 bytes) 2020-02-15 06:00:42 TaskSetManager: INFO: Finished task 41.0 in stage 2.0 (TID 924) in 519924 ms on localhost (executor driver) (42/882) 2020-02-15 06:00:42 Executor: INFO: Running task 42.0 in stage 2.0 (TID 925) 2020-02-15 06:00:42 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:00:42 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:00:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1409286144+33554432 2020-02-15 06:00:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:04:56 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000042_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000042 2020-02-15 06:04:56 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000042_0: Committed 2020-02-15 06:04:56 Executor: INFO: Finished task 42.0 in stage 2.0 (TID 925). 959 bytes result sent to driver 2020-02-15 06:04:56 TaskSetManager: INFO: Starting task 43.0 in stage 2.0 (TID 926, localhost, executor driver, partition 43, PROCESS_LOCAL, 9321 bytes) 2020-02-15 06:04:56 TaskSetManager: INFO: Finished task 42.0 in stage 2.0 (TID 925) in 254043 ms on localhost (executor driver) (43/882) 2020-02-15 06:04:56 Executor: INFO: Running task 43.0 in stage 2.0 (TID 926) 2020-02-15 06:04:56 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:04:56 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:04:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1442840576+33554432 2020-02-15 06:04:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:08:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1476395008+33554432 2020-02-15 06:08:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:11:04 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000043_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000043 2020-02-15 06:11:04 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000043_0: Committed 2020-02-15 06:11:04 Executor: INFO: Finished task 43.0 in stage 2.0 (TID 926). 959 bytes result sent to driver 2020-02-15 06:11:04 TaskSetManager: INFO: Starting task 44.0 in stage 2.0 (TID 927, localhost, executor driver, partition 44, PROCESS_LOCAL, 9136 bytes) 2020-02-15 06:11:04 TaskSetManager: INFO: Finished task 43.0 in stage 2.0 (TID 926) in 367647 ms on localhost (executor driver) (44/882) 2020-02-15 06:11:04 Executor: INFO: Running task 44.0 in stage 2.0 (TID 927) 2020-02-15 06:11:04 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:11:04 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:11:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1476395008+33554432 2020-02-15 06:11:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:13:45 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000044_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000044 2020-02-15 06:13:45 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000044_0: Committed 2020-02-15 06:13:45 Executor: INFO: Finished task 44.0 in stage 2.0 (TID 927). 959 bytes result sent to driver 2020-02-15 06:13:45 TaskSetManager: INFO: Starting task 45.0 in stage 2.0 (TID 928, localhost, executor driver, partition 45, PROCESS_LOCAL, 9166 bytes) 2020-02-15 06:13:45 TaskSetManager: INFO: Finished task 44.0 in stage 2.0 (TID 927) in 161073 ms on localhost (executor driver) (45/882) 2020-02-15 06:13:45 Executor: INFO: Running task 45.0 in stage 2.0 (TID 928) 2020-02-15 06:13:45 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:13:45 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:13:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1509949440+33554432 2020-02-15 06:13:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:17:05 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000045_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000045 2020-02-15 06:17:05 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000045_0: Committed 2020-02-15 06:17:05 Executor: INFO: Finished task 45.0 in stage 2.0 (TID 928). 959 bytes result sent to driver 2020-02-15 06:17:05 TaskSetManager: INFO: Starting task 46.0 in stage 2.0 (TID 929, localhost, executor driver, partition 46, PROCESS_LOCAL, 9321 bytes) 2020-02-15 06:17:05 TaskSetManager: INFO: Finished task 45.0 in stage 2.0 (TID 928) in 199664 ms on localhost (executor driver) (46/882) 2020-02-15 06:17:05 Executor: INFO: Running task 46.0 in stage 2.0 (TID 929) 2020-02-15 06:17:05 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:17:05 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:17:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1543503872+33554432 2020-02-15 06:17:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:20:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1577058304+33554432 2020-02-15 06:20:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:24:13 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000046_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000046 2020-02-15 06:24:13 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000046_0: Committed 2020-02-15 06:24:13 Executor: INFO: Finished task 46.0 in stage 2.0 (TID 929). 959 bytes result sent to driver 2020-02-15 06:24:13 TaskSetManager: INFO: Starting task 47.0 in stage 2.0 (TID 930, localhost, executor driver, partition 47, PROCESS_LOCAL, 9136 bytes) 2020-02-15 06:24:13 TaskSetManager: INFO: Finished task 46.0 in stage 2.0 (TID 929) in 428229 ms on localhost (executor driver) (47/882) 2020-02-15 06:24:13 Executor: INFO: Running task 47.0 in stage 2.0 (TID 930) 2020-02-15 06:24:13 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:24:13 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:24:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1577058304+33554432 2020-02-15 06:24:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:27:52 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000047_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000047 2020-02-15 06:27:52 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000047_0: Committed 2020-02-15 06:27:52 Executor: INFO: Finished task 47.0 in stage 2.0 (TID 930). 959 bytes result sent to driver 2020-02-15 06:27:52 TaskSetManager: INFO: Starting task 48.0 in stage 2.0 (TID 931, localhost, executor driver, partition 48, PROCESS_LOCAL, 9166 bytes) 2020-02-15 06:27:52 TaskSetManager: INFO: Finished task 47.0 in stage 2.0 (TID 930) in 218968 ms on localhost (executor driver) (48/882) 2020-02-15 06:27:52 Executor: INFO: Running task 48.0 in stage 2.0 (TID 931) 2020-02-15 06:27:52 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:27:52 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:27:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1610612736+33554432 2020-02-15 06:27:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:31:42 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000048_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000048 2020-02-15 06:31:42 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000048_0: Committed 2020-02-15 06:31:42 Executor: INFO: Finished task 48.0 in stage 2.0 (TID 931). 959 bytes result sent to driver 2020-02-15 06:31:42 TaskSetManager: INFO: Starting task 49.0 in stage 2.0 (TID 932, localhost, executor driver, partition 49, PROCESS_LOCAL, 9321 bytes) 2020-02-15 06:31:42 TaskSetManager: INFO: Finished task 48.0 in stage 2.0 (TID 931) in 230103 ms on localhost (executor driver) (49/882) 2020-02-15 06:31:42 Executor: INFO: Running task 49.0 in stage 2.0 (TID 932) 2020-02-15 06:31:42 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:31:42 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:31:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1644167168+33554432 2020-02-15 06:31:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:34:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1677721600+33554432 2020-02-15 06:34:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:38:46 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000049_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000049 2020-02-15 06:38:46 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000049_0: Committed 2020-02-15 06:38:46 Executor: INFO: Finished task 49.0 in stage 2.0 (TID 932). 959 bytes result sent to driver 2020-02-15 06:38:46 TaskSetManager: INFO: Starting task 50.0 in stage 2.0 (TID 933, localhost, executor driver, partition 50, PROCESS_LOCAL, 9136 bytes) 2020-02-15 06:38:46 TaskSetManager: INFO: Finished task 49.0 in stage 2.0 (TID 932) in 423937 ms on localhost (executor driver) (50/882) 2020-02-15 06:38:46 Executor: INFO: Running task 50.0 in stage 2.0 (TID 933) 2020-02-15 06:38:46 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:38:46 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:38:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1677721600+33554432 2020-02-15 06:38:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:42:51 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000050_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000050 2020-02-15 06:42:51 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000050_0: Committed 2020-02-15 06:42:51 Executor: INFO: Finished task 50.0 in stage 2.0 (TID 933). 959 bytes result sent to driver 2020-02-15 06:42:51 TaskSetManager: INFO: Starting task 51.0 in stage 2.0 (TID 934, localhost, executor driver, partition 51, PROCESS_LOCAL, 9166 bytes) 2020-02-15 06:42:51 TaskSetManager: INFO: Finished task 50.0 in stage 2.0 (TID 933) in 244590 ms on localhost (executor driver) (51/882) 2020-02-15 06:42:51 Executor: INFO: Running task 51.0 in stage 2.0 (TID 934) 2020-02-15 06:42:51 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:42:51 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:42:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1711276032+33554432 2020-02-15 06:42:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:46:08 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000051_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000051 2020-02-15 06:46:08 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000051_0: Committed 2020-02-15 06:46:08 Executor: INFO: Finished task 51.0 in stage 2.0 (TID 934). 1002 bytes result sent to driver 2020-02-15 06:46:08 TaskSetManager: INFO: Starting task 52.0 in stage 2.0 (TID 935, localhost, executor driver, partition 52, PROCESS_LOCAL, 9321 bytes) 2020-02-15 06:46:08 TaskSetManager: INFO: Finished task 51.0 in stage 2.0 (TID 934) in 197511 ms on localhost (executor driver) (52/882) 2020-02-15 06:46:08 Executor: INFO: Running task 52.0 in stage 2.0 (TID 935) 2020-02-15 06:46:08 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:46:08 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:46:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1744830464+33554432 2020-02-15 06:46:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:49:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1778384896+33554432 2020-02-15 06:49:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:53:02 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000052_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000052 2020-02-15 06:53:02 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000052_0: Committed 2020-02-15 06:53:02 Executor: INFO: Finished task 52.0 in stage 2.0 (TID 935). 959 bytes result sent to driver 2020-02-15 06:53:02 TaskSetManager: INFO: Starting task 53.0 in stage 2.0 (TID 936, localhost, executor driver, partition 53, PROCESS_LOCAL, 8749 bytes) 2020-02-15 06:53:02 TaskSetManager: INFO: Finished task 52.0 in stage 2.0 (TID 935) in 413865 ms on localhost (executor driver) (53/882) 2020-02-15 06:53:02 Executor: INFO: Running task 53.0 in stage 2.0 (TID 936) 2020-02-15 06:53:02 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:53:02 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:53:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1778384896+33554432 2020-02-15 06:53:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:56:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1811939328+33554432 2020-02-15 06:56:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 06:59:48 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000053_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000053 2020-02-15 06:59:48 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000053_0: Committed 2020-02-15 06:59:48 Executor: INFO: Finished task 53.0 in stage 2.0 (TID 936). 959 bytes result sent to driver 2020-02-15 06:59:48 TaskSetManager: INFO: Starting task 54.0 in stage 2.0 (TID 937, localhost, executor driver, partition 54, PROCESS_LOCAL, 9136 bytes) 2020-02-15 06:59:48 TaskSetManager: INFO: Finished task 53.0 in stage 2.0 (TID 936) in 405549 ms on localhost (executor driver) (54/882) 2020-02-15 06:59:48 Executor: INFO: Running task 54.0 in stage 2.0 (TID 937) 2020-02-15 06:59:48 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 06:59:48 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 06:59:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1811939328+33554432 2020-02-15 06:59:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:03:24 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000054_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000054 2020-02-15 07:03:24 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000054_0: Committed 2020-02-15 07:03:24 Executor: INFO: Finished task 54.0 in stage 2.0 (TID 937). 959 bytes result sent to driver 2020-02-15 07:03:24 TaskSetManager: INFO: Starting task 55.0 in stage 2.0 (TID 938, localhost, executor driver, partition 55, PROCESS_LOCAL, 9321 bytes) 2020-02-15 07:03:24 TaskSetManager: INFO: Finished task 54.0 in stage 2.0 (TID 937) in 216138 ms on localhost (executor driver) (55/882) 2020-02-15 07:03:24 Executor: INFO: Running task 55.0 in stage 2.0 (TID 938) 2020-02-15 07:03:24 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:03:24 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:03:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1845493760+33554432 2020-02-15 07:03:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:06:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1879048192+33554432 2020-02-15 07:06:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:09:54 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000055_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000055 2020-02-15 07:09:54 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000055_0: Committed 2020-02-15 07:09:54 Executor: INFO: Finished task 55.0 in stage 2.0 (TID 938). 959 bytes result sent to driver 2020-02-15 07:09:54 TaskSetManager: INFO: Starting task 56.0 in stage 2.0 (TID 939, localhost, executor driver, partition 56, PROCESS_LOCAL, 9137 bytes) 2020-02-15 07:09:54 TaskSetManager: INFO: Finished task 55.0 in stage 2.0 (TID 938) in 390247 ms on localhost (executor driver) (56/882) 2020-02-15 07:09:54 Executor: INFO: Running task 56.0 in stage 2.0 (TID 939) 2020-02-15 07:09:54 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:09:54 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:09:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1879048192+33554432 2020-02-15 07:09:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:13:09 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000056_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000056 2020-02-15 07:13:09 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000056_0: Committed 2020-02-15 07:13:09 Executor: INFO: Finished task 56.0 in stage 2.0 (TID 939). 959 bytes result sent to driver 2020-02-15 07:13:09 TaskSetManager: INFO: Starting task 57.0 in stage 2.0 (TID 940, localhost, executor driver, partition 57, PROCESS_LOCAL, 9166 bytes) 2020-02-15 07:13:09 TaskSetManager: INFO: Finished task 56.0 in stage 2.0 (TID 939) in 195362 ms on localhost (executor driver) (57/882) 2020-02-15 07:13:09 Executor: INFO: Running task 57.0 in stage 2.0 (TID 940) 2020-02-15 07:13:09 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:13:09 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:13:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1912602624+33554432 2020-02-15 07:13:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:17:33 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000057_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000057 2020-02-15 07:17:33 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000057_0: Committed 2020-02-15 07:17:33 Executor: INFO: Finished task 57.0 in stage 2.0 (TID 940). 959 bytes result sent to driver 2020-02-15 07:17:33 TaskSetManager: INFO: Starting task 58.0 in stage 2.0 (TID 941, localhost, executor driver, partition 58, PROCESS_LOCAL, 9166 bytes) 2020-02-15 07:17:33 TaskSetManager: INFO: Finished task 57.0 in stage 2.0 (TID 940) in 264033 ms on localhost (executor driver) (58/882) 2020-02-15 07:17:33 Executor: INFO: Running task 58.0 in stage 2.0 (TID 941) 2020-02-15 07:17:33 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:17:33 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:17:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1946157056+33554432 2020-02-15 07:17:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:21:19 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000058_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000058 2020-02-15 07:21:19 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000058_0: Committed 2020-02-15 07:21:19 Executor: INFO: Finished task 58.0 in stage 2.0 (TID 941). 959 bytes result sent to driver 2020-02-15 07:21:19 TaskSetManager: INFO: Starting task 59.0 in stage 2.0 (TID 942, localhost, executor driver, partition 59, PROCESS_LOCAL, 9166 bytes) 2020-02-15 07:21:19 TaskSetManager: INFO: Finished task 58.0 in stage 2.0 (TID 941) in 225395 ms on localhost (executor driver) (59/882) 2020-02-15 07:21:19 Executor: INFO: Running task 59.0 in stage 2.0 (TID 942) 2020-02-15 07:21:19 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:21:19 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:21:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:1979711488+33554432 2020-02-15 07:21:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:24:58 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000059_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000059 2020-02-15 07:24:58 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000059_0: Committed 2020-02-15 07:24:58 Executor: INFO: Finished task 59.0 in stage 2.0 (TID 942). 959 bytes result sent to driver 2020-02-15 07:24:58 TaskSetManager: INFO: Starting task 60.0 in stage 2.0 (TID 943, localhost, executor driver, partition 60, PROCESS_LOCAL, 9171 bytes) 2020-02-15 07:24:58 TaskSetManager: INFO: Finished task 59.0 in stage 2.0 (TID 942) in 218805 ms on localhost (executor driver) (60/882) 2020-02-15 07:24:58 Executor: INFO: Running task 60.0 in stage 2.0 (TID 943) 2020-02-15 07:24:58 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:24:58 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:24:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2013265920+33554432 2020-02-15 07:24:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:29:14 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000060_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000060 2020-02-15 07:29:14 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000060_0: Committed 2020-02-15 07:29:14 Executor: INFO: Finished task 60.0 in stage 2.0 (TID 943). 959 bytes result sent to driver 2020-02-15 07:29:14 TaskSetManager: INFO: Starting task 61.0 in stage 2.0 (TID 944, localhost, executor driver, partition 61, PROCESS_LOCAL, 9166 bytes) 2020-02-15 07:29:14 TaskSetManager: INFO: Finished task 60.0 in stage 2.0 (TID 943) in 256099 ms on localhost (executor driver) (61/882) 2020-02-15 07:29:14 Executor: INFO: Running task 61.0 in stage 2.0 (TID 944) 2020-02-15 07:29:14 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:29:14 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:29:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2046820352+33554432 2020-02-15 07:29:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:33:18 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000061_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000061 2020-02-15 07:33:18 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000061_0: Committed 2020-02-15 07:33:18 Executor: INFO: Finished task 61.0 in stage 2.0 (TID 944). 959 bytes result sent to driver 2020-02-15 07:33:18 TaskSetManager: INFO: Starting task 62.0 in stage 2.0 (TID 945, localhost, executor driver, partition 62, PROCESS_LOCAL, 9166 bytes) 2020-02-15 07:33:18 TaskSetManager: INFO: Finished task 61.0 in stage 2.0 (TID 944) in 244015 ms on localhost (executor driver) (62/882) 2020-02-15 07:33:18 Executor: INFO: Running task 62.0 in stage 2.0 (TID 945) 2020-02-15 07:33:18 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:33:18 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:33:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2080374784+33554432 2020-02-15 07:33:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:37:04 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000062_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000062 2020-02-15 07:37:04 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000062_0: Committed 2020-02-15 07:37:04 Executor: INFO: Finished task 62.0 in stage 2.0 (TID 945). 959 bytes result sent to driver 2020-02-15 07:37:04 TaskSetManager: INFO: Starting task 63.0 in stage 2.0 (TID 946, localhost, executor driver, partition 63, PROCESS_LOCAL, 9166 bytes) 2020-02-15 07:37:04 TaskSetManager: INFO: Finished task 62.0 in stage 2.0 (TID 945) in 226282 ms on localhost (executor driver) (63/882) 2020-02-15 07:37:04 Executor: INFO: Running task 63.0 in stage 2.0 (TID 946) 2020-02-15 07:37:04 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:37:04 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:37:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2113929216+33554432 2020-02-15 07:37:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:40:54 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000063_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000063 2020-02-15 07:40:54 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000063_0: Committed 2020-02-15 07:40:54 Executor: INFO: Finished task 63.0 in stage 2.0 (TID 946). 1002 bytes result sent to driver 2020-02-15 07:40:54 TaskSetManager: INFO: Starting task 64.0 in stage 2.0 (TID 947, localhost, executor driver, partition 64, PROCESS_LOCAL, 9166 bytes) 2020-02-15 07:40:54 TaskSetManager: INFO: Finished task 63.0 in stage 2.0 (TID 946) in 229591 ms on localhost (executor driver) (64/882) 2020-02-15 07:40:54 Executor: INFO: Running task 64.0 in stage 2.0 (TID 947) 2020-02-15 07:40:54 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:40:54 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:40:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2147483648+33554432 2020-02-15 07:40:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:45:34 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000064_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000064 2020-02-15 07:45:34 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000064_0: Committed 2020-02-15 07:45:34 Executor: INFO: Finished task 64.0 in stage 2.0 (TID 947). 959 bytes result sent to driver 2020-02-15 07:45:34 TaskSetManager: INFO: Starting task 65.0 in stage 2.0 (TID 948, localhost, executor driver, partition 65, PROCESS_LOCAL, 9166 bytes) 2020-02-15 07:45:34 TaskSetManager: INFO: Finished task 64.0 in stage 2.0 (TID 947) in 280694 ms on localhost (executor driver) (65/882) 2020-02-15 07:45:34 Executor: INFO: Running task 65.0 in stage 2.0 (TID 948) 2020-02-15 07:45:34 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:45:34 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:45:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2181038080+33554432 2020-02-15 07:45:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:49:58 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000065_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000065 2020-02-15 07:49:58 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000065_0: Committed 2020-02-15 07:49:58 Executor: INFO: Finished task 65.0 in stage 2.0 (TID 948). 959 bytes result sent to driver 2020-02-15 07:49:58 TaskSetManager: INFO: Starting task 66.0 in stage 2.0 (TID 949, localhost, executor driver, partition 66, PROCESS_LOCAL, 9166 bytes) 2020-02-15 07:49:58 TaskSetManager: INFO: Finished task 65.0 in stage 2.0 (TID 948) in 263721 ms on localhost (executor driver) (66/882) 2020-02-15 07:49:58 Executor: INFO: Running task 66.0 in stage 2.0 (TID 949) 2020-02-15 07:49:58 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:49:58 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:49:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2214592512+33554432 2020-02-15 07:49:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:52:23 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000066_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000066 2020-02-15 07:52:23 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000066_0: Committed 2020-02-15 07:52:23 Executor: INFO: Finished task 66.0 in stage 2.0 (TID 949). 959 bytes result sent to driver 2020-02-15 07:52:23 TaskSetManager: INFO: Starting task 67.0 in stage 2.0 (TID 950, localhost, executor driver, partition 67, PROCESS_LOCAL, 9166 bytes) 2020-02-15 07:52:23 TaskSetManager: INFO: Finished task 66.0 in stage 2.0 (TID 949) in 145444 ms on localhost (executor driver) (67/882) 2020-02-15 07:52:23 Executor: INFO: Running task 67.0 in stage 2.0 (TID 950) 2020-02-15 07:52:23 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:52:23 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:52:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2248146944+33554432 2020-02-15 07:52:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:54:31 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000067_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000067 2020-02-15 07:54:31 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000067_0: Committed 2020-02-15 07:54:31 Executor: INFO: Finished task 67.0 in stage 2.0 (TID 950). 959 bytes result sent to driver 2020-02-15 07:54:31 TaskSetManager: INFO: Starting task 68.0 in stage 2.0 (TID 951, localhost, executor driver, partition 68, PROCESS_LOCAL, 9321 bytes) 2020-02-15 07:54:31 TaskSetManager: INFO: Finished task 67.0 in stage 2.0 (TID 950) in 127997 ms on localhost (executor driver) (68/882) 2020-02-15 07:54:31 Executor: INFO: Running task 68.0 in stage 2.0 (TID 951) 2020-02-15 07:54:31 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 07:54:31 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 07:54:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2281701376+33554432 2020-02-15 07:54:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 07:58:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2315255808+33554432 2020-02-15 07:58:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:01:58 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000068_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000068 2020-02-15 08:01:58 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000068_0: Committed 2020-02-15 08:01:58 Executor: INFO: Finished task 68.0 in stage 2.0 (TID 951). 959 bytes result sent to driver 2020-02-15 08:01:58 TaskSetManager: INFO: Starting task 69.0 in stage 2.0 (TID 952, localhost, executor driver, partition 69, PROCESS_LOCAL, 9136 bytes) 2020-02-15 08:01:58 TaskSetManager: INFO: Finished task 68.0 in stage 2.0 (TID 951) in 446478 ms on localhost (executor driver) (69/882) 2020-02-15 08:01:58 Executor: INFO: Running task 69.0 in stage 2.0 (TID 952) 2020-02-15 08:01:58 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:01:58 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:01:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2315255808+33554432 2020-02-15 08:01:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:05:45 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000069_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000069 2020-02-15 08:05:45 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000069_0: Committed 2020-02-15 08:05:45 Executor: INFO: Finished task 69.0 in stage 2.0 (TID 952). 959 bytes result sent to driver 2020-02-15 08:05:45 TaskSetManager: INFO: Starting task 70.0 in stage 2.0 (TID 953, localhost, executor driver, partition 70, PROCESS_LOCAL, 9166 bytes) 2020-02-15 08:05:45 TaskSetManager: INFO: Finished task 69.0 in stage 2.0 (TID 952) in 227396 ms on localhost (executor driver) (70/882) 2020-02-15 08:05:45 Executor: INFO: Running task 70.0 in stage 2.0 (TID 953) 2020-02-15 08:05:45 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:05:45 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:05:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2348810240+33554432 2020-02-15 08:05:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:10:00 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000070_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000070 2020-02-15 08:10:00 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000070_0: Committed 2020-02-15 08:10:00 Executor: INFO: Finished task 70.0 in stage 2.0 (TID 953). 959 bytes result sent to driver 2020-02-15 08:10:00 TaskSetManager: INFO: Starting task 71.0 in stage 2.0 (TID 954, localhost, executor driver, partition 71, PROCESS_LOCAL, 9166 bytes) 2020-02-15 08:10:00 TaskSetManager: INFO: Finished task 70.0 in stage 2.0 (TID 953) in 254599 ms on localhost (executor driver) (71/882) 2020-02-15 08:10:00 Executor: INFO: Running task 71.0 in stage 2.0 (TID 954) 2020-02-15 08:10:00 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:10:00 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:10:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2382364672+33554432 2020-02-15 08:10:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:14:05 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000071_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000071 2020-02-15 08:14:05 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000071_0: Committed 2020-02-15 08:14:05 Executor: INFO: Finished task 71.0 in stage 2.0 (TID 954). 959 bytes result sent to driver 2020-02-15 08:14:05 TaskSetManager: INFO: Starting task 72.0 in stage 2.0 (TID 955, localhost, executor driver, partition 72, PROCESS_LOCAL, 9166 bytes) 2020-02-15 08:14:05 TaskSetManager: INFO: Finished task 71.0 in stage 2.0 (TID 954) in 245440 ms on localhost (executor driver) (72/882) 2020-02-15 08:14:05 Executor: INFO: Running task 72.0 in stage 2.0 (TID 955) 2020-02-15 08:14:05 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:14:05 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:14:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2415919104+33554432 2020-02-15 08:14:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:18:36 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000072_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000072 2020-02-15 08:18:36 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000072_0: Committed 2020-02-15 08:18:36 Executor: INFO: Finished task 72.0 in stage 2.0 (TID 955). 959 bytes result sent to driver 2020-02-15 08:18:36 TaskSetManager: INFO: Starting task 73.0 in stage 2.0 (TID 956, localhost, executor driver, partition 73, PROCESS_LOCAL, 9166 bytes) 2020-02-15 08:18:36 TaskSetManager: INFO: Finished task 72.0 in stage 2.0 (TID 955) in 270812 ms on localhost (executor driver) (73/882) 2020-02-15 08:18:36 Executor: INFO: Running task 73.0 in stage 2.0 (TID 956) 2020-02-15 08:18:36 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:18:36 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:18:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2449473536+33554432 2020-02-15 08:18:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:22:24 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000073_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000073 2020-02-15 08:22:24 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000073_0: Committed 2020-02-15 08:22:24 Executor: INFO: Finished task 73.0 in stage 2.0 (TID 956). 959 bytes result sent to driver 2020-02-15 08:22:24 TaskSetManager: INFO: Starting task 74.0 in stage 2.0 (TID 957, localhost, executor driver, partition 74, PROCESS_LOCAL, 9166 bytes) 2020-02-15 08:22:24 TaskSetManager: INFO: Finished task 73.0 in stage 2.0 (TID 956) in 227590 ms on localhost (executor driver) (74/882) 2020-02-15 08:22:24 Executor: INFO: Running task 74.0 in stage 2.0 (TID 957) 2020-02-15 08:22:24 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:22:24 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:22:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2483027968+33554432 2020-02-15 08:22:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:26:12 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000074_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000074 2020-02-15 08:26:12 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000074_0: Committed 2020-02-15 08:26:12 Executor: INFO: Finished task 74.0 in stage 2.0 (TID 957). 959 bytes result sent to driver 2020-02-15 08:26:12 TaskSetManager: INFO: Starting task 75.0 in stage 2.0 (TID 958, localhost, executor driver, partition 75, PROCESS_LOCAL, 9168 bytes) 2020-02-15 08:26:12 TaskSetManager: INFO: Finished task 74.0 in stage 2.0 (TID 957) in 228246 ms on localhost (executor driver) (75/882) 2020-02-15 08:26:12 Executor: INFO: Running task 75.0 in stage 2.0 (TID 958) 2020-02-15 08:26:12 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:26:12 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:26:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2516582400+33554432 2020-02-15 08:26:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:30:28 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000075_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000075 2020-02-15 08:30:28 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000075_0: Committed 2020-02-15 08:30:28 Executor: INFO: Finished task 75.0 in stage 2.0 (TID 958). 959 bytes result sent to driver 2020-02-15 08:30:28 TaskSetManager: INFO: Starting task 76.0 in stage 2.0 (TID 959, localhost, executor driver, partition 76, PROCESS_LOCAL, 9166 bytes) 2020-02-15 08:30:28 TaskSetManager: INFO: Finished task 75.0 in stage 2.0 (TID 958) in 256537 ms on localhost (executor driver) (76/882) 2020-02-15 08:30:28 Executor: INFO: Running task 76.0 in stage 2.0 (TID 959) 2020-02-15 08:30:28 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:30:28 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:30:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2550136832+33554432 2020-02-15 08:30:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:34:14 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000076_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000076 2020-02-15 08:34:14 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000076_0: Committed 2020-02-15 08:34:14 Executor: INFO: Finished task 76.0 in stage 2.0 (TID 959). 959 bytes result sent to driver 2020-02-15 08:34:14 TaskSetManager: INFO: Starting task 77.0 in stage 2.0 (TID 960, localhost, executor driver, partition 77, PROCESS_LOCAL, 9166 bytes) 2020-02-15 08:34:14 TaskSetManager: INFO: Finished task 76.0 in stage 2.0 (TID 959) in 225095 ms on localhost (executor driver) (77/882) 2020-02-15 08:34:14 Executor: INFO: Running task 77.0 in stage 2.0 (TID 960) 2020-02-15 08:34:14 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:34:14 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:34:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2583691264+33554432 2020-02-15 08:34:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:37:42 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000077_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000077 2020-02-15 08:37:42 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000077_0: Committed 2020-02-15 08:37:42 Executor: INFO: Finished task 77.0 in stage 2.0 (TID 960). 959 bytes result sent to driver 2020-02-15 08:37:42 TaskSetManager: INFO: Starting task 78.0 in stage 2.0 (TID 961, localhost, executor driver, partition 78, PROCESS_LOCAL, 9166 bytes) 2020-02-15 08:37:42 TaskSetManager: INFO: Finished task 77.0 in stage 2.0 (TID 960) in 208774 ms on localhost (executor driver) (78/882) 2020-02-15 08:37:42 Executor: INFO: Running task 78.0 in stage 2.0 (TID 961) 2020-02-15 08:37:42 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:37:42 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:37:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2617245696+33554432 2020-02-15 08:37:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:40:14 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000078_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000078 2020-02-15 08:40:14 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000078_0: Committed 2020-02-15 08:40:14 Executor: INFO: Finished task 78.0 in stage 2.0 (TID 961). 959 bytes result sent to driver 2020-02-15 08:40:14 TaskSetManager: INFO: Starting task 79.0 in stage 2.0 (TID 962, localhost, executor driver, partition 79, PROCESS_LOCAL, 9166 bytes) 2020-02-15 08:40:14 TaskSetManager: INFO: Finished task 78.0 in stage 2.0 (TID 961) in 151236 ms on localhost (executor driver) (79/882) 2020-02-15 08:40:14 Executor: INFO: Running task 79.0 in stage 2.0 (TID 962) 2020-02-15 08:40:14 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:40:14 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:40:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2650800128+33554432 2020-02-15 08:40:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:44:37 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000079_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000079 2020-02-15 08:44:37 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000079_0: Committed 2020-02-15 08:44:37 Executor: INFO: Finished task 79.0 in stage 2.0 (TID 962). 959 bytes result sent to driver 2020-02-15 08:44:37 TaskSetManager: INFO: Starting task 80.0 in stage 2.0 (TID 963, localhost, executor driver, partition 80, PROCESS_LOCAL, 9166 bytes) 2020-02-15 08:44:37 TaskSetManager: INFO: Finished task 79.0 in stage 2.0 (TID 962) in 263784 ms on localhost (executor driver) (80/882) 2020-02-15 08:44:37 Executor: INFO: Running task 80.0 in stage 2.0 (TID 963) 2020-02-15 08:44:37 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:44:37 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:44:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2684354560+33554432 2020-02-15 08:44:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:47:47 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000080_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000080 2020-02-15 08:47:47 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000080_0: Committed 2020-02-15 08:47:47 Executor: INFO: Finished task 80.0 in stage 2.0 (TID 963). 959 bytes result sent to driver 2020-02-15 08:47:47 TaskSetManager: INFO: Starting task 81.0 in stage 2.0 (TID 964, localhost, executor driver, partition 81, PROCESS_LOCAL, 9166 bytes) 2020-02-15 08:47:47 TaskSetManager: INFO: Finished task 80.0 in stage 2.0 (TID 963) in 189971 ms on localhost (executor driver) (81/882) 2020-02-15 08:47:47 Executor: INFO: Running task 81.0 in stage 2.0 (TID 964) 2020-02-15 08:47:47 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:47:47 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:47:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2717908992+33554432 2020-02-15 08:47:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:51:04 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000081_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000081 2020-02-15 08:51:04 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000081_0: Committed 2020-02-15 08:51:04 Executor: INFO: Finished task 81.0 in stage 2.0 (TID 964). 959 bytes result sent to driver 2020-02-15 08:51:04 TaskSetManager: INFO: Starting task 82.0 in stage 2.0 (TID 965, localhost, executor driver, partition 82, PROCESS_LOCAL, 9321 bytes) 2020-02-15 08:51:04 TaskSetManager: INFO: Finished task 81.0 in stage 2.0 (TID 964) in 196451 ms on localhost (executor driver) (82/882) 2020-02-15 08:51:04 Executor: INFO: Running task 82.0 in stage 2.0 (TID 965) 2020-02-15 08:51:04 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:51:04 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:51:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2751463424+33554432 2020-02-15 08:51:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:54:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2785017856+33554432 2020-02-15 08:54:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 08:58:54 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000082_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000082 2020-02-15 08:58:54 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000082_0: Committed 2020-02-15 08:58:54 Executor: INFO: Finished task 82.0 in stage 2.0 (TID 965). 959 bytes result sent to driver 2020-02-15 08:58:54 TaskSetManager: INFO: Starting task 83.0 in stage 2.0 (TID 966, localhost, executor driver, partition 83, PROCESS_LOCAL, 8749 bytes) 2020-02-15 08:58:54 TaskSetManager: INFO: Finished task 82.0 in stage 2.0 (TID 965) in 470710 ms on localhost (executor driver) (83/882) 2020-02-15 08:58:54 Executor: INFO: Running task 83.0 in stage 2.0 (TID 966) 2020-02-15 08:58:55 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 08:58:55 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 08:59:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2785017856+33554432 2020-02-15 08:59:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:03:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2818572288+33554432 2020-02-15 09:03:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:06:15 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000083_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000083 2020-02-15 09:06:15 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000083_0: Committed 2020-02-15 09:06:15 Executor: INFO: Finished task 83.0 in stage 2.0 (TID 966). 1002 bytes result sent to driver 2020-02-15 09:06:15 TaskSetManager: INFO: Starting task 84.0 in stage 2.0 (TID 967, localhost, executor driver, partition 84, PROCESS_LOCAL, 8749 bytes) 2020-02-15 09:06:15 TaskSetManager: INFO: Finished task 83.0 in stage 2.0 (TID 966) in 440730 ms on localhost (executor driver) (84/882) 2020-02-15 09:06:15 Executor: INFO: Running task 84.0 in stage 2.0 (TID 967) 2020-02-15 09:06:15 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 09:06:15 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 09:06:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2818572288+33554432 2020-02-15 09:06:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:09:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2852126720+33554432 2020-02-15 09:09:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:13:01 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000084_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000084 2020-02-15 09:13:01 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000084_0: Committed 2020-02-15 09:13:01 Executor: INFO: Finished task 84.0 in stage 2.0 (TID 967). 959 bytes result sent to driver 2020-02-15 09:13:01 TaskSetManager: INFO: Starting task 85.0 in stage 2.0 (TID 968, localhost, executor driver, partition 85, PROCESS_LOCAL, 9136 bytes) 2020-02-15 09:13:01 TaskSetManager: INFO: Finished task 84.0 in stage 2.0 (TID 967) in 406230 ms on localhost (executor driver) (85/882) 2020-02-15 09:13:01 Executor: INFO: Running task 85.0 in stage 2.0 (TID 968) 2020-02-15 09:13:01 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 09:13:01 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 09:13:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2852126720+33554432 2020-02-15 09:13:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:16:53 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000085_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000085 2020-02-15 09:16:53 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000085_0: Committed 2020-02-15 09:16:53 Executor: INFO: Finished task 85.0 in stage 2.0 (TID 968). 959 bytes result sent to driver 2020-02-15 09:16:53 TaskSetManager: INFO: Starting task 86.0 in stage 2.0 (TID 969, localhost, executor driver, partition 86, PROCESS_LOCAL, 9321 bytes) 2020-02-15 09:16:53 TaskSetManager: INFO: Finished task 85.0 in stage 2.0 (TID 968) in 231608 ms on localhost (executor driver) (86/882) 2020-02-15 09:16:53 Executor: INFO: Running task 86.0 in stage 2.0 (TID 969) 2020-02-15 09:16:53 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 09:16:53 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 09:16:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2885681152+33554432 2020-02-15 09:16:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:21:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2919235584+33554432 2020-02-15 09:21:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:26:32 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000086_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000086 2020-02-15 09:26:32 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000086_0: Committed 2020-02-15 09:26:32 Executor: INFO: Finished task 86.0 in stage 2.0 (TID 969). 959 bytes result sent to driver 2020-02-15 09:26:32 TaskSetManager: INFO: Starting task 87.0 in stage 2.0 (TID 970, localhost, executor driver, partition 87, PROCESS_LOCAL, 9136 bytes) 2020-02-15 09:26:32 TaskSetManager: INFO: Finished task 86.0 in stage 2.0 (TID 969) in 579412 ms on localhost (executor driver) (87/882) 2020-02-15 09:26:32 Executor: INFO: Running task 87.0 in stage 2.0 (TID 970) 2020-02-15 09:26:32 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 09:26:32 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 09:26:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2919235584+33554432 2020-02-15 09:26:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:31:38 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000087_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000087 2020-02-15 09:31:38 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000087_0: Committed 2020-02-15 09:31:38 Executor: INFO: Finished task 87.0 in stage 2.0 (TID 970). 959 bytes result sent to driver 2020-02-15 09:31:38 TaskSetManager: INFO: Starting task 88.0 in stage 2.0 (TID 971, localhost, executor driver, partition 88, PROCESS_LOCAL, 9166 bytes) 2020-02-15 09:31:38 TaskSetManager: INFO: Finished task 87.0 in stage 2.0 (TID 970) in 305504 ms on localhost (executor driver) (88/882) 2020-02-15 09:31:38 Executor: INFO: Running task 88.0 in stage 2.0 (TID 971) 2020-02-15 09:31:38 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 09:31:38 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 09:31:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2952790016+33554432 2020-02-15 09:31:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:36:47 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000088_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000088 2020-02-15 09:36:47 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000088_0: Committed 2020-02-15 09:36:47 Executor: INFO: Finished task 88.0 in stage 2.0 (TID 971). 959 bytes result sent to driver 2020-02-15 09:36:47 TaskSetManager: INFO: Starting task 89.0 in stage 2.0 (TID 972, localhost, executor driver, partition 89, PROCESS_LOCAL, 9166 bytes) 2020-02-15 09:36:47 TaskSetManager: INFO: Finished task 88.0 in stage 2.0 (TID 971) in 308874 ms on localhost (executor driver) (89/882) 2020-02-15 09:36:47 Executor: INFO: Running task 89.0 in stage 2.0 (TID 972) 2020-02-15 09:36:47 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 09:36:47 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 09:36:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:2986344448+33554432 2020-02-15 09:36:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:41:14 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000089_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000089 2020-02-15 09:41:14 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000089_0: Committed 2020-02-15 09:41:14 Executor: INFO: Finished task 89.0 in stage 2.0 (TID 972). 1002 bytes result sent to driver 2020-02-15 09:41:14 TaskSetManager: INFO: Starting task 90.0 in stage 2.0 (TID 973, localhost, executor driver, partition 90, PROCESS_LOCAL, 9321 bytes) 2020-02-15 09:41:14 TaskSetManager: INFO: Finished task 89.0 in stage 2.0 (TID 972) in 267509 ms on localhost (executor driver) (90/882) 2020-02-15 09:41:14 Executor: INFO: Running task 90.0 in stage 2.0 (TID 973) 2020-02-15 09:41:14 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 09:41:14 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 09:41:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3019898880+33554432 2020-02-15 09:41:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:45:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3053453312+33554432 2020-02-15 09:45:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:49:12 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000090_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000090 2020-02-15 09:49:12 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000090_0: Committed 2020-02-15 09:49:12 Executor: INFO: Finished task 90.0 in stage 2.0 (TID 973). 959 bytes result sent to driver 2020-02-15 09:49:12 TaskSetManager: INFO: Starting task 91.0 in stage 2.0 (TID 974, localhost, executor driver, partition 91, PROCESS_LOCAL, 9136 bytes) 2020-02-15 09:49:12 TaskSetManager: INFO: Finished task 90.0 in stage 2.0 (TID 973) in 477206 ms on localhost (executor driver) (91/882) 2020-02-15 09:49:12 Executor: INFO: Running task 91.0 in stage 2.0 (TID 974) 2020-02-15 09:49:12 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 09:49:12 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 09:49:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3053453312+33554432 2020-02-15 09:49:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:53:05 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000091_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000091 2020-02-15 09:53:05 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000091_0: Committed 2020-02-15 09:53:05 Executor: INFO: Finished task 91.0 in stage 2.0 (TID 974). 1002 bytes result sent to driver 2020-02-15 09:53:05 TaskSetManager: INFO: Starting task 92.0 in stage 2.0 (TID 975, localhost, executor driver, partition 92, PROCESS_LOCAL, 9166 bytes) 2020-02-15 09:53:05 TaskSetManager: INFO: Finished task 91.0 in stage 2.0 (TID 974) in 233486 ms on localhost (executor driver) (92/882) 2020-02-15 09:53:05 Executor: INFO: Running task 92.0 in stage 2.0 (TID 975) 2020-02-15 09:53:05 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 09:53:05 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 09:53:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3087007744+33554432 2020-02-15 09:53:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 09:56:55 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000092_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000092 2020-02-15 09:56:55 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000092_0: Committed 2020-02-15 09:56:55 Executor: INFO: Finished task 92.0 in stage 2.0 (TID 975). 959 bytes result sent to driver 2020-02-15 09:56:55 TaskSetManager: INFO: Starting task 93.0 in stage 2.0 (TID 976, localhost, executor driver, partition 93, PROCESS_LOCAL, 9166 bytes) 2020-02-15 09:56:55 TaskSetManager: INFO: Finished task 92.0 in stage 2.0 (TID 975) in 229853 ms on localhost (executor driver) (93/882) 2020-02-15 09:56:55 Executor: INFO: Running task 93.0 in stage 2.0 (TID 976) 2020-02-15 09:56:55 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 09:56:55 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 09:56:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3120562176+33554432 2020-02-15 09:56:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:00:28 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000093_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000093 2020-02-15 10:00:28 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000093_0: Committed 2020-02-15 10:00:28 Executor: INFO: Finished task 93.0 in stage 2.0 (TID 976). 959 bytes result sent to driver 2020-02-15 10:00:28 TaskSetManager: INFO: Starting task 94.0 in stage 2.0 (TID 977, localhost, executor driver, partition 94, PROCESS_LOCAL, 9321 bytes) 2020-02-15 10:00:28 TaskSetManager: INFO: Finished task 93.0 in stage 2.0 (TID 976) in 213389 ms on localhost (executor driver) (94/882) 2020-02-15 10:00:28 Executor: INFO: Running task 94.0 in stage 2.0 (TID 977) 2020-02-15 10:00:28 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 10:00:28 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 10:00:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3154116608+33554432 2020-02-15 10:00:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:04:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3187671040+33554432 2020-02-15 10:04:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:09:17 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000094_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000094 2020-02-15 10:09:17 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000094_0: Committed 2020-02-15 10:09:17 Executor: INFO: Finished task 94.0 in stage 2.0 (TID 977). 959 bytes result sent to driver 2020-02-15 10:09:17 TaskSetManager: INFO: Starting task 95.0 in stage 2.0 (TID 978, localhost, executor driver, partition 95, PROCESS_LOCAL, 9136 bytes) 2020-02-15 10:09:17 TaskSetManager: INFO: Finished task 94.0 in stage 2.0 (TID 977) in 528463 ms on localhost (executor driver) (95/882) 2020-02-15 10:09:17 Executor: INFO: Running task 95.0 in stage 2.0 (TID 978) 2020-02-15 10:09:17 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 10:09:17 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 10:09:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3187671040+33554432 2020-02-15 10:09:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:14:06 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000095_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000095 2020-02-15 10:14:06 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000095_0: Committed 2020-02-15 10:14:06 Executor: INFO: Finished task 95.0 in stage 2.0 (TID 978). 959 bytes result sent to driver 2020-02-15 10:14:06 TaskSetManager: INFO: Starting task 96.0 in stage 2.0 (TID 979, localhost, executor driver, partition 96, PROCESS_LOCAL, 9321 bytes) 2020-02-15 10:14:06 TaskSetManager: INFO: Finished task 95.0 in stage 2.0 (TID 978) in 289153 ms on localhost (executor driver) (96/882) 2020-02-15 10:14:06 Executor: INFO: Running task 96.0 in stage 2.0 (TID 979) 2020-02-15 10:14:06 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 10:14:06 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 10:14:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3221225472+33554432 2020-02-15 10:14:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:18:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3254779904+33554432 2020-02-15 10:18:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:22:01 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000096_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000096 2020-02-15 10:22:01 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000096_0: Committed 2020-02-15 10:22:01 Executor: INFO: Finished task 96.0 in stage 2.0 (TID 979). 959 bytes result sent to driver 2020-02-15 10:22:01 TaskSetManager: INFO: Starting task 97.0 in stage 2.0 (TID 980, localhost, executor driver, partition 97, PROCESS_LOCAL, 8749 bytes) 2020-02-15 10:22:01 TaskSetManager: INFO: Finished task 96.0 in stage 2.0 (TID 979) in 474913 ms on localhost (executor driver) (97/882) 2020-02-15 10:22:01 Executor: INFO: Running task 97.0 in stage 2.0 (TID 980) 2020-02-15 10:22:01 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 10:22:01 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 10:22:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3254779904+33554432 2020-02-15 10:22:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:25:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3288334336+33554432 2020-02-15 10:25:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:29:18 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000097_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000097 2020-02-15 10:29:18 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000097_0: Committed 2020-02-15 10:29:18 Executor: INFO: Finished task 97.0 in stage 2.0 (TID 980). 959 bytes result sent to driver 2020-02-15 10:29:18 TaskSetManager: INFO: Starting task 98.0 in stage 2.0 (TID 981, localhost, executor driver, partition 98, PROCESS_LOCAL, 8749 bytes) 2020-02-15 10:29:18 TaskSetManager: INFO: Finished task 97.0 in stage 2.0 (TID 980) in 436892 ms on localhost (executor driver) (98/882) 2020-02-15 10:29:18 Executor: INFO: Running task 98.0 in stage 2.0 (TID 981) 2020-02-15 10:29:18 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 10:29:18 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 10:29:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3288334336+33554432 2020-02-15 10:29:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:32:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3321888768+33554432 2020-02-15 10:32:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:35:30 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000098_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000098 2020-02-15 10:35:30 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000098_0: Committed 2020-02-15 10:35:30 Executor: INFO: Finished task 98.0 in stage 2.0 (TID 981). 959 bytes result sent to driver 2020-02-15 10:35:30 TaskSetManager: INFO: Starting task 99.0 in stage 2.0 (TID 982, localhost, executor driver, partition 99, PROCESS_LOCAL, 9136 bytes) 2020-02-15 10:35:30 TaskSetManager: INFO: Finished task 98.0 in stage 2.0 (TID 981) in 372463 ms on localhost (executor driver) (99/882) 2020-02-15 10:35:30 Executor: INFO: Running task 99.0 in stage 2.0 (TID 982) 2020-02-15 10:35:30 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 10:35:30 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 10:35:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3321888768+33554432 2020-02-15 10:35:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:38:29 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000099_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000099 2020-02-15 10:38:29 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000099_0: Committed 2020-02-15 10:38:29 Executor: INFO: Finished task 99.0 in stage 2.0 (TID 982). 959 bytes result sent to driver 2020-02-15 10:38:29 TaskSetManager: INFO: Starting task 100.0 in stage 2.0 (TID 983, localhost, executor driver, partition 100, PROCESS_LOCAL, 9321 bytes) 2020-02-15 10:38:29 TaskSetManager: INFO: Finished task 99.0 in stage 2.0 (TID 982) in 179100 ms on localhost (executor driver) (100/882) 2020-02-15 10:38:29 Executor: INFO: Running task 100.0 in stage 2.0 (TID 983) 2020-02-15 10:38:29 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 10:38:29 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 10:38:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3355443200+33554432 2020-02-15 10:38:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:42:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3388997632+33554432 2020-02-15 10:42:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:45:18 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000100_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000100 2020-02-15 10:45:18 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000100_0: Committed 2020-02-15 10:45:18 Executor: INFO: Finished task 100.0 in stage 2.0 (TID 983). 1002 bytes result sent to driver 2020-02-15 10:45:18 TaskSetManager: INFO: Starting task 101.0 in stage 2.0 (TID 984, localhost, executor driver, partition 101, PROCESS_LOCAL, 9136 bytes) 2020-02-15 10:45:18 TaskSetManager: INFO: Finished task 100.0 in stage 2.0 (TID 983) in 408874 ms on localhost (executor driver) (101/882) 2020-02-15 10:45:18 Executor: INFO: Running task 101.0 in stage 2.0 (TID 984) 2020-02-15 10:45:18 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 10:45:18 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 10:45:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3388997632+33554432 2020-02-15 10:45:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:48:41 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000101_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000101 2020-02-15 10:48:41 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000101_0: Committed 2020-02-15 10:48:41 Executor: INFO: Finished task 101.0 in stage 2.0 (TID 984). 959 bytes result sent to driver 2020-02-15 10:48:41 TaskSetManager: INFO: Starting task 102.0 in stage 2.0 (TID 985, localhost, executor driver, partition 102, PROCESS_LOCAL, 9166 bytes) 2020-02-15 10:48:41 TaskSetManager: INFO: Finished task 101.0 in stage 2.0 (TID 984) in 203185 ms on localhost (executor driver) (102/882) 2020-02-15 10:48:41 Executor: INFO: Running task 102.0 in stage 2.0 (TID 985) 2020-02-15 10:48:41 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 10:48:41 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 10:48:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3422552064+33554432 2020-02-15 10:48:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:50:51 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000102_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000102 2020-02-15 10:50:51 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000102_0: Committed 2020-02-15 10:50:51 Executor: INFO: Finished task 102.0 in stage 2.0 (TID 985). 959 bytes result sent to driver 2020-02-15 10:50:51 TaskSetManager: INFO: Starting task 103.0 in stage 2.0 (TID 986, localhost, executor driver, partition 103, PROCESS_LOCAL, 9166 bytes) 2020-02-15 10:50:51 TaskSetManager: INFO: Finished task 102.0 in stage 2.0 (TID 985) in 129570 ms on localhost (executor driver) (103/882) 2020-02-15 10:50:51 Executor: INFO: Running task 103.0 in stage 2.0 (TID 986) 2020-02-15 10:50:51 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 10:50:51 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 10:50:51 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3456106496+33554432 2020-02-15 10:50:51 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:55:02 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000103_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000103 2020-02-15 10:55:02 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000103_0: Committed 2020-02-15 10:55:02 Executor: INFO: Finished task 103.0 in stage 2.0 (TID 986). 959 bytes result sent to driver 2020-02-15 10:55:02 TaskSetManager: INFO: Starting task 104.0 in stage 2.0 (TID 987, localhost, executor driver, partition 104, PROCESS_LOCAL, 9166 bytes) 2020-02-15 10:55:02 TaskSetManager: INFO: Finished task 103.0 in stage 2.0 (TID 986) in 250744 ms on localhost (executor driver) (104/882) 2020-02-15 10:55:02 Executor: INFO: Running task 104.0 in stage 2.0 (TID 987) 2020-02-15 10:55:02 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 10:55:02 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 10:55:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3489660928+33554432 2020-02-15 10:55:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 10:57:40 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000104_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000104 2020-02-15 10:57:40 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000104_0: Committed 2020-02-15 10:57:40 Executor: INFO: Finished task 104.0 in stage 2.0 (TID 987). 959 bytes result sent to driver 2020-02-15 10:57:40 TaskSetManager: INFO: Starting task 105.0 in stage 2.0 (TID 988, localhost, executor driver, partition 105, PROCESS_LOCAL, 9166 bytes) 2020-02-15 10:57:40 TaskSetManager: INFO: Finished task 104.0 in stage 2.0 (TID 987) in 157974 ms on localhost (executor driver) (105/882) 2020-02-15 10:57:40 Executor: INFO: Running task 105.0 in stage 2.0 (TID 988) 2020-02-15 10:57:40 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 10:57:40 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 10:57:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3523215360+33554432 2020-02-15 10:57:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:02:32 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000105_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000105 2020-02-15 11:02:32 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000105_0: Committed 2020-02-15 11:02:32 Executor: INFO: Finished task 105.0 in stage 2.0 (TID 988). 959 bytes result sent to driver 2020-02-15 11:02:32 TaskSetManager: INFO: Starting task 106.0 in stage 2.0 (TID 989, localhost, executor driver, partition 106, PROCESS_LOCAL, 9166 bytes) 2020-02-15 11:02:32 TaskSetManager: INFO: Finished task 105.0 in stage 2.0 (TID 988) in 292735 ms on localhost (executor driver) (106/882) 2020-02-15 11:02:32 Executor: INFO: Running task 106.0 in stage 2.0 (TID 989) 2020-02-15 11:02:32 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 11:02:32 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 11:02:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3556769792+33554432 2020-02-15 11:02:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:06:50 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000106_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000106 2020-02-15 11:06:50 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000106_0: Committed 2020-02-15 11:06:50 Executor: INFO: Finished task 106.0 in stage 2.0 (TID 989). 959 bytes result sent to driver 2020-02-15 11:06:50 TaskSetManager: INFO: Starting task 107.0 in stage 2.0 (TID 990, localhost, executor driver, partition 107, PROCESS_LOCAL, 9321 bytes) 2020-02-15 11:06:50 TaskSetManager: INFO: Finished task 106.0 in stage 2.0 (TID 989) in 257682 ms on localhost (executor driver) (107/882) 2020-02-15 11:06:50 Executor: INFO: Running task 107.0 in stage 2.0 (TID 990) 2020-02-15 11:06:50 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 11:06:50 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 11:06:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3590324224+33554432 2020-02-15 11:06:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:11:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3623878656+33554432 2020-02-15 11:11:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:15:04 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000107_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000107 2020-02-15 11:15:04 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000107_0: Committed 2020-02-15 11:15:04 Executor: INFO: Finished task 107.0 in stage 2.0 (TID 990). 1002 bytes result sent to driver 2020-02-15 11:15:04 TaskSetManager: INFO: Starting task 108.0 in stage 2.0 (TID 991, localhost, executor driver, partition 108, PROCESS_LOCAL, 8749 bytes) 2020-02-15 11:15:04 TaskSetManager: INFO: Finished task 107.0 in stage 2.0 (TID 990) in 494398 ms on localhost (executor driver) (108/882) 2020-02-15 11:15:04 Executor: INFO: Running task 108.0 in stage 2.0 (TID 991) 2020-02-15 11:15:04 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 11:15:04 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 11:15:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3623878656+33554432 2020-02-15 11:15:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:18:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3657433088+33554432 2020-02-15 11:18:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:22:29 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000108_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000108 2020-02-15 11:22:29 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000108_0: Committed 2020-02-15 11:22:29 Executor: INFO: Finished task 108.0 in stage 2.0 (TID 991). 959 bytes result sent to driver 2020-02-15 11:22:29 TaskSetManager: INFO: Starting task 109.0 in stage 2.0 (TID 992, localhost, executor driver, partition 109, PROCESS_LOCAL, 8749 bytes) 2020-02-15 11:22:29 TaskSetManager: INFO: Finished task 108.0 in stage 2.0 (TID 991) in 444520 ms on localhost (executor driver) (109/882) 2020-02-15 11:22:29 Executor: INFO: Running task 109.0 in stage 2.0 (TID 992) 2020-02-15 11:22:29 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 11:22:29 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 11:22:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3657433088+33554432 2020-02-15 11:22:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:26:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3690987520+33554432 2020-02-15 11:26:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:30:02 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000109_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000109 2020-02-15 11:30:02 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000109_0: Committed 2020-02-15 11:30:02 Executor: INFO: Finished task 109.0 in stage 2.0 (TID 992). 959 bytes result sent to driver 2020-02-15 11:30:02 TaskSetManager: INFO: Starting task 110.0 in stage 2.0 (TID 993, localhost, executor driver, partition 110, PROCESS_LOCAL, 9136 bytes) 2020-02-15 11:30:02 TaskSetManager: INFO: Finished task 109.0 in stage 2.0 (TID 992) in 452981 ms on localhost (executor driver) (110/882) 2020-02-15 11:30:02 Executor: INFO: Running task 110.0 in stage 2.0 (TID 993) 2020-02-15 11:30:02 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 11:30:02 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 11:30:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3690987520+33554432 2020-02-15 11:30:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:33:39 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000110_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000110 2020-02-15 11:33:39 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000110_0: Committed 2020-02-15 11:33:39 Executor: INFO: Finished task 110.0 in stage 2.0 (TID 993). 959 bytes result sent to driver 2020-02-15 11:33:39 TaskSetManager: INFO: Starting task 111.0 in stage 2.0 (TID 994, localhost, executor driver, partition 111, PROCESS_LOCAL, 9166 bytes) 2020-02-15 11:33:39 TaskSetManager: INFO: Finished task 110.0 in stage 2.0 (TID 993) in 217201 ms on localhost (executor driver) (111/882) 2020-02-15 11:33:39 Executor: INFO: Running task 111.0 in stage 2.0 (TID 994) 2020-02-15 11:33:39 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 11:33:39 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 11:33:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3724541952+33554432 2020-02-15 11:33:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:36:29 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000111_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000111 2020-02-15 11:36:29 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000111_0: Committed 2020-02-15 11:36:29 Executor: INFO: Finished task 111.0 in stage 2.0 (TID 994). 959 bytes result sent to driver 2020-02-15 11:36:29 TaskSetManager: INFO: Starting task 112.0 in stage 2.0 (TID 995, localhost, executor driver, partition 112, PROCESS_LOCAL, 9321 bytes) 2020-02-15 11:36:29 TaskSetManager: INFO: Finished task 111.0 in stage 2.0 (TID 994) in 169794 ms on localhost (executor driver) (112/882) 2020-02-15 11:36:29 Executor: INFO: Running task 112.0 in stage 2.0 (TID 995) 2020-02-15 11:36:29 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 11:36:29 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 11:36:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3758096384+33554432 2020-02-15 11:36:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:39:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3791650816+33554432 2020-02-15 11:39:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:43:10 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000112_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000112 2020-02-15 11:43:10 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000112_0: Committed 2020-02-15 11:43:10 Executor: INFO: Finished task 112.0 in stage 2.0 (TID 995). 959 bytes result sent to driver 2020-02-15 11:43:10 TaskSetManager: INFO: Starting task 113.0 in stage 2.0 (TID 996, localhost, executor driver, partition 113, PROCESS_LOCAL, 8749 bytes) 2020-02-15 11:43:10 TaskSetManager: INFO: Finished task 112.0 in stage 2.0 (TID 995) in 401480 ms on localhost (executor driver) (113/882) 2020-02-15 11:43:10 Executor: INFO: Running task 113.0 in stage 2.0 (TID 996) 2020-02-15 11:43:10 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 11:43:10 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 11:43:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3791650816+33554432 2020-02-15 11:43:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:46:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3825205248+33554432 2020-02-15 11:46:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:51:04 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000113_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000113 2020-02-15 11:51:04 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000113_0: Committed 2020-02-15 11:51:04 Executor: INFO: Finished task 113.0 in stage 2.0 (TID 996). 959 bytes result sent to driver 2020-02-15 11:51:04 TaskSetManager: INFO: Starting task 114.0 in stage 2.0 (TID 997, localhost, executor driver, partition 114, PROCESS_LOCAL, 8749 bytes) 2020-02-15 11:51:04 TaskSetManager: INFO: Finished task 113.0 in stage 2.0 (TID 996) in 473235 ms on localhost (executor driver) (114/882) 2020-02-15 11:51:04 Executor: INFO: Running task 114.0 in stage 2.0 (TID 997) 2020-02-15 11:51:04 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 11:51:04 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 11:51:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3825205248+33554432 2020-02-15 11:51:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:55:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3858759680+33554432 2020-02-15 11:55:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 11:58:11 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000114_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000114 2020-02-15 11:58:11 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000114_0: Committed 2020-02-15 11:58:11 Executor: INFO: Finished task 114.0 in stage 2.0 (TID 997). 959 bytes result sent to driver 2020-02-15 11:58:11 TaskSetManager: INFO: Starting task 115.0 in stage 2.0 (TID 998, localhost, executor driver, partition 115, PROCESS_LOCAL, 9136 bytes) 2020-02-15 11:58:11 TaskSetManager: INFO: Finished task 114.0 in stage 2.0 (TID 997) in 427353 ms on localhost (executor driver) (115/882) 2020-02-15 11:58:11 Executor: INFO: Running task 115.0 in stage 2.0 (TID 998) 2020-02-15 11:58:11 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 11:58:11 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 11:58:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3858759680+33554432 2020-02-15 11:58:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:01:11 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000115_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000115 2020-02-15 12:01:11 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000115_0: Committed 2020-02-15 12:01:11 Executor: INFO: Finished task 115.0 in stage 2.0 (TID 998). 959 bytes result sent to driver 2020-02-15 12:01:11 TaskSetManager: INFO: Starting task 116.0 in stage 2.0 (TID 999, localhost, executor driver, partition 116, PROCESS_LOCAL, 9321 bytes) 2020-02-15 12:01:11 TaskSetManager: INFO: Finished task 115.0 in stage 2.0 (TID 998) in 179923 ms on localhost (executor driver) (116/882) 2020-02-15 12:01:11 Executor: INFO: Running task 116.0 in stage 2.0 (TID 999) 2020-02-15 12:01:11 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:01:11 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:01:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3892314112+33554432 2020-02-15 12:01:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:04:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3925868544+33554432 2020-02-15 12:04:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:08:45 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000116_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000116 2020-02-15 12:08:45 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000116_0: Committed 2020-02-15 12:08:45 Executor: INFO: Finished task 116.0 in stage 2.0 (TID 999). 959 bytes result sent to driver 2020-02-15 12:08:45 TaskSetManager: INFO: Starting task 117.0 in stage 2.0 (TID 1000, localhost, executor driver, partition 117, PROCESS_LOCAL, 9139 bytes) 2020-02-15 12:08:45 TaskSetManager: INFO: Finished task 116.0 in stage 2.0 (TID 999) in 454356 ms on localhost (executor driver) (117/882) 2020-02-15 12:08:45 Executor: INFO: Running task 117.0 in stage 2.0 (TID 1000) 2020-02-15 12:08:45 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:08:45 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:08:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3925868544+33554432 2020-02-15 12:08:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:13:38 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000117_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000117 2020-02-15 12:13:38 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000117_0: Committed 2020-02-15 12:13:38 Executor: INFO: Finished task 117.0 in stage 2.0 (TID 1000). 959 bytes result sent to driver 2020-02-15 12:13:38 TaskSetManager: INFO: Starting task 118.0 in stage 2.0 (TID 1001, localhost, executor driver, partition 118, PROCESS_LOCAL, 9323 bytes) 2020-02-15 12:13:38 TaskSetManager: INFO: Finished task 117.0 in stage 2.0 (TID 1000) in 292470 ms on localhost (executor driver) (118/882) 2020-02-15 12:13:38 Executor: INFO: Running task 118.0 in stage 2.0 (TID 1001) 2020-02-15 12:13:38 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:13:38 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:13:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3959422976+33554432 2020-02-15 12:13:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:15:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3992977408+33554432 2020-02-15 12:15:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:16:49 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000118_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000118 2020-02-15 12:16:49 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000118_0: Committed 2020-02-15 12:16:49 Executor: INFO: Finished task 118.0 in stage 2.0 (TID 1001). 959 bytes result sent to driver 2020-02-15 12:16:49 TaskSetManager: INFO: Starting task 119.0 in stage 2.0 (TID 1002, localhost, executor driver, partition 119, PROCESS_LOCAL, 8749 bytes) 2020-02-15 12:16:49 TaskSetManager: INFO: Finished task 118.0 in stage 2.0 (TID 1001) in 191586 ms on localhost (executor driver) (119/882) 2020-02-15 12:16:49 Executor: INFO: Running task 119.0 in stage 2.0 (TID 1002) 2020-02-15 12:16:49 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:16:49 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:16:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:3992977408+33554432 2020-02-15 12:16:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:17:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4026531840+33554432 2020-02-15 12:17:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:21:38 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000119_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000119 2020-02-15 12:21:38 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000119_0: Committed 2020-02-15 12:21:38 Executor: INFO: Finished task 119.0 in stage 2.0 (TID 1002). 959 bytes result sent to driver 2020-02-15 12:21:38 TaskSetManager: INFO: Starting task 120.0 in stage 2.0 (TID 1003, localhost, executor driver, partition 120, PROCESS_LOCAL, 9136 bytes) 2020-02-15 12:21:38 TaskSetManager: INFO: Finished task 119.0 in stage 2.0 (TID 1002) in 289163 ms on localhost (executor driver) (120/882) 2020-02-15 12:21:38 Executor: INFO: Running task 120.0 in stage 2.0 (TID 1003) 2020-02-15 12:21:38 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:21:38 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:21:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4026531840+33554432 2020-02-15 12:21:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:25:25 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000120_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000120 2020-02-15 12:25:25 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000120_0: Committed 2020-02-15 12:25:25 Executor: INFO: Finished task 120.0 in stage 2.0 (TID 1003). 1002 bytes result sent to driver 2020-02-15 12:25:25 TaskSetManager: INFO: Starting task 121.0 in stage 2.0 (TID 1004, localhost, executor driver, partition 121, PROCESS_LOCAL, 9321 bytes) 2020-02-15 12:25:25 TaskSetManager: INFO: Finished task 120.0 in stage 2.0 (TID 1003) in 226520 ms on localhost (executor driver) (121/882) 2020-02-15 12:25:25 Executor: INFO: Running task 121.0 in stage 2.0 (TID 1004) 2020-02-15 12:25:25 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:25:25 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:25:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4060086272+33554432 2020-02-15 12:25:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:29:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4093640704+33554432 2020-02-15 12:29:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:33:01 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000121_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000121 2020-02-15 12:33:01 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000121_0: Committed 2020-02-15 12:33:01 Executor: INFO: Finished task 121.0 in stage 2.0 (TID 1004). 959 bytes result sent to driver 2020-02-15 12:33:01 TaskSetManager: INFO: Starting task 122.0 in stage 2.0 (TID 1005, localhost, executor driver, partition 122, PROCESS_LOCAL, 8749 bytes) 2020-02-15 12:33:01 TaskSetManager: INFO: Finished task 121.0 in stage 2.0 (TID 1004) in 456439 ms on localhost (executor driver) (122/882) 2020-02-15 12:33:01 Executor: INFO: Running task 122.0 in stage 2.0 (TID 1005) 2020-02-15 12:33:01 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:33:01 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:33:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4093640704+33554432 2020-02-15 12:33:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:36:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4127195136+33554432 2020-02-15 12:36:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:39:53 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000122_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000122 2020-02-15 12:39:53 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000122_0: Committed 2020-02-15 12:39:53 Executor: INFO: Finished task 122.0 in stage 2.0 (TID 1005). 959 bytes result sent to driver 2020-02-15 12:39:53 TaskSetManager: INFO: Starting task 123.0 in stage 2.0 (TID 1006, localhost, executor driver, partition 123, PROCESS_LOCAL, 9136 bytes) 2020-02-15 12:39:53 TaskSetManager: INFO: Finished task 122.0 in stage 2.0 (TID 1005) in 412065 ms on localhost (executor driver) (123/882) 2020-02-15 12:39:53 Executor: INFO: Running task 123.0 in stage 2.0 (TID 1006) 2020-02-15 12:39:54 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:39:54 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:39:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4127195136+33554432 2020-02-15 12:39:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:43:00 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000123_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000123 2020-02-15 12:43:00 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000123_0: Committed 2020-02-15 12:43:00 Executor: INFO: Finished task 123.0 in stage 2.0 (TID 1006). 959 bytes result sent to driver 2020-02-15 12:43:00 TaskSetManager: INFO: Starting task 124.0 in stage 2.0 (TID 1007, localhost, executor driver, partition 124, PROCESS_LOCAL, 9166 bytes) 2020-02-15 12:43:00 TaskSetManager: INFO: Finished task 123.0 in stage 2.0 (TID 1006) in 186283 ms on localhost (executor driver) (124/882) 2020-02-15 12:43:00 Executor: INFO: Running task 124.0 in stage 2.0 (TID 1007) 2020-02-15 12:43:00 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:43:00 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:43:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4160749568+33554432 2020-02-15 12:43:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:46:24 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000124_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000124 2020-02-15 12:46:24 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000124_0: Committed 2020-02-15 12:46:24 Executor: INFO: Finished task 124.0 in stage 2.0 (TID 1007). 959 bytes result sent to driver 2020-02-15 12:46:24 TaskSetManager: INFO: Starting task 125.0 in stage 2.0 (TID 1008, localhost, executor driver, partition 125, PROCESS_LOCAL, 9166 bytes) 2020-02-15 12:46:24 TaskSetManager: INFO: Finished task 124.0 in stage 2.0 (TID 1007) in 204374 ms on localhost (executor driver) (125/882) 2020-02-15 12:46:24 Executor: INFO: Running task 125.0 in stage 2.0 (TID 1008) 2020-02-15 12:46:24 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:46:24 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:46:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4194304000+33554432 2020-02-15 12:46:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:49:46 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000125_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000125 2020-02-15 12:49:46 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000125_0: Committed 2020-02-15 12:49:46 Executor: INFO: Finished task 125.0 in stage 2.0 (TID 1008). 959 bytes result sent to driver 2020-02-15 12:49:46 TaskSetManager: INFO: Starting task 126.0 in stage 2.0 (TID 1009, localhost, executor driver, partition 126, PROCESS_LOCAL, 9166 bytes) 2020-02-15 12:49:46 TaskSetManager: INFO: Finished task 125.0 in stage 2.0 (TID 1008) in 201742 ms on localhost (executor driver) (126/882) 2020-02-15 12:49:46 Executor: INFO: Running task 126.0 in stage 2.0 (TID 1009) 2020-02-15 12:49:46 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:49:46 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:49:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4227858432+33554432 2020-02-15 12:49:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:53:28 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000126_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000126 2020-02-15 12:53:28 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000126_0: Committed 2020-02-15 12:53:28 Executor: INFO: Finished task 126.0 in stage 2.0 (TID 1009). 959 bytes result sent to driver 2020-02-15 12:53:28 TaskSetManager: INFO: Starting task 127.0 in stage 2.0 (TID 1010, localhost, executor driver, partition 127, PROCESS_LOCAL, 9166 bytes) 2020-02-15 12:53:28 TaskSetManager: INFO: Finished task 126.0 in stage 2.0 (TID 1009) in 221627 ms on localhost (executor driver) (127/882) 2020-02-15 12:53:28 Executor: INFO: Running task 127.0 in stage 2.0 (TID 1010) 2020-02-15 12:53:28 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:53:28 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:53:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4261412864+33554432 2020-02-15 12:53:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:56:36 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000127_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000127 2020-02-15 12:56:36 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000127_0: Committed 2020-02-15 12:56:36 Executor: INFO: Finished task 127.0 in stage 2.0 (TID 1010). 1002 bytes result sent to driver 2020-02-15 12:56:36 TaskSetManager: INFO: Starting task 128.0 in stage 2.0 (TID 1011, localhost, executor driver, partition 128, PROCESS_LOCAL, 9188 bytes) 2020-02-15 12:56:36 TaskSetManager: INFO: Finished task 127.0 in stage 2.0 (TID 1010) in 188542 ms on localhost (executor driver) (128/882) 2020-02-15 12:56:36 Executor: INFO: Running task 128.0 in stage 2.0 (TID 1011) 2020-02-15 12:56:36 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:56:36 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:56:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4294967296+33554432 2020-02-15 12:56:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 12:59:52 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000128_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000128 2020-02-15 12:59:52 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000128_0: Committed 2020-02-15 12:59:52 Executor: INFO: Finished task 128.0 in stage 2.0 (TID 1011). 959 bytes result sent to driver 2020-02-15 12:59:52 TaskSetManager: INFO: Starting task 129.0 in stage 2.0 (TID 1012, localhost, executor driver, partition 129, PROCESS_LOCAL, 9166 bytes) 2020-02-15 12:59:52 TaskSetManager: INFO: Finished task 128.0 in stage 2.0 (TID 1011) in 195709 ms on localhost (executor driver) (129/882) 2020-02-15 12:59:52 Executor: INFO: Running task 129.0 in stage 2.0 (TID 1012) 2020-02-15 12:59:52 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 12:59:52 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 12:59:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4328521728+33554432 2020-02-15 12:59:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:03:37 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000129_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000129 2020-02-15 13:03:37 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000129_0: Committed 2020-02-15 13:03:37 Executor: INFO: Finished task 129.0 in stage 2.0 (TID 1012). 959 bytes result sent to driver 2020-02-15 13:03:37 TaskSetManager: INFO: Starting task 130.0 in stage 2.0 (TID 1013, localhost, executor driver, partition 130, PROCESS_LOCAL, 9166 bytes) 2020-02-15 13:03:37 TaskSetManager: INFO: Finished task 129.0 in stage 2.0 (TID 1012) in 225627 ms on localhost (executor driver) (130/882) 2020-02-15 13:03:37 Executor: INFO: Running task 130.0 in stage 2.0 (TID 1013) 2020-02-15 13:03:37 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 13:03:37 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 13:03:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4362076160+33554432 2020-02-15 13:03:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:07:08 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000130_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000130 2020-02-15 13:07:08 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000130_0: Committed 2020-02-15 13:07:08 Executor: INFO: Finished task 130.0 in stage 2.0 (TID 1013). 959 bytes result sent to driver 2020-02-15 13:07:08 TaskSetManager: INFO: Starting task 131.0 in stage 2.0 (TID 1014, localhost, executor driver, partition 131, PROCESS_LOCAL, 9166 bytes) 2020-02-15 13:07:08 TaskSetManager: INFO: Finished task 130.0 in stage 2.0 (TID 1013) in 210473 ms on localhost (executor driver) (131/882) 2020-02-15 13:07:08 Executor: INFO: Running task 131.0 in stage 2.0 (TID 1014) 2020-02-15 13:07:08 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 13:07:08 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 13:07:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4395630592+33554432 2020-02-15 13:07:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:10:38 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000131_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000131 2020-02-15 13:10:38 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000131_0: Committed 2020-02-15 13:10:38 Executor: INFO: Finished task 131.0 in stage 2.0 (TID 1014). 959 bytes result sent to driver 2020-02-15 13:10:38 TaskSetManager: INFO: Starting task 132.0 in stage 2.0 (TID 1015, localhost, executor driver, partition 132, PROCESS_LOCAL, 9168 bytes) 2020-02-15 13:10:38 TaskSetManager: INFO: Finished task 131.0 in stage 2.0 (TID 1014) in 210460 ms on localhost (executor driver) (132/882) 2020-02-15 13:10:38 Executor: INFO: Running task 132.0 in stage 2.0 (TID 1015) 2020-02-15 13:10:38 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 13:10:38 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 13:10:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4429185024+33554432 2020-02-15 13:10:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:14:11 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000132_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000132 2020-02-15 13:14:11 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000132_0: Committed 2020-02-15 13:14:11 Executor: INFO: Finished task 132.0 in stage 2.0 (TID 1015). 959 bytes result sent to driver 2020-02-15 13:14:11 TaskSetManager: INFO: Starting task 133.0 in stage 2.0 (TID 1016, localhost, executor driver, partition 133, PROCESS_LOCAL, 9321 bytes) 2020-02-15 13:14:11 TaskSetManager: INFO: Finished task 132.0 in stage 2.0 (TID 1015) in 212585 ms on localhost (executor driver) (133/882) 2020-02-15 13:14:11 Executor: INFO: Running task 133.0 in stage 2.0 (TID 1016) 2020-02-15 13:14:11 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 13:14:11 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 13:14:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4462739456+33554432 2020-02-15 13:14:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:17:15 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4496293888+33554432 2020-02-15 13:17:15 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:19:56 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000133_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000133 2020-02-15 13:19:56 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000133_0: Committed 2020-02-15 13:19:56 Executor: INFO: Finished task 133.0 in stage 2.0 (TID 1016). 959 bytes result sent to driver 2020-02-15 13:19:56 TaskSetManager: INFO: Starting task 134.0 in stage 2.0 (TID 1017, localhost, executor driver, partition 134, PROCESS_LOCAL, 8749 bytes) 2020-02-15 13:19:56 TaskSetManager: INFO: Finished task 133.0 in stage 2.0 (TID 1016) in 345102 ms on localhost (executor driver) (134/882) 2020-02-15 13:19:56 Executor: INFO: Running task 134.0 in stage 2.0 (TID 1017) 2020-02-15 13:19:56 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 13:19:56 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 13:19:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4496293888+33554432 2020-02-15 13:19:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:22:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4529848320+33554432 2020-02-15 13:22:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:25:37 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000134_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000134 2020-02-15 13:25:37 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000134_0: Committed 2020-02-15 13:25:37 Executor: INFO: Finished task 134.0 in stage 2.0 (TID 1017). 959 bytes result sent to driver 2020-02-15 13:25:37 TaskSetManager: INFO: Starting task 135.0 in stage 2.0 (TID 1018, localhost, executor driver, partition 135, PROCESS_LOCAL, 9136 bytes) 2020-02-15 13:25:37 TaskSetManager: INFO: Finished task 134.0 in stage 2.0 (TID 1017) in 340752 ms on localhost (executor driver) (135/882) 2020-02-15 13:25:37 Executor: INFO: Running task 135.0 in stage 2.0 (TID 1018) 2020-02-15 13:25:37 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 13:25:37 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 13:25:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4529848320+33554432 2020-02-15 13:25:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:28:38 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000135_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000135 2020-02-15 13:28:38 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000135_0: Committed 2020-02-15 13:28:38 Executor: INFO: Finished task 135.0 in stage 2.0 (TID 1018). 959 bytes result sent to driver 2020-02-15 13:28:38 TaskSetManager: INFO: Starting task 136.0 in stage 2.0 (TID 1019, localhost, executor driver, partition 136, PROCESS_LOCAL, 9321 bytes) 2020-02-15 13:28:38 TaskSetManager: INFO: Finished task 135.0 in stage 2.0 (TID 1018) in 181103 ms on localhost (executor driver) (136/882) 2020-02-15 13:28:38 Executor: INFO: Running task 136.0 in stage 2.0 (TID 1019) 2020-02-15 13:28:38 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 13:28:38 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 13:28:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4563402752+33554432 2020-02-15 13:28:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:32:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4596957184+33554432 2020-02-15 13:32:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:35:33 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000136_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000136 2020-02-15 13:35:33 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000136_0: Committed 2020-02-15 13:35:33 Executor: INFO: Finished task 136.0 in stage 2.0 (TID 1019). 959 bytes result sent to driver 2020-02-15 13:35:33 TaskSetManager: INFO: Starting task 137.0 in stage 2.0 (TID 1020, localhost, executor driver, partition 137, PROCESS_LOCAL, 9136 bytes) 2020-02-15 13:35:33 TaskSetManager: INFO: Finished task 136.0 in stage 2.0 (TID 1019) in 415223 ms on localhost (executor driver) (137/882) 2020-02-15 13:35:33 Executor: INFO: Running task 137.0 in stage 2.0 (TID 1020) 2020-02-15 13:35:33 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 13:35:33 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 13:35:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4596957184+33554432 2020-02-15 13:35:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:39:04 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000137_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000137 2020-02-15 13:39:04 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000137_0: Committed 2020-02-15 13:39:04 Executor: INFO: Finished task 137.0 in stage 2.0 (TID 1020). 959 bytes result sent to driver 2020-02-15 13:39:04 TaskSetManager: INFO: Starting task 138.0 in stage 2.0 (TID 1021, localhost, executor driver, partition 138, PROCESS_LOCAL, 9166 bytes) 2020-02-15 13:39:04 TaskSetManager: INFO: Finished task 137.0 in stage 2.0 (TID 1020) in 211046 ms on localhost (executor driver) (138/882) 2020-02-15 13:39:04 Executor: INFO: Running task 138.0 in stage 2.0 (TID 1021) 2020-02-15 13:39:04 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 13:39:04 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 13:39:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4630511616+33554432 2020-02-15 13:39:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:44:05 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000138_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000138 2020-02-15 13:44:05 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000138_0: Committed 2020-02-15 13:44:05 Executor: INFO: Finished task 138.0 in stage 2.0 (TID 1021). 959 bytes result sent to driver 2020-02-15 13:44:05 TaskSetManager: INFO: Starting task 139.0 in stage 2.0 (TID 1022, localhost, executor driver, partition 139, PROCESS_LOCAL, 9166 bytes) 2020-02-15 13:44:05 TaskSetManager: INFO: Finished task 138.0 in stage 2.0 (TID 1021) in 301192 ms on localhost (executor driver) (139/882) 2020-02-15 13:44:05 Executor: INFO: Running task 139.0 in stage 2.0 (TID 1022) 2020-02-15 13:44:05 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 13:44:05 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 13:44:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4664066048+33554432 2020-02-15 13:44:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:49:22 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000139_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000139 2020-02-15 13:49:22 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000139_0: Committed 2020-02-15 13:49:22 Executor: INFO: Finished task 139.0 in stage 2.0 (TID 1022). 959 bytes result sent to driver 2020-02-15 13:49:22 TaskSetManager: INFO: Starting task 140.0 in stage 2.0 (TID 1023, localhost, executor driver, partition 140, PROCESS_LOCAL, 9166 bytes) 2020-02-15 13:49:22 TaskSetManager: INFO: Finished task 139.0 in stage 2.0 (TID 1022) in 316283 ms on localhost (executor driver) (140/882) 2020-02-15 13:49:22 Executor: INFO: Running task 140.0 in stage 2.0 (TID 1023) 2020-02-15 13:49:22 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 13:49:22 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 13:49:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4697620480+33554432 2020-02-15 13:49:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 13:55:06 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000140_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000140 2020-02-15 13:55:06 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000140_0: Committed 2020-02-15 13:55:06 Executor: INFO: Finished task 140.0 in stage 2.0 (TID 1023). 959 bytes result sent to driver 2020-02-15 13:55:06 TaskSetManager: INFO: Starting task 141.0 in stage 2.0 (TID 1024, localhost, executor driver, partition 141, PROCESS_LOCAL, 9166 bytes) 2020-02-15 13:55:06 TaskSetManager: INFO: Finished task 140.0 in stage 2.0 (TID 1023) in 344268 ms on localhost (executor driver) (141/882) 2020-02-15 13:55:06 Executor: INFO: Running task 141.0 in stage 2.0 (TID 1024) 2020-02-15 13:55:06 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 13:55:06 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 13:55:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4731174912+33554432 2020-02-15 13:55:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:00:13 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000141_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000141 2020-02-15 14:00:13 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000141_0: Committed 2020-02-15 14:00:13 Executor: INFO: Finished task 141.0 in stage 2.0 (TID 1024). 959 bytes result sent to driver 2020-02-15 14:00:13 TaskSetManager: INFO: Starting task 142.0 in stage 2.0 (TID 1025, localhost, executor driver, partition 142, PROCESS_LOCAL, 9166 bytes) 2020-02-15 14:00:13 TaskSetManager: INFO: Finished task 141.0 in stage 2.0 (TID 1024) in 306845 ms on localhost (executor driver) (142/882) 2020-02-15 14:00:13 Executor: INFO: Running task 142.0 in stage 2.0 (TID 1025) 2020-02-15 14:00:13 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:00:13 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:00:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4764729344+33554432 2020-02-15 14:00:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:05:09 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000142_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000142 2020-02-15 14:05:09 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000142_0: Committed 2020-02-15 14:05:09 Executor: INFO: Finished task 142.0 in stage 2.0 (TID 1025). 959 bytes result sent to driver 2020-02-15 14:05:09 TaskSetManager: INFO: Starting task 143.0 in stage 2.0 (TID 1026, localhost, executor driver, partition 143, PROCESS_LOCAL, 9166 bytes) 2020-02-15 14:05:09 TaskSetManager: INFO: Finished task 142.0 in stage 2.0 (TID 1025) in 296011 ms on localhost (executor driver) (143/882) 2020-02-15 14:05:09 Executor: INFO: Running task 143.0 in stage 2.0 (TID 1026) 2020-02-15 14:05:09 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:05:09 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:05:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4798283776+33554432 2020-02-15 14:05:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:08:59 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000143_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000143 2020-02-15 14:08:59 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000143_0: Committed 2020-02-15 14:08:59 Executor: INFO: Finished task 143.0 in stage 2.0 (TID 1026). 959 bytes result sent to driver 2020-02-15 14:08:59 TaskSetManager: INFO: Starting task 144.0 in stage 2.0 (TID 1027, localhost, executor driver, partition 144, PROCESS_LOCAL, 9321 bytes) 2020-02-15 14:08:59 TaskSetManager: INFO: Finished task 143.0 in stage 2.0 (TID 1026) in 230379 ms on localhost (executor driver) (144/882) 2020-02-15 14:08:59 Executor: INFO: Running task 144.0 in stage 2.0 (TID 1027) 2020-02-15 14:08:59 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:08:59 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:08:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4831838208+33554432 2020-02-15 14:08:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:11:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4865392640+33554432 2020-02-15 14:11:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:15:01 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000144_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000144 2020-02-15 14:15:01 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000144_0: Committed 2020-02-15 14:15:01 Executor: INFO: Finished task 144.0 in stage 2.0 (TID 1027). 959 bytes result sent to driver 2020-02-15 14:15:01 TaskSetManager: INFO: Starting task 145.0 in stage 2.0 (TID 1028, localhost, executor driver, partition 145, PROCESS_LOCAL, 8749 bytes) 2020-02-15 14:15:01 TaskSetManager: INFO: Finished task 144.0 in stage 2.0 (TID 1027) in 361953 ms on localhost (executor driver) (145/882) 2020-02-15 14:15:01 Executor: INFO: Running task 145.0 in stage 2.0 (TID 1028) 2020-02-15 14:15:01 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:15:01 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:15:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4865392640+33554432 2020-02-15 14:15:01 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:18:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4898947072+33554432 2020-02-15 14:18:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:21:49 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000145_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000145 2020-02-15 14:21:49 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000145_0: Committed 2020-02-15 14:21:49 Executor: INFO: Finished task 145.0 in stage 2.0 (TID 1028). 959 bytes result sent to driver 2020-02-15 14:21:49 TaskSetManager: INFO: Starting task 146.0 in stage 2.0 (TID 1029, localhost, executor driver, partition 146, PROCESS_LOCAL, 9136 bytes) 2020-02-15 14:21:49 TaskSetManager: INFO: Finished task 145.0 in stage 2.0 (TID 1028) in 407772 ms on localhost (executor driver) (146/882) 2020-02-15 14:21:49 Executor: INFO: Running task 146.0 in stage 2.0 (TID 1029) 2020-02-15 14:21:49 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:21:49 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:21:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4898947072+33554432 2020-02-15 14:21:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:25:09 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000146_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000146 2020-02-15 14:25:09 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000146_0: Committed 2020-02-15 14:25:09 Executor: INFO: Finished task 146.0 in stage 2.0 (TID 1029). 959 bytes result sent to driver 2020-02-15 14:25:09 TaskSetManager: INFO: Starting task 147.0 in stage 2.0 (TID 1030, localhost, executor driver, partition 147, PROCESS_LOCAL, 9166 bytes) 2020-02-15 14:25:09 TaskSetManager: INFO: Finished task 146.0 in stage 2.0 (TID 1029) in 199694 ms on localhost (executor driver) (147/882) 2020-02-15 14:25:09 Executor: INFO: Running task 147.0 in stage 2.0 (TID 1030) 2020-02-15 14:25:09 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:25:09 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:25:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4932501504+33554432 2020-02-15 14:25:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:29:38 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000147_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000147 2020-02-15 14:29:38 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000147_0: Committed 2020-02-15 14:29:38 Executor: INFO: Finished task 147.0 in stage 2.0 (TID 1030). 959 bytes result sent to driver 2020-02-15 14:29:38 TaskSetManager: INFO: Starting task 148.0 in stage 2.0 (TID 1031, localhost, executor driver, partition 148, PROCESS_LOCAL, 9166 bytes) 2020-02-15 14:29:38 TaskSetManager: INFO: Finished task 147.0 in stage 2.0 (TID 1030) in 269105 ms on localhost (executor driver) (148/882) 2020-02-15 14:29:38 Executor: INFO: Running task 148.0 in stage 2.0 (TID 1031) 2020-02-15 14:29:38 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:29:38 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:29:38 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4966055936+33554432 2020-02-15 14:29:38 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:33:02 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000148_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000148 2020-02-15 14:33:02 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000148_0: Committed 2020-02-15 14:33:02 Executor: INFO: Finished task 148.0 in stage 2.0 (TID 1031). 959 bytes result sent to driver 2020-02-15 14:33:02 TaskSetManager: INFO: Starting task 149.0 in stage 2.0 (TID 1032, localhost, executor driver, partition 149, PROCESS_LOCAL, 9166 bytes) 2020-02-15 14:33:02 TaskSetManager: INFO: Finished task 148.0 in stage 2.0 (TID 1031) in 204692 ms on localhost (executor driver) (149/882) 2020-02-15 14:33:02 Executor: INFO: Running task 149.0 in stage 2.0 (TID 1032) 2020-02-15 14:33:02 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:33:02 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:33:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:4999610368+33554432 2020-02-15 14:33:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:36:21 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000149_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000149 2020-02-15 14:36:21 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000149_0: Committed 2020-02-15 14:36:21 Executor: INFO: Finished task 149.0 in stage 2.0 (TID 1032). 959 bytes result sent to driver 2020-02-15 14:36:21 TaskSetManager: INFO: Starting task 150.0 in stage 2.0 (TID 1033, localhost, executor driver, partition 150, PROCESS_LOCAL, 9321 bytes) 2020-02-15 14:36:21 TaskSetManager: INFO: Finished task 149.0 in stage 2.0 (TID 1032) in 198531 ms on localhost (executor driver) (150/882) 2020-02-15 14:36:21 Executor: INFO: Running task 150.0 in stage 2.0 (TID 1033) 2020-02-15 14:36:21 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:36:21 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:36:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5033164800+33554432 2020-02-15 14:36:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:40:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5066719232+33554432 2020-02-15 14:40:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:43:33 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000150_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000150 2020-02-15 14:43:33 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000150_0: Committed 2020-02-15 14:43:33 Executor: INFO: Finished task 150.0 in stage 2.0 (TID 1033). 959 bytes result sent to driver 2020-02-15 14:43:33 TaskSetManager: INFO: Starting task 151.0 in stage 2.0 (TID 1034, localhost, executor driver, partition 151, PROCESS_LOCAL, 9136 bytes) 2020-02-15 14:43:33 TaskSetManager: INFO: Finished task 150.0 in stage 2.0 (TID 1033) in 432099 ms on localhost (executor driver) (151/882) 2020-02-15 14:43:33 Executor: INFO: Running task 151.0 in stage 2.0 (TID 1034) 2020-02-15 14:43:33 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:43:33 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:43:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5066719232+33554432 2020-02-15 14:43:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:46:50 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000151_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000151 2020-02-15 14:46:50 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000151_0: Committed 2020-02-15 14:46:50 Executor: INFO: Finished task 151.0 in stage 2.0 (TID 1034). 959 bytes result sent to driver 2020-02-15 14:46:50 TaskSetManager: INFO: Starting task 152.0 in stage 2.0 (TID 1035, localhost, executor driver, partition 152, PROCESS_LOCAL, 9321 bytes) 2020-02-15 14:46:50 TaskSetManager: INFO: Finished task 151.0 in stage 2.0 (TID 1034) in 196746 ms on localhost (executor driver) (152/882) 2020-02-15 14:46:50 Executor: INFO: Running task 152.0 in stage 2.0 (TID 1035) 2020-02-15 14:46:50 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:46:50 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:46:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5100273664+33554432 2020-02-15 14:46:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:50:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5133828096+33554432 2020-02-15 14:50:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:54:41 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000152_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000152 2020-02-15 14:54:41 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000152_0: Committed 2020-02-15 14:54:41 Executor: INFO: Finished task 152.0 in stage 2.0 (TID 1035). 959 bytes result sent to driver 2020-02-15 14:54:41 TaskSetManager: INFO: Starting task 153.0 in stage 2.0 (TID 1036, localhost, executor driver, partition 153, PROCESS_LOCAL, 9136 bytes) 2020-02-15 14:54:41 TaskSetManager: INFO: Finished task 152.0 in stage 2.0 (TID 1035) in 471313 ms on localhost (executor driver) (153/882) 2020-02-15 14:54:41 Executor: INFO: Running task 153.0 in stage 2.0 (TID 1036) 2020-02-15 14:54:41 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:54:41 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:54:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5133828096+33554432 2020-02-15 14:54:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 14:58:49 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000153_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000153 2020-02-15 14:58:49 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000153_0: Committed 2020-02-15 14:58:49 Executor: INFO: Finished task 153.0 in stage 2.0 (TID 1036). 959 bytes result sent to driver 2020-02-15 14:58:49 TaskSetManager: INFO: Starting task 154.0 in stage 2.0 (TID 1037, localhost, executor driver, partition 154, PROCESS_LOCAL, 9166 bytes) 2020-02-15 14:58:49 TaskSetManager: INFO: Finished task 153.0 in stage 2.0 (TID 1036) in 248274 ms on localhost (executor driver) (154/882) 2020-02-15 14:58:49 Executor: INFO: Running task 154.0 in stage 2.0 (TID 1037) 2020-02-15 14:58:49 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 14:58:49 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 14:58:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5167382528+33554432 2020-02-15 14:58:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:03:13 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000154_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000154 2020-02-15 15:03:13 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000154_0: Committed 2020-02-15 15:03:13 Executor: INFO: Finished task 154.0 in stage 2.0 (TID 1037). 959 bytes result sent to driver 2020-02-15 15:03:13 TaskSetManager: INFO: Starting task 155.0 in stage 2.0 (TID 1038, localhost, executor driver, partition 155, PROCESS_LOCAL, 9166 bytes) 2020-02-15 15:03:13 TaskSetManager: INFO: Finished task 154.0 in stage 2.0 (TID 1037) in 263897 ms on localhost (executor driver) (155/882) 2020-02-15 15:03:13 Executor: INFO: Running task 155.0 in stage 2.0 (TID 1038) 2020-02-15 15:03:13 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 15:03:13 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 15:03:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5200936960+33554432 2020-02-15 15:03:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:08:41 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000155_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000155 2020-02-15 15:08:41 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000155_0: Committed 2020-02-15 15:08:41 Executor: INFO: Finished task 155.0 in stage 2.0 (TID 1038). 959 bytes result sent to driver 2020-02-15 15:08:41 TaskSetManager: INFO: Starting task 156.0 in stage 2.0 (TID 1039, localhost, executor driver, partition 156, PROCESS_LOCAL, 9166 bytes) 2020-02-15 15:08:41 TaskSetManager: INFO: Finished task 155.0 in stage 2.0 (TID 1038) in 327541 ms on localhost (executor driver) (156/882) 2020-02-15 15:08:41 Executor: INFO: Running task 156.0 in stage 2.0 (TID 1039) 2020-02-15 15:08:41 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 15:08:41 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 15:08:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5234491392+33554432 2020-02-15 15:08:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:13:10 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000156_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000156 2020-02-15 15:13:10 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000156_0: Committed 2020-02-15 15:13:10 Executor: INFO: Finished task 156.0 in stage 2.0 (TID 1039). 959 bytes result sent to driver 2020-02-15 15:13:10 TaskSetManager: INFO: Starting task 157.0 in stage 2.0 (TID 1040, localhost, executor driver, partition 157, PROCESS_LOCAL, 9166 bytes) 2020-02-15 15:13:10 TaskSetManager: INFO: Finished task 156.0 in stage 2.0 (TID 1039) in 268800 ms on localhost (executor driver) (157/882) 2020-02-15 15:13:10 Executor: INFO: Running task 157.0 in stage 2.0 (TID 1040) 2020-02-15 15:13:10 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 15:13:10 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 15:13:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5268045824+33554432 2020-02-15 15:13:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:18:36 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000157_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000157 2020-02-15 15:18:36 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000157_0: Committed 2020-02-15 15:18:36 Executor: INFO: Finished task 157.0 in stage 2.0 (TID 1040). 959 bytes result sent to driver 2020-02-15 15:18:36 TaskSetManager: INFO: Starting task 158.0 in stage 2.0 (TID 1041, localhost, executor driver, partition 158, PROCESS_LOCAL, 9321 bytes) 2020-02-15 15:18:36 TaskSetManager: INFO: Finished task 157.0 in stage 2.0 (TID 1040) in 326228 ms on localhost (executor driver) (158/882) 2020-02-15 15:18:36 Executor: INFO: Running task 158.0 in stage 2.0 (TID 1041) 2020-02-15 15:18:36 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 15:18:36 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 15:18:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5301600256+33554432 2020-02-15 15:18:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:23:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5335154688+33554432 2020-02-15 15:23:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:26:55 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000158_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000158 2020-02-15 15:26:55 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000158_0: Committed 2020-02-15 15:26:55 Executor: INFO: Finished task 158.0 in stage 2.0 (TID 1041). 959 bytes result sent to driver 2020-02-15 15:26:55 TaskSetManager: INFO: Starting task 159.0 in stage 2.0 (TID 1042, localhost, executor driver, partition 159, PROCESS_LOCAL, 9136 bytes) 2020-02-15 15:26:55 TaskSetManager: INFO: Finished task 158.0 in stage 2.0 (TID 1041) in 498884 ms on localhost (executor driver) (159/882) 2020-02-15 15:26:55 Executor: INFO: Running task 159.0 in stage 2.0 (TID 1042) 2020-02-15 15:26:55 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 15:26:55 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 15:26:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5335154688+33554432 2020-02-15 15:26:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:30:46 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000159_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000159 2020-02-15 15:30:46 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000159_0: Committed 2020-02-15 15:30:46 Executor: INFO: Finished task 159.0 in stage 2.0 (TID 1042). 959 bytes result sent to driver 2020-02-15 15:30:46 TaskSetManager: INFO: Starting task 160.0 in stage 2.0 (TID 1043, localhost, executor driver, partition 160, PROCESS_LOCAL, 9166 bytes) 2020-02-15 15:30:46 TaskSetManager: INFO: Finished task 159.0 in stage 2.0 (TID 1042) in 231407 ms on localhost (executor driver) (160/882) 2020-02-15 15:30:46 Executor: INFO: Running task 160.0 in stage 2.0 (TID 1043) 2020-02-15 15:30:46 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 15:30:46 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 15:30:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5368709120+33554432 2020-02-15 15:30:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:34:02 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000160_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000160 2020-02-15 15:34:02 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000160_0: Committed 2020-02-15 15:34:02 Executor: INFO: Finished task 160.0 in stage 2.0 (TID 1043). 959 bytes result sent to driver 2020-02-15 15:34:02 TaskSetManager: INFO: Starting task 161.0 in stage 2.0 (TID 1044, localhost, executor driver, partition 161, PROCESS_LOCAL, 9321 bytes) 2020-02-15 15:34:02 TaskSetManager: INFO: Finished task 160.0 in stage 2.0 (TID 1043) in 195807 ms on localhost (executor driver) (161/882) 2020-02-15 15:34:02 Executor: INFO: Running task 161.0 in stage 2.0 (TID 1044) 2020-02-15 15:34:02 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 15:34:02 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 15:34:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5402263552+33554432 2020-02-15 15:34:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:37:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5435817984+33554432 2020-02-15 15:37:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:41:09 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000161_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000161 2020-02-15 15:41:09 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000161_0: Committed 2020-02-15 15:41:09 Executor: INFO: Finished task 161.0 in stage 2.0 (TID 1044). 959 bytes result sent to driver 2020-02-15 15:41:09 TaskSetManager: INFO: Starting task 162.0 in stage 2.0 (TID 1045, localhost, executor driver, partition 162, PROCESS_LOCAL, 8749 bytes) 2020-02-15 15:41:09 TaskSetManager: INFO: Finished task 161.0 in stage 2.0 (TID 1044) in 427043 ms on localhost (executor driver) (162/882) 2020-02-15 15:41:09 Executor: INFO: Running task 162.0 in stage 2.0 (TID 1045) 2020-02-15 15:41:09 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 15:41:09 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 15:41:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5435817984+33554432 2020-02-15 15:41:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:45:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5469372416+33554432 2020-02-15 15:45:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:48:24 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000162_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000162 2020-02-15 15:48:24 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000162_0: Committed 2020-02-15 15:48:24 Executor: INFO: Finished task 162.0 in stage 2.0 (TID 1045). 959 bytes result sent to driver 2020-02-15 15:48:24 TaskSetManager: INFO: Starting task 163.0 in stage 2.0 (TID 1046, localhost, executor driver, partition 163, PROCESS_LOCAL, 9136 bytes) 2020-02-15 15:48:24 TaskSetManager: INFO: Finished task 162.0 in stage 2.0 (TID 1045) in 434831 ms on localhost (executor driver) (163/882) 2020-02-15 15:48:24 Executor: INFO: Running task 163.0 in stage 2.0 (TID 1046) 2020-02-15 15:48:24 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 15:48:24 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 15:48:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5469372416+33554432 2020-02-15 15:48:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:51:50 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000163_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000163 2020-02-15 15:51:50 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000163_0: Committed 2020-02-15 15:51:50 Executor: INFO: Finished task 163.0 in stage 2.0 (TID 1046). 959 bytes result sent to driver 2020-02-15 15:51:50 TaskSetManager: INFO: Starting task 164.0 in stage 2.0 (TID 1047, localhost, executor driver, partition 164, PROCESS_LOCAL, 9166 bytes) 2020-02-15 15:51:50 TaskSetManager: INFO: Finished task 163.0 in stage 2.0 (TID 1046) in 205853 ms on localhost (executor driver) (164/882) 2020-02-15 15:51:50 Executor: INFO: Running task 164.0 in stage 2.0 (TID 1047) 2020-02-15 15:51:50 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 15:51:50 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 15:51:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5502926848+33554432 2020-02-15 15:51:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:55:40 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000164_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000164 2020-02-15 15:55:40 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000164_0: Committed 2020-02-15 15:55:40 Executor: INFO: Finished task 164.0 in stage 2.0 (TID 1047). 959 bytes result sent to driver 2020-02-15 15:55:40 TaskSetManager: INFO: Starting task 165.0 in stage 2.0 (TID 1048, localhost, executor driver, partition 165, PROCESS_LOCAL, 9166 bytes) 2020-02-15 15:55:40 TaskSetManager: INFO: Finished task 164.0 in stage 2.0 (TID 1047) in 230560 ms on localhost (executor driver) (165/882) 2020-02-15 15:55:40 Executor: INFO: Running task 165.0 in stage 2.0 (TID 1048) 2020-02-15 15:55:40 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 15:55:40 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 15:55:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5536481280+33554432 2020-02-15 15:55:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 15:58:39 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000165_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000165 2020-02-15 15:58:39 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000165_0: Committed 2020-02-15 15:58:39 Executor: INFO: Finished task 165.0 in stage 2.0 (TID 1048). 959 bytes result sent to driver 2020-02-15 15:58:39 TaskSetManager: INFO: Starting task 166.0 in stage 2.0 (TID 1049, localhost, executor driver, partition 166, PROCESS_LOCAL, 9166 bytes) 2020-02-15 15:58:39 TaskSetManager: INFO: Finished task 165.0 in stage 2.0 (TID 1048) in 178390 ms on localhost (executor driver) (166/882) 2020-02-15 15:58:39 Executor: INFO: Running task 166.0 in stage 2.0 (TID 1049) 2020-02-15 15:58:39 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 15:58:39 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 15:58:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5570035712+33554432 2020-02-15 15:58:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:02:39 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000166_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000166 2020-02-15 16:02:39 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000166_0: Committed 2020-02-15 16:02:39 Executor: INFO: Finished task 166.0 in stage 2.0 (TID 1049). 959 bytes result sent to driver 2020-02-15 16:02:39 TaskSetManager: INFO: Starting task 167.0 in stage 2.0 (TID 1050, localhost, executor driver, partition 167, PROCESS_LOCAL, 9166 bytes) 2020-02-15 16:02:39 TaskSetManager: INFO: Finished task 166.0 in stage 2.0 (TID 1049) in 240527 ms on localhost (executor driver) (167/882) 2020-02-15 16:02:39 Executor: INFO: Running task 167.0 in stage 2.0 (TID 1050) 2020-02-15 16:02:39 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 16:02:39 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 16:02:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5603590144+33554432 2020-02-15 16:02:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:07:11 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000167_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000167 2020-02-15 16:07:11 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000167_0: Committed 2020-02-15 16:07:11 Executor: INFO: Finished task 167.0 in stage 2.0 (TID 1050). 959 bytes result sent to driver 2020-02-15 16:07:11 TaskSetManager: INFO: Starting task 168.0 in stage 2.0 (TID 1051, localhost, executor driver, partition 168, PROCESS_LOCAL, 9166 bytes) 2020-02-15 16:07:11 TaskSetManager: INFO: Finished task 167.0 in stage 2.0 (TID 1050) in 272168 ms on localhost (executor driver) (168/882) 2020-02-15 16:07:11 Executor: INFO: Running task 168.0 in stage 2.0 (TID 1051) 2020-02-15 16:07:11 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 16:07:11 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 16:07:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5637144576+33554432 2020-02-15 16:07:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:09:59 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000168_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000168 2020-02-15 16:09:59 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000168_0: Committed 2020-02-15 16:09:59 Executor: INFO: Finished task 168.0 in stage 2.0 (TID 1051). 959 bytes result sent to driver 2020-02-15 16:09:59 TaskSetManager: INFO: Starting task 169.0 in stage 2.0 (TID 1052, localhost, executor driver, partition 169, PROCESS_LOCAL, 9166 bytes) 2020-02-15 16:09:59 TaskSetManager: INFO: Finished task 168.0 in stage 2.0 (TID 1051) in 167910 ms on localhost (executor driver) (169/882) 2020-02-15 16:09:59 Executor: INFO: Running task 169.0 in stage 2.0 (TID 1052) 2020-02-15 16:09:59 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 16:09:59 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 16:09:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5670699008+33554432 2020-02-15 16:09:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:14:35 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000169_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000169 2020-02-15 16:14:35 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000169_0: Committed 2020-02-15 16:14:35 Executor: INFO: Finished task 169.0 in stage 2.0 (TID 1052). 959 bytes result sent to driver 2020-02-15 16:14:35 TaskSetManager: INFO: Starting task 170.0 in stage 2.0 (TID 1053, localhost, executor driver, partition 170, PROCESS_LOCAL, 9321 bytes) 2020-02-15 16:14:35 TaskSetManager: INFO: Finished task 169.0 in stage 2.0 (TID 1052) in 275744 ms on localhost (executor driver) (170/882) 2020-02-15 16:14:35 Executor: INFO: Running task 170.0 in stage 2.0 (TID 1053) 2020-02-15 16:14:35 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 16:14:35 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 16:14:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5704253440+33554432 2020-02-15 16:14:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:18:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5737807872+33554432 2020-02-15 16:18:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:22:26 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000170_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000170 2020-02-15 16:22:26 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000170_0: Committed 2020-02-15 16:22:26 Executor: INFO: Finished task 170.0 in stage 2.0 (TID 1053). 959 bytes result sent to driver 2020-02-15 16:22:26 TaskSetManager: INFO: Starting task 171.0 in stage 2.0 (TID 1054, localhost, executor driver, partition 171, PROCESS_LOCAL, 9136 bytes) 2020-02-15 16:22:26 TaskSetManager: INFO: Finished task 170.0 in stage 2.0 (TID 1053) in 471375 ms on localhost (executor driver) (171/882) 2020-02-15 16:22:26 Executor: INFO: Running task 171.0 in stage 2.0 (TID 1054) 2020-02-15 16:22:26 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 16:22:26 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 16:22:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5737807872+33554432 2020-02-15 16:22:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:26:07 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000171_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000171 2020-02-15 16:26:07 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000171_0: Committed 2020-02-15 16:26:07 Executor: INFO: Finished task 171.0 in stage 2.0 (TID 1054). 1002 bytes result sent to driver 2020-02-15 16:26:07 TaskSetManager: INFO: Starting task 172.0 in stage 2.0 (TID 1055, localhost, executor driver, partition 172, PROCESS_LOCAL, 9166 bytes) 2020-02-15 16:26:07 TaskSetManager: INFO: Finished task 171.0 in stage 2.0 (TID 1054) in 220706 ms on localhost (executor driver) (172/882) 2020-02-15 16:26:07 Executor: INFO: Running task 172.0 in stage 2.0 (TID 1055) 2020-02-15 16:26:07 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 16:26:07 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 16:26:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5771362304+33554432 2020-02-15 16:26:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:29:41 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000172_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000172 2020-02-15 16:29:41 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000172_0: Committed 2020-02-15 16:29:41 Executor: INFO: Finished task 172.0 in stage 2.0 (TID 1055). 959 bytes result sent to driver 2020-02-15 16:29:41 TaskSetManager: INFO: Starting task 173.0 in stage 2.0 (TID 1056, localhost, executor driver, partition 173, PROCESS_LOCAL, 9321 bytes) 2020-02-15 16:29:41 TaskSetManager: INFO: Finished task 172.0 in stage 2.0 (TID 1055) in 214033 ms on localhost (executor driver) (173/882) 2020-02-15 16:29:41 Executor: INFO: Running task 173.0 in stage 2.0 (TID 1056) 2020-02-15 16:29:41 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 16:29:41 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 16:29:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5804916736+33554432 2020-02-15 16:29:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:34:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5838471168+33554432 2020-02-15 16:34:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:39:13 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000173_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000173 2020-02-15 16:39:13 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000173_0: Committed 2020-02-15 16:39:13 Executor: INFO: Finished task 173.0 in stage 2.0 (TID 1056). 959 bytes result sent to driver 2020-02-15 16:39:13 TaskSetManager: INFO: Starting task 174.0 in stage 2.0 (TID 1057, localhost, executor driver, partition 174, PROCESS_LOCAL, 9136 bytes) 2020-02-15 16:39:13 TaskSetManager: INFO: Finished task 173.0 in stage 2.0 (TID 1056) in 571655 ms on localhost (executor driver) (174/882) 2020-02-15 16:39:13 Executor: INFO: Running task 174.0 in stage 2.0 (TID 1057) 2020-02-15 16:39:13 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 16:39:13 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 16:39:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5838471168+33554432 2020-02-15 16:39:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:44:13 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000174_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000174 2020-02-15 16:44:13 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000174_0: Committed 2020-02-15 16:44:13 Executor: INFO: Finished task 174.0 in stage 2.0 (TID 1057). 959 bytes result sent to driver 2020-02-15 16:44:13 TaskSetManager: INFO: Starting task 175.0 in stage 2.0 (TID 1058, localhost, executor driver, partition 175, PROCESS_LOCAL, 9321 bytes) 2020-02-15 16:44:13 TaskSetManager: INFO: Finished task 174.0 in stage 2.0 (TID 1057) in 300821 ms on localhost (executor driver) (175/882) 2020-02-15 16:44:13 Executor: INFO: Running task 175.0 in stage 2.0 (TID 1058) 2020-02-15 16:44:13 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 16:44:13 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 16:44:14 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5872025600+33554432 2020-02-15 16:44:14 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:48:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5905580032+33554432 2020-02-15 16:48:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:51:16 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000175_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000175 2020-02-15 16:51:16 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000175_0: Committed 2020-02-15 16:51:16 Executor: INFO: Finished task 175.0 in stage 2.0 (TID 1058). 959 bytes result sent to driver 2020-02-15 16:51:16 TaskSetManager: INFO: Starting task 176.0 in stage 2.0 (TID 1059, localhost, executor driver, partition 176, PROCESS_LOCAL, 9136 bytes) 2020-02-15 16:51:16 TaskSetManager: INFO: Finished task 175.0 in stage 2.0 (TID 1058) in 422887 ms on localhost (executor driver) (176/882) 2020-02-15 16:51:16 Executor: INFO: Running task 176.0 in stage 2.0 (TID 1059) 2020-02-15 16:51:16 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 16:51:16 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 16:51:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5905580032+33554432 2020-02-15 16:51:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:54:11 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000176_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000176 2020-02-15 16:54:11 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000176_0: Committed 2020-02-15 16:54:11 Executor: INFO: Finished task 176.0 in stage 2.0 (TID 1059). 959 bytes result sent to driver 2020-02-15 16:54:11 TaskSetManager: INFO: Starting task 177.0 in stage 2.0 (TID 1060, localhost, executor driver, partition 177, PROCESS_LOCAL, 9321 bytes) 2020-02-15 16:54:11 TaskSetManager: INFO: Finished task 176.0 in stage 2.0 (TID 1059) in 175072 ms on localhost (executor driver) (177/882) 2020-02-15 16:54:11 Executor: INFO: Running task 177.0 in stage 2.0 (TID 1060) 2020-02-15 16:54:11 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 16:54:11 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 16:54:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5939134464+33554432 2020-02-15 16:54:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 16:57:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5972688896+33554432 2020-02-15 16:57:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:00:57 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000177_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000177 2020-02-15 17:00:57 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000177_0: Committed 2020-02-15 17:00:57 Executor: INFO: Finished task 177.0 in stage 2.0 (TID 1060). 959 bytes result sent to driver 2020-02-15 17:00:57 TaskSetManager: INFO: Starting task 178.0 in stage 2.0 (TID 1061, localhost, executor driver, partition 178, PROCESS_LOCAL, 9136 bytes) 2020-02-15 17:00:57 TaskSetManager: INFO: Finished task 177.0 in stage 2.0 (TID 1060) in 405978 ms on localhost (executor driver) (178/882) 2020-02-15 17:00:57 Executor: INFO: Running task 178.0 in stage 2.0 (TID 1061) 2020-02-15 17:00:57 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 17:00:57 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 17:00:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:5972688896+33554432 2020-02-15 17:00:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:04:39 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000178_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000178 2020-02-15 17:04:39 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000178_0: Committed 2020-02-15 17:04:39 Executor: INFO: Finished task 178.0 in stage 2.0 (TID 1061). 959 bytes result sent to driver 2020-02-15 17:04:39 TaskSetManager: INFO: Starting task 179.0 in stage 2.0 (TID 1062, localhost, executor driver, partition 179, PROCESS_LOCAL, 9166 bytes) 2020-02-15 17:04:39 TaskSetManager: INFO: Finished task 178.0 in stage 2.0 (TID 1061) in 221415 ms on localhost (executor driver) (179/882) 2020-02-15 17:04:39 Executor: INFO: Running task 179.0 in stage 2.0 (TID 1062) 2020-02-15 17:04:39 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 17:04:39 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 17:04:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6006243328+33554432 2020-02-15 17:04:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:08:15 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000179_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000179 2020-02-15 17:08:15 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000179_0: Committed 2020-02-15 17:08:15 Executor: INFO: Finished task 179.0 in stage 2.0 (TID 1062). 959 bytes result sent to driver 2020-02-15 17:08:15 TaskSetManager: INFO: Starting task 180.0 in stage 2.0 (TID 1063, localhost, executor driver, partition 180, PROCESS_LOCAL, 9166 bytes) 2020-02-15 17:08:15 TaskSetManager: INFO: Finished task 179.0 in stage 2.0 (TID 1062) in 216685 ms on localhost (executor driver) (180/882) 2020-02-15 17:08:15 Executor: INFO: Running task 180.0 in stage 2.0 (TID 1063) 2020-02-15 17:08:16 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 17:08:16 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 17:08:16 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6039797760+33554432 2020-02-15 17:08:16 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:11:59 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000180_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000180 2020-02-15 17:11:59 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000180_0: Committed 2020-02-15 17:11:59 Executor: INFO: Finished task 180.0 in stage 2.0 (TID 1063). 959 bytes result sent to driver 2020-02-15 17:11:59 TaskSetManager: INFO: Starting task 181.0 in stage 2.0 (TID 1064, localhost, executor driver, partition 181, PROCESS_LOCAL, 9321 bytes) 2020-02-15 17:11:59 TaskSetManager: INFO: Finished task 180.0 in stage 2.0 (TID 1063) in 223664 ms on localhost (executor driver) (181/882) 2020-02-15 17:11:59 Executor: INFO: Running task 181.0 in stage 2.0 (TID 1064) 2020-02-15 17:11:59 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 17:11:59 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 17:11:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6073352192+33554432 2020-02-15 17:11:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:15:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6106906624+33554432 2020-02-15 17:15:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:18:59 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000181_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000181 2020-02-15 17:18:59 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000181_0: Committed 2020-02-15 17:18:59 Executor: INFO: Finished task 181.0 in stage 2.0 (TID 1064). 959 bytes result sent to driver 2020-02-15 17:18:59 TaskSetManager: INFO: Starting task 182.0 in stage 2.0 (TID 1065, localhost, executor driver, partition 182, PROCESS_LOCAL, 9136 bytes) 2020-02-15 17:18:59 TaskSetManager: INFO: Finished task 181.0 in stage 2.0 (TID 1064) in 419502 ms on localhost (executor driver) (182/882) 2020-02-15 17:18:59 Executor: INFO: Running task 182.0 in stage 2.0 (TID 1065) 2020-02-15 17:18:59 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 17:18:59 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 17:18:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6106906624+33554432 2020-02-15 17:18:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:22:36 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000182_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000182 2020-02-15 17:22:36 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000182_0: Committed 2020-02-15 17:22:36 Executor: INFO: Finished task 182.0 in stage 2.0 (TID 1065). 959 bytes result sent to driver 2020-02-15 17:22:36 TaskSetManager: INFO: Starting task 183.0 in stage 2.0 (TID 1066, localhost, executor driver, partition 183, PROCESS_LOCAL, 9321 bytes) 2020-02-15 17:22:36 TaskSetManager: INFO: Finished task 182.0 in stage 2.0 (TID 1065) in 217184 ms on localhost (executor driver) (183/882) 2020-02-15 17:22:36 Executor: INFO: Running task 183.0 in stage 2.0 (TID 1066) 2020-02-15 17:22:36 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 17:22:36 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 17:22:36 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6140461056+33554432 2020-02-15 17:22:36 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:25:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6174015488+33554432 2020-02-15 17:25:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:29:57 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000183_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000183 2020-02-15 17:29:57 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000183_0: Committed 2020-02-15 17:29:57 Executor: INFO: Finished task 183.0 in stage 2.0 (TID 1066). 959 bytes result sent to driver 2020-02-15 17:29:57 TaskSetManager: INFO: Starting task 184.0 in stage 2.0 (TID 1067, localhost, executor driver, partition 184, PROCESS_LOCAL, 8749 bytes) 2020-02-15 17:29:57 TaskSetManager: INFO: Finished task 183.0 in stage 2.0 (TID 1066) in 441580 ms on localhost (executor driver) (184/882) 2020-02-15 17:29:57 Executor: INFO: Running task 184.0 in stage 2.0 (TID 1067) 2020-02-15 17:29:57 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 17:29:57 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 17:29:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6174015488+33554432 2020-02-15 17:29:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:34:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6207569920+33554432 2020-02-15 17:34:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:38:35 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000184_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000184 2020-02-15 17:38:35 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000184_0: Committed 2020-02-15 17:38:35 Executor: INFO: Finished task 184.0 in stage 2.0 (TID 1067). 959 bytes result sent to driver 2020-02-15 17:38:35 TaskSetManager: INFO: Starting task 185.0 in stage 2.0 (TID 1068, localhost, executor driver, partition 185, PROCESS_LOCAL, 9136 bytes) 2020-02-15 17:38:35 TaskSetManager: INFO: Finished task 184.0 in stage 2.0 (TID 1067) in 517784 ms on localhost (executor driver) (185/882) 2020-02-15 17:38:35 Executor: INFO: Running task 185.0 in stage 2.0 (TID 1068) 2020-02-15 17:38:35 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 17:38:35 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 17:38:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6207569920+33554432 2020-02-15 17:38:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:42:54 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000185_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000185 2020-02-15 17:42:54 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000185_0: Committed 2020-02-15 17:42:54 Executor: INFO: Finished task 185.0 in stage 2.0 (TID 1068). 959 bytes result sent to driver 2020-02-15 17:42:54 TaskSetManager: INFO: Starting task 186.0 in stage 2.0 (TID 1069, localhost, executor driver, partition 186, PROCESS_LOCAL, 9166 bytes) 2020-02-15 17:42:54 TaskSetManager: INFO: Finished task 185.0 in stage 2.0 (TID 1068) in 258921 ms on localhost (executor driver) (186/882) 2020-02-15 17:42:54 Executor: INFO: Running task 186.0 in stage 2.0 (TID 1069) 2020-02-15 17:42:54 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 17:42:54 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 17:42:54 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6241124352+33554432 2020-02-15 17:42:54 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:47:30 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000186_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000186 2020-02-15 17:47:30 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000186_0: Committed 2020-02-15 17:47:30 Executor: INFO: Finished task 186.0 in stage 2.0 (TID 1069). 959 bytes result sent to driver 2020-02-15 17:47:30 TaskSetManager: INFO: Starting task 187.0 in stage 2.0 (TID 1070, localhost, executor driver, partition 187, PROCESS_LOCAL, 9166 bytes) 2020-02-15 17:47:30 TaskSetManager: INFO: Finished task 186.0 in stage 2.0 (TID 1069) in 276349 ms on localhost (executor driver) (187/882) 2020-02-15 17:47:30 Executor: INFO: Running task 187.0 in stage 2.0 (TID 1070) 2020-02-15 17:47:30 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 17:47:30 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 17:47:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6274678784+33554432 2020-02-15 17:47:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:50:39 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000187_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000187 2020-02-15 17:50:39 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000187_0: Committed 2020-02-15 17:50:39 Executor: INFO: Finished task 187.0 in stage 2.0 (TID 1070). 959 bytes result sent to driver 2020-02-15 17:50:39 TaskSetManager: INFO: Starting task 188.0 in stage 2.0 (TID 1071, localhost, executor driver, partition 188, PROCESS_LOCAL, 9321 bytes) 2020-02-15 17:50:39 TaskSetManager: INFO: Finished task 187.0 in stage 2.0 (TID 1070) in 188577 ms on localhost (executor driver) (188/882) 2020-02-15 17:50:39 Executor: INFO: Running task 188.0 in stage 2.0 (TID 1071) 2020-02-15 17:50:39 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 17:50:39 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 17:50:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6308233216+33554432 2020-02-15 17:50:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 17:56:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6341787648+33554432 2020-02-15 17:56:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:00:17 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000188_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000188 2020-02-15 18:00:17 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000188_0: Committed 2020-02-15 18:00:17 Executor: INFO: Finished task 188.0 in stage 2.0 (TID 1071). 959 bytes result sent to driver 2020-02-15 18:00:17 TaskSetManager: INFO: Starting task 189.0 in stage 2.0 (TID 1072, localhost, executor driver, partition 189, PROCESS_LOCAL, 8749 bytes) 2020-02-15 18:00:17 TaskSetManager: INFO: Finished task 188.0 in stage 2.0 (TID 1071) in 578323 ms on localhost (executor driver) (189/882) 2020-02-15 18:00:17 Executor: INFO: Running task 189.0 in stage 2.0 (TID 1072) 2020-02-15 18:00:17 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 18:00:17 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 18:00:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6341787648+33554432 2020-02-15 18:00:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:04:44 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6375342080+33554432 2020-02-15 18:04:44 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:08:57 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000189_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000189 2020-02-15 18:08:57 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000189_0: Committed 2020-02-15 18:08:57 Executor: INFO: Finished task 189.0 in stage 2.0 (TID 1072). 959 bytes result sent to driver 2020-02-15 18:08:57 TaskSetManager: INFO: Starting task 190.0 in stage 2.0 (TID 1073, localhost, executor driver, partition 190, PROCESS_LOCAL, 9136 bytes) 2020-02-15 18:08:57 TaskSetManager: INFO: Finished task 189.0 in stage 2.0 (TID 1072) in 519791 ms on localhost (executor driver) (190/882) 2020-02-15 18:08:57 Executor: INFO: Running task 190.0 in stage 2.0 (TID 1073) 2020-02-15 18:08:57 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 18:08:57 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 18:08:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6375342080+33554432 2020-02-15 18:08:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:13:18 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000190_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000190 2020-02-15 18:13:18 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000190_0: Committed 2020-02-15 18:13:18 Executor: INFO: Finished task 190.0 in stage 2.0 (TID 1073). 959 bytes result sent to driver 2020-02-15 18:13:18 TaskSetManager: INFO: Starting task 191.0 in stage 2.0 (TID 1074, localhost, executor driver, partition 191, PROCESS_LOCAL, 9166 bytes) 2020-02-15 18:13:18 TaskSetManager: INFO: Finished task 190.0 in stage 2.0 (TID 1073) in 260648 ms on localhost (executor driver) (191/882) 2020-02-15 18:13:18 Executor: INFO: Running task 191.0 in stage 2.0 (TID 1074) 2020-02-15 18:13:18 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 18:13:18 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 18:13:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6408896512+33554432 2020-02-15 18:13:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:17:17 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000191_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000191 2020-02-15 18:17:17 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000191_0: Committed 2020-02-15 18:17:17 Executor: INFO: Finished task 191.0 in stage 2.0 (TID 1074). 959 bytes result sent to driver 2020-02-15 18:17:17 TaskSetManager: INFO: Starting task 192.0 in stage 2.0 (TID 1075, localhost, executor driver, partition 192, PROCESS_LOCAL, 9321 bytes) 2020-02-15 18:17:17 TaskSetManager: INFO: Finished task 191.0 in stage 2.0 (TID 1074) in 239265 ms on localhost (executor driver) (192/882) 2020-02-15 18:17:17 Executor: INFO: Running task 192.0 in stage 2.0 (TID 1075) 2020-02-15 18:17:17 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 18:17:17 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 18:17:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6442450944+33554432 2020-02-15 18:17:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:21:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6476005376+33554432 2020-02-15 18:21:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:25:53 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000192_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000192 2020-02-15 18:25:53 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000192_0: Committed 2020-02-15 18:25:53 Executor: INFO: Finished task 192.0 in stage 2.0 (TID 1075). 959 bytes result sent to driver 2020-02-15 18:25:53 TaskSetManager: INFO: Starting task 193.0 in stage 2.0 (TID 1076, localhost, executor driver, partition 193, PROCESS_LOCAL, 9144 bytes) 2020-02-15 18:25:53 TaskSetManager: INFO: Finished task 192.0 in stage 2.0 (TID 1075) in 515692 ms on localhost (executor driver) (193/882) 2020-02-15 18:25:53 Executor: INFO: Running task 193.0 in stage 2.0 (TID 1076) 2020-02-15 18:25:53 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 18:25:53 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 18:25:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6476005376+33554432 2020-02-15 18:25:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:30:13 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000193_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000193 2020-02-15 18:30:13 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000193_0: Committed 2020-02-15 18:30:13 Executor: INFO: Finished task 193.0 in stage 2.0 (TID 1076). 959 bytes result sent to driver 2020-02-15 18:30:13 TaskSetManager: INFO: Starting task 194.0 in stage 2.0 (TID 1077, localhost, executor driver, partition 194, PROCESS_LOCAL, 9166 bytes) 2020-02-15 18:30:13 TaskSetManager: INFO: Finished task 193.0 in stage 2.0 (TID 1076) in 260165 ms on localhost (executor driver) (194/882) 2020-02-15 18:30:13 Executor: INFO: Running task 194.0 in stage 2.0 (TID 1077) 2020-02-15 18:30:13 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 18:30:13 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 18:30:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6509559808+33554432 2020-02-15 18:30:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:34:19 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000194_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000194 2020-02-15 18:34:19 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000194_0: Committed 2020-02-15 18:34:19 Executor: INFO: Finished task 194.0 in stage 2.0 (TID 1077). 959 bytes result sent to driver 2020-02-15 18:34:19 TaskSetManager: INFO: Starting task 195.0 in stage 2.0 (TID 1078, localhost, executor driver, partition 195, PROCESS_LOCAL, 9166 bytes) 2020-02-15 18:34:19 TaskSetManager: INFO: Finished task 194.0 in stage 2.0 (TID 1077) in 245934 ms on localhost (executor driver) (195/882) 2020-02-15 18:34:19 Executor: INFO: Running task 195.0 in stage 2.0 (TID 1078) 2020-02-15 18:34:19 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 18:34:19 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 18:34:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6543114240+33554432 2020-02-15 18:34:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:37:59 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000195_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000195 2020-02-15 18:37:59 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000195_0: Committed 2020-02-15 18:37:59 Executor: INFO: Finished task 195.0 in stage 2.0 (TID 1078). 1002 bytes result sent to driver 2020-02-15 18:37:59 TaskSetManager: INFO: Starting task 196.0 in stage 2.0 (TID 1079, localhost, executor driver, partition 196, PROCESS_LOCAL, 9166 bytes) 2020-02-15 18:37:59 TaskSetManager: INFO: Finished task 195.0 in stage 2.0 (TID 1078) in 220351 ms on localhost (executor driver) (196/882) 2020-02-15 18:37:59 Executor: INFO: Running task 196.0 in stage 2.0 (TID 1079) 2020-02-15 18:37:59 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 18:37:59 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 18:37:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6576668672+33554432 2020-02-15 18:37:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:41:23 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000196_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000196 2020-02-15 18:41:23 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000196_0: Committed 2020-02-15 18:41:23 Executor: INFO: Finished task 196.0 in stage 2.0 (TID 1079). 959 bytes result sent to driver 2020-02-15 18:41:23 TaskSetManager: INFO: Starting task 197.0 in stage 2.0 (TID 1080, localhost, executor driver, partition 197, PROCESS_LOCAL, 9321 bytes) 2020-02-15 18:41:23 TaskSetManager: INFO: Finished task 196.0 in stage 2.0 (TID 1079) in 204002 ms on localhost (executor driver) (197/882) 2020-02-15 18:41:23 Executor: INFO: Running task 197.0 in stage 2.0 (TID 1080) 2020-02-15 18:41:23 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 18:41:23 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 18:41:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6610223104+33554432 2020-02-15 18:41:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:45:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6643777536+33554432 2020-02-15 18:45:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:49:32 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000197_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000197 2020-02-15 18:49:32 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000197_0: Committed 2020-02-15 18:49:32 Executor: INFO: Finished task 197.0 in stage 2.0 (TID 1080). 959 bytes result sent to driver 2020-02-15 18:49:32 TaskSetManager: INFO: Starting task 198.0 in stage 2.0 (TID 1081, localhost, executor driver, partition 198, PROCESS_LOCAL, 9136 bytes) 2020-02-15 18:49:32 TaskSetManager: INFO: Finished task 197.0 in stage 2.0 (TID 1080) in 489046 ms on localhost (executor driver) (198/882) 2020-02-15 18:49:32 Executor: INFO: Running task 198.0 in stage 2.0 (TID 1081) 2020-02-15 18:49:32 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 18:49:32 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 18:49:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6643777536+33554432 2020-02-15 18:49:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:53:47 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000198_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000198 2020-02-15 18:53:47 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000198_0: Committed 2020-02-15 18:53:47 Executor: INFO: Finished task 198.0 in stage 2.0 (TID 1081). 959 bytes result sent to driver 2020-02-15 18:53:47 TaskSetManager: INFO: Starting task 199.0 in stage 2.0 (TID 1082, localhost, executor driver, partition 199, PROCESS_LOCAL, 9166 bytes) 2020-02-15 18:53:47 TaskSetManager: INFO: Finished task 198.0 in stage 2.0 (TID 1081) in 254648 ms on localhost (executor driver) (199/882) 2020-02-15 18:53:47 Executor: INFO: Running task 199.0 in stage 2.0 (TID 1082) 2020-02-15 18:53:47 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 18:53:47 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 18:53:47 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6677331968+33554432 2020-02-15 18:53:47 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 18:57:18 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000199_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000199 2020-02-15 18:57:18 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000199_0: Committed 2020-02-15 18:57:18 Executor: INFO: Finished task 199.0 in stage 2.0 (TID 1082). 959 bytes result sent to driver 2020-02-15 18:57:18 TaskSetManager: INFO: Starting task 200.0 in stage 2.0 (TID 1083, localhost, executor driver, partition 200, PROCESS_LOCAL, 9166 bytes) 2020-02-15 18:57:18 TaskSetManager: INFO: Finished task 199.0 in stage 2.0 (TID 1082) in 211293 ms on localhost (executor driver) (200/882) 2020-02-15 18:57:18 Executor: INFO: Running task 200.0 in stage 2.0 (TID 1083) 2020-02-15 18:57:18 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 18:57:18 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 18:57:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6710886400+33554432 2020-02-15 18:57:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:00:33 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000200_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000200 2020-02-15 19:00:33 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000200_0: Committed 2020-02-15 19:00:33 Executor: INFO: Finished task 200.0 in stage 2.0 (TID 1083). 959 bytes result sent to driver 2020-02-15 19:00:33 TaskSetManager: INFO: Starting task 201.0 in stage 2.0 (TID 1084, localhost, executor driver, partition 201, PROCESS_LOCAL, 9166 bytes) 2020-02-15 19:00:33 TaskSetManager: INFO: Finished task 200.0 in stage 2.0 (TID 1083) in 194517 ms on localhost (executor driver) (201/882) 2020-02-15 19:00:33 Executor: INFO: Running task 201.0 in stage 2.0 (TID 1084) 2020-02-15 19:00:33 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:00:33 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:00:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6744440832+33554432 2020-02-15 19:00:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:04:18 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000201_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000201 2020-02-15 19:04:18 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000201_0: Committed 2020-02-15 19:04:18 Executor: INFO: Finished task 201.0 in stage 2.0 (TID 1084). 959 bytes result sent to driver 2020-02-15 19:04:18 TaskSetManager: INFO: Starting task 202.0 in stage 2.0 (TID 1085, localhost, executor driver, partition 202, PROCESS_LOCAL, 9166 bytes) 2020-02-15 19:04:18 TaskSetManager: INFO: Finished task 201.0 in stage 2.0 (TID 1084) in 225495 ms on localhost (executor driver) (202/882) 2020-02-15 19:04:18 Executor: INFO: Running task 202.0 in stage 2.0 (TID 1085) 2020-02-15 19:04:18 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:04:18 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:04:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6777995264+33554432 2020-02-15 19:04:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:07:31 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000202_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000202 2020-02-15 19:07:31 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000202_0: Committed 2020-02-15 19:07:31 Executor: INFO: Finished task 202.0 in stage 2.0 (TID 1085). 959 bytes result sent to driver 2020-02-15 19:07:31 TaskSetManager: INFO: Starting task 203.0 in stage 2.0 (TID 1086, localhost, executor driver, partition 203, PROCESS_LOCAL, 9166 bytes) 2020-02-15 19:07:31 TaskSetManager: INFO: Finished task 202.0 in stage 2.0 (TID 1085) in 192946 ms on localhost (executor driver) (203/882) 2020-02-15 19:07:31 Executor: INFO: Running task 203.0 in stage 2.0 (TID 1086) 2020-02-15 19:07:31 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:07:31 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:07:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6811549696+33554432 2020-02-15 19:07:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:10:56 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000203_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000203 2020-02-15 19:10:56 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000203_0: Committed 2020-02-15 19:10:56 Executor: INFO: Finished task 203.0 in stage 2.0 (TID 1086). 959 bytes result sent to driver 2020-02-15 19:10:56 TaskSetManager: INFO: Starting task 204.0 in stage 2.0 (TID 1087, localhost, executor driver, partition 204, PROCESS_LOCAL, 9166 bytes) 2020-02-15 19:10:56 TaskSetManager: INFO: Finished task 203.0 in stage 2.0 (TID 1086) in 205262 ms on localhost (executor driver) (204/882) 2020-02-15 19:10:56 Executor: INFO: Running task 204.0 in stage 2.0 (TID 1087) 2020-02-15 19:10:56 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:10:56 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:10:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6845104128+33554432 2020-02-15 19:10:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:13:59 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000204_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000204 2020-02-15 19:13:59 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000204_0: Committed 2020-02-15 19:13:59 Executor: INFO: Finished task 204.0 in stage 2.0 (TID 1087). 959 bytes result sent to driver 2020-02-15 19:13:59 TaskSetManager: INFO: Starting task 205.0 in stage 2.0 (TID 1088, localhost, executor driver, partition 205, PROCESS_LOCAL, 9166 bytes) 2020-02-15 19:13:59 TaskSetManager: INFO: Finished task 204.0 in stage 2.0 (TID 1087) in 182974 ms on localhost (executor driver) (205/882) 2020-02-15 19:13:59 Executor: INFO: Running task 205.0 in stage 2.0 (TID 1088) 2020-02-15 19:13:59 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:13:59 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:13:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6878658560+33554432 2020-02-15 19:13:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:17:35 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000205_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000205 2020-02-15 19:17:35 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000205_0: Committed 2020-02-15 19:17:35 Executor: INFO: Finished task 205.0 in stage 2.0 (TID 1088). 959 bytes result sent to driver 2020-02-15 19:17:35 TaskSetManager: INFO: Starting task 206.0 in stage 2.0 (TID 1089, localhost, executor driver, partition 206, PROCESS_LOCAL, 9321 bytes) 2020-02-15 19:17:35 TaskSetManager: INFO: Finished task 205.0 in stage 2.0 (TID 1088) in 215790 ms on localhost (executor driver) (206/882) 2020-02-15 19:17:35 Executor: INFO: Running task 206.0 in stage 2.0 (TID 1089) 2020-02-15 19:17:35 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:17:35 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:17:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6912212992+33554432 2020-02-15 19:17:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:20:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6945767424+33554432 2020-02-15 19:20:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:24:33 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000206_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000206 2020-02-15 19:24:33 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000206_0: Committed 2020-02-15 19:24:33 Executor: INFO: Finished task 206.0 in stage 2.0 (TID 1089). 1002 bytes result sent to driver 2020-02-15 19:24:33 TaskSetManager: INFO: Starting task 207.0 in stage 2.0 (TID 1090, localhost, executor driver, partition 207, PROCESS_LOCAL, 9136 bytes) 2020-02-15 19:24:33 TaskSetManager: INFO: Finished task 206.0 in stage 2.0 (TID 1089) in 417459 ms on localhost (executor driver) (207/882) 2020-02-15 19:24:33 Executor: INFO: Running task 207.0 in stage 2.0 (TID 1090) 2020-02-15 19:24:33 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:24:33 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:24:33 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6945767424+33554432 2020-02-15 19:24:33 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:28:24 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000207_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000207 2020-02-15 19:28:24 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000207_0: Committed 2020-02-15 19:28:24 Executor: INFO: Finished task 207.0 in stage 2.0 (TID 1090). 959 bytes result sent to driver 2020-02-15 19:28:24 TaskSetManager: INFO: Starting task 208.0 in stage 2.0 (TID 1091, localhost, executor driver, partition 208, PROCESS_LOCAL, 9166 bytes) 2020-02-15 19:28:24 TaskSetManager: INFO: Finished task 207.0 in stage 2.0 (TID 1090) in 231127 ms on localhost (executor driver) (208/882) 2020-02-15 19:28:24 Executor: INFO: Running task 208.0 in stage 2.0 (TID 1091) 2020-02-15 19:28:24 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:28:24 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:28:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:6979321856+33554432 2020-02-15 19:28:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:33:22 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000208_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000208 2020-02-15 19:33:22 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000208_0: Committed 2020-02-15 19:33:22 Executor: INFO: Finished task 208.0 in stage 2.0 (TID 1091). 959 bytes result sent to driver 2020-02-15 19:33:22 TaskSetManager: INFO: Starting task 209.0 in stage 2.0 (TID 1092, localhost, executor driver, partition 209, PROCESS_LOCAL, 9166 bytes) 2020-02-15 19:33:22 TaskSetManager: INFO: Finished task 208.0 in stage 2.0 (TID 1091) in 298194 ms on localhost (executor driver) (209/882) 2020-02-15 19:33:22 Executor: INFO: Running task 209.0 in stage 2.0 (TID 1092) 2020-02-15 19:33:22 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:33:22 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:33:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7012876288+33554432 2020-02-15 19:33:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:37:43 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000209_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000209 2020-02-15 19:37:43 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000209_0: Committed 2020-02-15 19:37:43 Executor: INFO: Finished task 209.0 in stage 2.0 (TID 1092). 959 bytes result sent to driver 2020-02-15 19:37:43 TaskSetManager: INFO: Starting task 210.0 in stage 2.0 (TID 1093, localhost, executor driver, partition 210, PROCESS_LOCAL, 9166 bytes) 2020-02-15 19:37:43 TaskSetManager: INFO: Finished task 209.0 in stage 2.0 (TID 1092) in 261117 ms on localhost (executor driver) (210/882) 2020-02-15 19:37:43 Executor: INFO: Running task 210.0 in stage 2.0 (TID 1093) 2020-02-15 19:37:43 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:37:43 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:37:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7046430720+33554432 2020-02-15 19:37:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:41:08 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000210_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000210 2020-02-15 19:41:08 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000210_0: Committed 2020-02-15 19:41:08 Executor: INFO: Finished task 210.0 in stage 2.0 (TID 1093). 959 bytes result sent to driver 2020-02-15 19:41:08 TaskSetManager: INFO: Starting task 211.0 in stage 2.0 (TID 1094, localhost, executor driver, partition 211, PROCESS_LOCAL, 9166 bytes) 2020-02-15 19:41:08 TaskSetManager: INFO: Finished task 210.0 in stage 2.0 (TID 1093) in 205403 ms on localhost (executor driver) (211/882) 2020-02-15 19:41:08 Executor: INFO: Running task 211.0 in stage 2.0 (TID 1094) 2020-02-15 19:41:08 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:41:08 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:41:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7079985152+33554432 2020-02-15 19:41:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:46:22 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000211_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000211 2020-02-15 19:46:22 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000211_0: Committed 2020-02-15 19:46:22 Executor: INFO: Finished task 211.0 in stage 2.0 (TID 1094). 959 bytes result sent to driver 2020-02-15 19:46:22 TaskSetManager: INFO: Starting task 212.0 in stage 2.0 (TID 1095, localhost, executor driver, partition 212, PROCESS_LOCAL, 9166 bytes) 2020-02-15 19:46:22 TaskSetManager: INFO: Finished task 211.0 in stage 2.0 (TID 1094) in 313581 ms on localhost (executor driver) (212/882) 2020-02-15 19:46:22 Executor: INFO: Running task 212.0 in stage 2.0 (TID 1095) 2020-02-15 19:46:22 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:46:22 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:46:22 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7113539584+33554432 2020-02-15 19:46:22 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:52:01 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000212_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000212 2020-02-15 19:52:01 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000212_0: Committed 2020-02-15 19:52:01 Executor: INFO: Finished task 212.0 in stage 2.0 (TID 1095). 959 bytes result sent to driver 2020-02-15 19:52:01 TaskSetManager: INFO: Starting task 213.0 in stage 2.0 (TID 1096, localhost, executor driver, partition 213, PROCESS_LOCAL, 9166 bytes) 2020-02-15 19:52:01 TaskSetManager: INFO: Finished task 212.0 in stage 2.0 (TID 1095) in 339389 ms on localhost (executor driver) (213/882) 2020-02-15 19:52:01 Executor: INFO: Running task 213.0 in stage 2.0 (TID 1096) 2020-02-15 19:52:01 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:52:01 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:52:01 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7147094016+33554432 2020-02-15 19:52:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 19:56:35 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000213_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000213 2020-02-15 19:56:35 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000213_0: Committed 2020-02-15 19:56:35 Executor: INFO: Finished task 213.0 in stage 2.0 (TID 1096). 959 bytes result sent to driver 2020-02-15 19:56:35 TaskSetManager: INFO: Starting task 214.0 in stage 2.0 (TID 1097, localhost, executor driver, partition 214, PROCESS_LOCAL, 9166 bytes) 2020-02-15 19:56:35 TaskSetManager: INFO: Finished task 213.0 in stage 2.0 (TID 1096) in 273266 ms on localhost (executor driver) (214/882) 2020-02-15 19:56:35 Executor: INFO: Running task 214.0 in stage 2.0 (TID 1097) 2020-02-15 19:56:35 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 19:56:35 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 19:56:35 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7180648448+33554432 2020-02-15 19:56:35 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:01:28 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000214_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000214 2020-02-15 20:01:28 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000214_0: Committed 2020-02-15 20:01:28 Executor: INFO: Finished task 214.0 in stage 2.0 (TID 1097). 959 bytes result sent to driver 2020-02-15 20:01:28 TaskSetManager: INFO: Starting task 215.0 in stage 2.0 (TID 1098, localhost, executor driver, partition 215, PROCESS_LOCAL, 9166 bytes) 2020-02-15 20:01:28 TaskSetManager: INFO: Finished task 214.0 in stage 2.0 (TID 1097) in 292910 ms on localhost (executor driver) (215/882) 2020-02-15 20:01:28 Executor: INFO: Running task 215.0 in stage 2.0 (TID 1098) 2020-02-15 20:01:28 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 20:01:28 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 20:01:28 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7214202880+33554432 2020-02-15 20:01:28 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:07:11 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000215_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000215 2020-02-15 20:07:11 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000215_0: Committed 2020-02-15 20:07:11 Executor: INFO: Finished task 215.0 in stage 2.0 (TID 1098). 959 bytes result sent to driver 2020-02-15 20:07:11 TaskSetManager: INFO: Starting task 216.0 in stage 2.0 (TID 1099, localhost, executor driver, partition 216, PROCESS_LOCAL, 9166 bytes) 2020-02-15 20:07:11 TaskSetManager: INFO: Finished task 215.0 in stage 2.0 (TID 1098) in 343129 ms on localhost (executor driver) (216/882) 2020-02-15 20:07:11 Executor: INFO: Running task 216.0 in stage 2.0 (TID 1099) 2020-02-15 20:07:11 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 20:07:11 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 20:07:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7247757312+33554432 2020-02-15 20:07:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:12:41 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000216_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000216 2020-02-15 20:12:41 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000216_0: Committed 2020-02-15 20:12:41 Executor: INFO: Finished task 216.0 in stage 2.0 (TID 1099). 959 bytes result sent to driver 2020-02-15 20:12:41 TaskSetManager: INFO: Starting task 217.0 in stage 2.0 (TID 1100, localhost, executor driver, partition 217, PROCESS_LOCAL, 9166 bytes) 2020-02-15 20:12:41 TaskSetManager: INFO: Finished task 216.0 in stage 2.0 (TID 1099) in 330401 ms on localhost (executor driver) (217/882) 2020-02-15 20:12:41 Executor: INFO: Running task 217.0 in stage 2.0 (TID 1100) 2020-02-15 20:12:41 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 20:12:41 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 20:12:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7281311744+33554432 2020-02-15 20:12:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:17:50 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000217_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000217 2020-02-15 20:17:50 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000217_0: Committed 2020-02-15 20:17:50 Executor: INFO: Finished task 217.0 in stage 2.0 (TID 1100). 959 bytes result sent to driver 2020-02-15 20:17:50 TaskSetManager: INFO: Starting task 218.0 in stage 2.0 (TID 1101, localhost, executor driver, partition 218, PROCESS_LOCAL, 9166 bytes) 2020-02-15 20:17:50 TaskSetManager: INFO: Finished task 217.0 in stage 2.0 (TID 1100) in 309134 ms on localhost (executor driver) (218/882) 2020-02-15 20:17:50 Executor: INFO: Running task 218.0 in stage 2.0 (TID 1101) 2020-02-15 20:17:50 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 20:17:50 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 20:17:50 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7314866176+33554432 2020-02-15 20:17:50 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:23:05 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000218_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000218 2020-02-15 20:23:05 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000218_0: Committed 2020-02-15 20:23:05 Executor: INFO: Finished task 218.0 in stage 2.0 (TID 1101). 959 bytes result sent to driver 2020-02-15 20:23:05 TaskSetManager: INFO: Starting task 219.0 in stage 2.0 (TID 1102, localhost, executor driver, partition 219, PROCESS_LOCAL, 9174 bytes) 2020-02-15 20:23:05 TaskSetManager: INFO: Finished task 218.0 in stage 2.0 (TID 1101) in 314454 ms on localhost (executor driver) (219/882) 2020-02-15 20:23:05 Executor: INFO: Running task 219.0 in stage 2.0 (TID 1102) 2020-02-15 20:23:05 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 20:23:05 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 20:23:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7348420608+33554432 2020-02-15 20:23:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:28:04 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000219_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000219 2020-02-15 20:28:04 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000219_0: Committed 2020-02-15 20:28:04 Executor: INFO: Finished task 219.0 in stage 2.0 (TID 1102). 959 bytes result sent to driver 2020-02-15 20:28:04 TaskSetManager: INFO: Starting task 220.0 in stage 2.0 (TID 1103, localhost, executor driver, partition 220, PROCESS_LOCAL, 9321 bytes) 2020-02-15 20:28:04 TaskSetManager: INFO: Finished task 219.0 in stage 2.0 (TID 1102) in 299327 ms on localhost (executor driver) (220/882) 2020-02-15 20:28:04 Executor: INFO: Running task 220.0 in stage 2.0 (TID 1103) 2020-02-15 20:28:04 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 20:28:04 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 20:28:04 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7381975040+33554432 2020-02-15 20:28:04 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:31:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7415529472+33554432 2020-02-15 20:31:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:36:25 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000220_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000220 2020-02-15 20:36:25 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000220_0: Committed 2020-02-15 20:36:25 Executor: INFO: Finished task 220.0 in stage 2.0 (TID 1103). 959 bytes result sent to driver 2020-02-15 20:36:25 TaskSetManager: INFO: Starting task 221.0 in stage 2.0 (TID 1104, localhost, executor driver, partition 221, PROCESS_LOCAL, 8749 bytes) 2020-02-15 20:36:25 TaskSetManager: INFO: Finished task 220.0 in stage 2.0 (TID 1103) in 501067 ms on localhost (executor driver) (221/882) 2020-02-15 20:36:25 Executor: INFO: Running task 221.0 in stage 2.0 (TID 1104) 2020-02-15 20:36:25 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 20:36:25 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 20:36:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7415529472+33554432 2020-02-15 20:36:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:41:03 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7449083904+33554432 2020-02-15 20:41:03 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:44:56 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000221_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000221 2020-02-15 20:44:56 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000221_0: Committed 2020-02-15 20:44:56 Executor: INFO: Finished task 221.0 in stage 2.0 (TID 1104). 959 bytes result sent to driver 2020-02-15 20:44:56 TaskSetManager: INFO: Starting task 222.0 in stage 2.0 (TID 1105, localhost, executor driver, partition 222, PROCESS_LOCAL, 9136 bytes) 2020-02-15 20:44:56 TaskSetManager: INFO: Finished task 221.0 in stage 2.0 (TID 1104) in 510389 ms on localhost (executor driver) (222/882) 2020-02-15 20:44:56 Executor: INFO: Running task 222.0 in stage 2.0 (TID 1105) 2020-02-15 20:44:56 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 20:44:56 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 20:44:56 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7449083904+33554432 2020-02-15 20:44:56 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:48:55 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000222_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000222 2020-02-15 20:48:55 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000222_0: Committed 2020-02-15 20:48:55 Executor: INFO: Finished task 222.0 in stage 2.0 (TID 1105). 959 bytes result sent to driver 2020-02-15 20:48:55 TaskSetManager: INFO: Starting task 223.0 in stage 2.0 (TID 1106, localhost, executor driver, partition 223, PROCESS_LOCAL, 9166 bytes) 2020-02-15 20:48:55 TaskSetManager: INFO: Finished task 222.0 in stage 2.0 (TID 1105) in 239097 ms on localhost (executor driver) (223/882) 2020-02-15 20:48:55 Executor: INFO: Running task 223.0 in stage 2.0 (TID 1106) 2020-02-15 20:48:55 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 20:48:55 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 20:48:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7482638336+33554432 2020-02-15 20:48:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:52:58 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000223_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000223 2020-02-15 20:52:58 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000223_0: Committed 2020-02-15 20:52:58 Executor: INFO: Finished task 223.0 in stage 2.0 (TID 1106). 959 bytes result sent to driver 2020-02-15 20:52:58 TaskSetManager: INFO: Starting task 224.0 in stage 2.0 (TID 1107, localhost, executor driver, partition 224, PROCESS_LOCAL, 9166 bytes) 2020-02-15 20:52:58 TaskSetManager: INFO: Finished task 223.0 in stage 2.0 (TID 1106) in 243539 ms on localhost (executor driver) (224/882) 2020-02-15 20:52:58 Executor: INFO: Running task 224.0 in stage 2.0 (TID 1107) 2020-02-15 20:52:58 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 20:52:58 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 20:52:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7516192768+33554432 2020-02-15 20:52:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 20:57:18 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000224_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000224 2020-02-15 20:57:18 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000224_0: Committed 2020-02-15 20:57:18 Executor: INFO: Finished task 224.0 in stage 2.0 (TID 1107). 959 bytes result sent to driver 2020-02-15 20:57:18 TaskSetManager: INFO: Starting task 225.0 in stage 2.0 (TID 1108, localhost, executor driver, partition 225, PROCESS_LOCAL, 9166 bytes) 2020-02-15 20:57:18 TaskSetManager: INFO: Finished task 224.0 in stage 2.0 (TID 1107) in 260009 ms on localhost (executor driver) (225/882) 2020-02-15 20:57:18 Executor: INFO: Running task 225.0 in stage 2.0 (TID 1108) 2020-02-15 20:57:18 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 20:57:18 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 20:57:18 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7549747200+33554432 2020-02-15 20:57:18 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:01:04 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000225_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000225 2020-02-15 21:01:04 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000225_0: Committed 2020-02-15 21:01:04 Executor: INFO: Finished task 225.0 in stage 2.0 (TID 1108). 959 bytes result sent to driver 2020-02-15 21:01:04 TaskSetManager: INFO: Starting task 226.0 in stage 2.0 (TID 1109, localhost, executor driver, partition 226, PROCESS_LOCAL, 9321 bytes) 2020-02-15 21:01:04 TaskSetManager: INFO: Finished task 225.0 in stage 2.0 (TID 1108) in 226325 ms on localhost (executor driver) (226/882) 2020-02-15 21:01:04 Executor: INFO: Running task 226.0 in stage 2.0 (TID 1109) 2020-02-15 21:01:05 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 21:01:05 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 21:01:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7583301632+33554432 2020-02-15 21:01:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:04:48 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7616856064+33554432 2020-02-15 21:04:48 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:08:32 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000226_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000226 2020-02-15 21:08:32 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000226_0: Committed 2020-02-15 21:08:32 Executor: INFO: Finished task 226.0 in stage 2.0 (TID 1109). 959 bytes result sent to driver 2020-02-15 21:08:32 TaskSetManager: INFO: Starting task 227.0 in stage 2.0 (TID 1110, localhost, executor driver, partition 227, PROCESS_LOCAL, 8749 bytes) 2020-02-15 21:08:32 TaskSetManager: INFO: Finished task 226.0 in stage 2.0 (TID 1109) in 447230 ms on localhost (executor driver) (227/882) 2020-02-15 21:08:32 Executor: INFO: Running task 227.0 in stage 2.0 (TID 1110) 2020-02-15 21:08:32 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 21:08:32 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 21:08:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7616856064+33554432 2020-02-15 21:08:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:12:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7650410496+33554432 2020-02-15 21:12:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:15:30 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000227_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000227 2020-02-15 21:15:30 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000227_0: Committed 2020-02-15 21:15:30 Executor: INFO: Finished task 227.0 in stage 2.0 (TID 1110). 959 bytes result sent to driver 2020-02-15 21:15:30 TaskSetManager: INFO: Starting task 228.0 in stage 2.0 (TID 1111, localhost, executor driver, partition 228, PROCESS_LOCAL, 9136 bytes) 2020-02-15 21:15:30 TaskSetManager: INFO: Finished task 227.0 in stage 2.0 (TID 1110) in 418240 ms on localhost (executor driver) (228/882) 2020-02-15 21:15:30 Executor: INFO: Running task 228.0 in stage 2.0 (TID 1111) 2020-02-15 21:15:30 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 21:15:30 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 21:15:30 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7650410496+33554432 2020-02-15 21:15:30 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:18:42 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000228_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000228 2020-02-15 21:18:42 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000228_0: Committed 2020-02-15 21:18:42 Executor: INFO: Finished task 228.0 in stage 2.0 (TID 1111). 959 bytes result sent to driver 2020-02-15 21:18:42 TaskSetManager: INFO: Starting task 229.0 in stage 2.0 (TID 1112, localhost, executor driver, partition 229, PROCESS_LOCAL, 9166 bytes) 2020-02-15 21:18:42 TaskSetManager: INFO: Finished task 228.0 in stage 2.0 (TID 1111) in 192510 ms on localhost (executor driver) (229/882) 2020-02-15 21:18:42 Executor: INFO: Running task 229.0 in stage 2.0 (TID 1112) 2020-02-15 21:18:42 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 21:18:42 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 21:18:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7683964928+33554432 2020-02-15 21:18:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:21:34 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000229_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000229 2020-02-15 21:21:34 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000229_0: Committed 2020-02-15 21:21:34 Executor: INFO: Finished task 229.0 in stage 2.0 (TID 1112). 959 bytes result sent to driver 2020-02-15 21:21:34 TaskSetManager: INFO: Starting task 230.0 in stage 2.0 (TID 1113, localhost, executor driver, partition 230, PROCESS_LOCAL, 9166 bytes) 2020-02-15 21:21:34 TaskSetManager: INFO: Finished task 229.0 in stage 2.0 (TID 1112) in 171788 ms on localhost (executor driver) (230/882) 2020-02-15 21:21:34 Executor: INFO: Running task 230.0 in stage 2.0 (TID 1113) 2020-02-15 21:21:34 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 21:21:34 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 21:21:34 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7717519360+33554432 2020-02-15 21:21:34 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:24:55 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000230_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000230 2020-02-15 21:24:55 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000230_0: Committed 2020-02-15 21:24:55 Executor: INFO: Finished task 230.0 in stage 2.0 (TID 1113). 959 bytes result sent to driver 2020-02-15 21:24:55 TaskSetManager: INFO: Starting task 231.0 in stage 2.0 (TID 1114, localhost, executor driver, partition 231, PROCESS_LOCAL, 9182 bytes) 2020-02-15 21:24:55 TaskSetManager: INFO: Finished task 230.0 in stage 2.0 (TID 1113) in 200943 ms on localhost (executor driver) (231/882) 2020-02-15 21:24:55 Executor: INFO: Running task 231.0 in stage 2.0 (TID 1114) 2020-02-15 21:24:55 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 21:24:55 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 21:24:55 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7751073792+33554432 2020-02-15 21:24:55 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:29:25 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000231_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000231 2020-02-15 21:29:25 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000231_0: Committed 2020-02-15 21:29:25 Executor: INFO: Finished task 231.0 in stage 2.0 (TID 1114). 959 bytes result sent to driver 2020-02-15 21:29:25 TaskSetManager: INFO: Starting task 232.0 in stage 2.0 (TID 1115, localhost, executor driver, partition 232, PROCESS_LOCAL, 9166 bytes) 2020-02-15 21:29:25 TaskSetManager: INFO: Finished task 231.0 in stage 2.0 (TID 1114) in 269519 ms on localhost (executor driver) (232/882) 2020-02-15 21:29:25 Executor: INFO: Running task 232.0 in stage 2.0 (TID 1115) 2020-02-15 21:29:25 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 21:29:25 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 21:29:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7784628224+33554432 2020-02-15 21:29:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:33:43 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000232_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000232 2020-02-15 21:33:43 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000232_0: Committed 2020-02-15 21:33:43 Executor: INFO: Finished task 232.0 in stage 2.0 (TID 1115). 959 bytes result sent to driver 2020-02-15 21:33:43 TaskSetManager: INFO: Starting task 233.0 in stage 2.0 (TID 1116, localhost, executor driver, partition 233, PROCESS_LOCAL, 9166 bytes) 2020-02-15 21:33:43 TaskSetManager: INFO: Finished task 232.0 in stage 2.0 (TID 1115) in 258677 ms on localhost (executor driver) (233/882) 2020-02-15 21:33:43 Executor: INFO: Running task 233.0 in stage 2.0 (TID 1116) 2020-02-15 21:33:43 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 21:33:43 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 21:33:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7818182656+33554432 2020-02-15 21:33:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:38:08 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000233_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000233 2020-02-15 21:38:08 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000233_0: Committed 2020-02-15 21:38:08 Executor: INFO: Finished task 233.0 in stage 2.0 (TID 1116). 959 bytes result sent to driver 2020-02-15 21:38:08 TaskSetManager: INFO: Starting task 234.0 in stage 2.0 (TID 1117, localhost, executor driver, partition 234, PROCESS_LOCAL, 9321 bytes) 2020-02-15 21:38:08 TaskSetManager: INFO: Finished task 233.0 in stage 2.0 (TID 1116) in 264452 ms on localhost (executor driver) (234/882) 2020-02-15 21:38:08 Executor: INFO: Running task 234.0 in stage 2.0 (TID 1117) 2020-02-15 21:38:08 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 21:38:08 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 21:38:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7851737088+33554432 2020-02-15 21:38:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:42:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7885291520+33554432 2020-02-15 21:42:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:46:17 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000234_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000234 2020-02-15 21:46:17 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000234_0: Committed 2020-02-15 21:46:17 Executor: INFO: Finished task 234.0 in stage 2.0 (TID 1117). 959 bytes result sent to driver 2020-02-15 21:46:17 TaskSetManager: INFO: Starting task 235.0 in stage 2.0 (TID 1118, localhost, executor driver, partition 235, PROCESS_LOCAL, 8749 bytes) 2020-02-15 21:46:17 TaskSetManager: INFO: Finished task 234.0 in stage 2.0 (TID 1117) in 488729 ms on localhost (executor driver) (235/882) 2020-02-15 21:46:17 Executor: INFO: Running task 235.0 in stage 2.0 (TID 1118) 2020-02-15 21:46:17 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 21:46:17 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 21:46:17 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7885291520+33554432 2020-02-15 21:46:17 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:49:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7918845952+33554432 2020-02-15 21:49:46 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:52:42 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000235_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000235 2020-02-15 21:52:42 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000235_0: Committed 2020-02-15 21:52:42 Executor: INFO: Finished task 235.0 in stage 2.0 (TID 1118). 959 bytes result sent to driver 2020-02-15 21:52:42 TaskSetManager: INFO: Starting task 236.0 in stage 2.0 (TID 1119, localhost, executor driver, partition 236, PROCESS_LOCAL, 8749 bytes) 2020-02-15 21:52:42 TaskSetManager: INFO: Finished task 235.0 in stage 2.0 (TID 1118) in 385329 ms on localhost (executor driver) (236/882) 2020-02-15 21:52:42 Executor: INFO: Running task 236.0 in stage 2.0 (TID 1119) 2020-02-15 21:52:42 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 21:52:42 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 21:52:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7918845952+33554432 2020-02-15 21:52:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 21:55:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7952400384+33554432 2020-02-15 21:55:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:00:00 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000236_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000236 2020-02-15 22:00:00 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000236_0: Committed 2020-02-15 22:00:00 Executor: INFO: Finished task 236.0 in stage 2.0 (TID 1119). 1002 bytes result sent to driver 2020-02-15 22:00:00 TaskSetManager: INFO: Starting task 237.0 in stage 2.0 (TID 1120, localhost, executor driver, partition 237, PROCESS_LOCAL, 8749 bytes) 2020-02-15 22:00:00 TaskSetManager: INFO: Finished task 236.0 in stage 2.0 (TID 1119) in 438207 ms on localhost (executor driver) (237/882) 2020-02-15 22:00:00 Executor: INFO: Running task 237.0 in stage 2.0 (TID 1120) 2020-02-15 22:00:00 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 22:00:00 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 22:00:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7952400384+33554432 2020-02-15 22:00:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:04:26 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7985954816+33554432 2020-02-15 22:04:26 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:09:02 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000237_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000237 2020-02-15 22:09:02 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000237_0: Committed 2020-02-15 22:09:02 Executor: INFO: Finished task 237.0 in stage 2.0 (TID 1120). 959 bytes result sent to driver 2020-02-15 22:09:02 TaskSetManager: INFO: Starting task 238.0 in stage 2.0 (TID 1121, localhost, executor driver, partition 238, PROCESS_LOCAL, 9136 bytes) 2020-02-15 22:09:02 TaskSetManager: INFO: Finished task 237.0 in stage 2.0 (TID 1120) in 542138 ms on localhost (executor driver) (238/882) 2020-02-15 22:09:02 Executor: INFO: Running task 238.0 in stage 2.0 (TID 1121) 2020-02-15 22:09:02 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 22:09:02 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 22:09:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:7985954816+33554432 2020-02-15 22:09:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:13:48 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000238_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000238 2020-02-15 22:13:48 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000238_0: Committed 2020-02-15 22:13:48 Executor: INFO: Finished task 238.0 in stage 2.0 (TID 1121). 959 bytes result sent to driver 2020-02-15 22:13:48 TaskSetManager: INFO: Starting task 239.0 in stage 2.0 (TID 1122, localhost, executor driver, partition 239, PROCESS_LOCAL, 9166 bytes) 2020-02-15 22:13:48 TaskSetManager: INFO: Finished task 238.0 in stage 2.0 (TID 1121) in 286254 ms on localhost (executor driver) (239/882) 2020-02-15 22:13:48 Executor: INFO: Running task 239.0 in stage 2.0 (TID 1122) 2020-02-15 22:13:49 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 22:13:49 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 22:13:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8019509248+33554432 2020-02-15 22:13:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:19:10 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000239_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000239 2020-02-15 22:19:10 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000239_0: Committed 2020-02-15 22:19:10 Executor: INFO: Finished task 239.0 in stage 2.0 (TID 1122). 959 bytes result sent to driver 2020-02-15 22:19:10 TaskSetManager: INFO: Starting task 240.0 in stage 2.0 (TID 1123, localhost, executor driver, partition 240, PROCESS_LOCAL, 9166 bytes) 2020-02-15 22:19:10 TaskSetManager: INFO: Finished task 239.0 in stage 2.0 (TID 1122) in 321397 ms on localhost (executor driver) (240/882) 2020-02-15 22:19:10 Executor: INFO: Running task 240.0 in stage 2.0 (TID 1123) 2020-02-15 22:19:10 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 22:19:10 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 22:19:10 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8053063680+33554432 2020-02-15 22:19:10 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:23:31 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000240_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000240 2020-02-15 22:23:31 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000240_0: Committed 2020-02-15 22:23:31 Executor: INFO: Finished task 240.0 in stage 2.0 (TID 1123). 959 bytes result sent to driver 2020-02-15 22:23:31 TaskSetManager: INFO: Starting task 241.0 in stage 2.0 (TID 1124, localhost, executor driver, partition 241, PROCESS_LOCAL, 9166 bytes) 2020-02-15 22:23:31 TaskSetManager: INFO: Finished task 240.0 in stage 2.0 (TID 1123) in 260967 ms on localhost (executor driver) (241/882) 2020-02-15 22:23:31 Executor: INFO: Running task 241.0 in stage 2.0 (TID 1124) 2020-02-15 22:23:31 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 22:23:31 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 22:23:31 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8086618112+33554432 2020-02-15 22:23:31 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:28:45 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000241_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000241 2020-02-15 22:28:45 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000241_0: Committed 2020-02-15 22:28:45 Executor: INFO: Finished task 241.0 in stage 2.0 (TID 1124). 959 bytes result sent to driver 2020-02-15 22:28:45 TaskSetManager: INFO: Starting task 242.0 in stage 2.0 (TID 1125, localhost, executor driver, partition 242, PROCESS_LOCAL, 9166 bytes) 2020-02-15 22:28:45 TaskSetManager: INFO: Finished task 241.0 in stage 2.0 (TID 1124) in 314223 ms on localhost (executor driver) (242/882) 2020-02-15 22:28:45 Executor: INFO: Running task 242.0 in stage 2.0 (TID 1125) 2020-02-15 22:28:45 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 22:28:45 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 22:28:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8120172544+33554432 2020-02-15 22:28:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:33:43 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000242_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000242 2020-02-15 22:33:43 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000242_0: Committed 2020-02-15 22:33:43 Executor: INFO: Finished task 242.0 in stage 2.0 (TID 1125). 959 bytes result sent to driver 2020-02-15 22:33:43 TaskSetManager: INFO: Starting task 243.0 in stage 2.0 (TID 1126, localhost, executor driver, partition 243, PROCESS_LOCAL, 9166 bytes) 2020-02-15 22:33:43 TaskSetManager: INFO: Finished task 242.0 in stage 2.0 (TID 1125) in 297560 ms on localhost (executor driver) (243/882) 2020-02-15 22:33:43 Executor: INFO: Running task 243.0 in stage 2.0 (TID 1126) 2020-02-15 22:33:43 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 22:33:43 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 22:33:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8153726976+33554432 2020-02-15 22:33:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:38:00 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000243_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000243 2020-02-15 22:38:00 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000243_0: Committed 2020-02-15 22:38:00 Executor: INFO: Finished task 243.0 in stage 2.0 (TID 1126). 959 bytes result sent to driver 2020-02-15 22:38:00 TaskSetManager: INFO: Starting task 244.0 in stage 2.0 (TID 1127, localhost, executor driver, partition 244, PROCESS_LOCAL, 9166 bytes) 2020-02-15 22:38:00 TaskSetManager: INFO: Finished task 243.0 in stage 2.0 (TID 1126) in 257617 ms on localhost (executor driver) (244/882) 2020-02-15 22:38:00 Executor: INFO: Running task 244.0 in stage 2.0 (TID 1127) 2020-02-15 22:38:00 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 22:38:00 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 22:38:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8187281408+33554432 2020-02-15 22:38:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:43:20 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000244_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000244 2020-02-15 22:43:20 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000244_0: Committed 2020-02-15 22:43:20 Executor: INFO: Finished task 244.0 in stage 2.0 (TID 1127). 959 bytes result sent to driver 2020-02-15 22:43:20 TaskSetManager: INFO: Starting task 245.0 in stage 2.0 (TID 1128, localhost, executor driver, partition 245, PROCESS_LOCAL, 9321 bytes) 2020-02-15 22:43:20 TaskSetManager: INFO: Finished task 244.0 in stage 2.0 (TID 1127) in 320218 ms on localhost (executor driver) (245/882) 2020-02-15 22:43:20 Executor: INFO: Running task 245.0 in stage 2.0 (TID 1128) 2020-02-15 22:43:20 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 22:43:20 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 22:43:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8220835840+33554432 2020-02-15 22:43:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:48:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8254390272+33554432 2020-02-15 22:48:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:52:43 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000245_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000245 2020-02-15 22:52:43 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000245_0: Committed 2020-02-15 22:52:43 Executor: INFO: Finished task 245.0 in stage 2.0 (TID 1128). 959 bytes result sent to driver 2020-02-15 22:52:43 TaskSetManager: INFO: Starting task 246.0 in stage 2.0 (TID 1129, localhost, executor driver, partition 246, PROCESS_LOCAL, 9136 bytes) 2020-02-15 22:52:43 TaskSetManager: INFO: Finished task 245.0 in stage 2.0 (TID 1128) in 562479 ms on localhost (executor driver) (246/882) 2020-02-15 22:52:43 Executor: INFO: Running task 246.0 in stage 2.0 (TID 1129) 2020-02-15 22:52:43 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 22:52:43 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 22:52:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8254390272+33554432 2020-02-15 22:52:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 22:57:16 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000246_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000246 2020-02-15 22:57:16 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000246_0: Committed 2020-02-15 22:57:16 Executor: INFO: Finished task 246.0 in stage 2.0 (TID 1129). 959 bytes result sent to driver 2020-02-15 22:57:16 TaskSetManager: INFO: Starting task 247.0 in stage 2.0 (TID 1130, localhost, executor driver, partition 247, PROCESS_LOCAL, 9166 bytes) 2020-02-15 22:57:16 TaskSetManager: INFO: Finished task 246.0 in stage 2.0 (TID 1129) in 273226 ms on localhost (executor driver) (247/882) 2020-02-15 22:57:16 Executor: INFO: Running task 247.0 in stage 2.0 (TID 1130) 2020-02-15 22:57:16 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 22:57:16 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 22:57:16 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8287944704+33554432 2020-02-15 22:57:16 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 23:01:58 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000247_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000247 2020-02-15 23:01:58 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000247_0: Committed 2020-02-15 23:01:58 Executor: INFO: Finished task 247.0 in stage 2.0 (TID 1130). 959 bytes result sent to driver 2020-02-15 23:01:58 TaskSetManager: INFO: Starting task 248.0 in stage 2.0 (TID 1131, localhost, executor driver, partition 248, PROCESS_LOCAL, 9166 bytes) 2020-02-15 23:01:58 TaskSetManager: INFO: Finished task 247.0 in stage 2.0 (TID 1130) in 282132 ms on localhost (executor driver) (248/882) 2020-02-15 23:01:58 Executor: INFO: Running task 248.0 in stage 2.0 (TID 1131) 2020-02-15 23:01:58 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 23:01:58 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 23:01:58 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8321499136+33554432 2020-02-15 23:01:58 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 23:07:05 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000248_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000248 2020-02-15 23:07:05 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000248_0: Committed 2020-02-15 23:07:05 Executor: INFO: Finished task 248.0 in stage 2.0 (TID 1131). 959 bytes result sent to driver 2020-02-15 23:07:05 TaskSetManager: INFO: Starting task 249.0 in stage 2.0 (TID 1132, localhost, executor driver, partition 249, PROCESS_LOCAL, 9321 bytes) 2020-02-15 23:07:05 TaskSetManager: INFO: Finished task 248.0 in stage 2.0 (TID 1131) in 307052 ms on localhost (executor driver) (249/882) 2020-02-15 23:07:05 Executor: INFO: Running task 249.0 in stage 2.0 (TID 1132) 2020-02-15 23:07:05 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 23:07:05 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 23:07:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8355053568+33554432 2020-02-15 23:07:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 23:12:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8388608000+33554432 2020-02-15 23:12:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 23:16:43 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000249_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000249 2020-02-15 23:16:43 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000249_0: Committed 2020-02-15 23:16:43 Executor: INFO: Finished task 249.0 in stage 2.0 (TID 1132). 959 bytes result sent to driver 2020-02-15 23:16:43 TaskSetManager: INFO: Starting task 250.0 in stage 2.0 (TID 1133, localhost, executor driver, partition 250, PROCESS_LOCAL, 9136 bytes) 2020-02-15 23:16:43 TaskSetManager: INFO: Finished task 249.0 in stage 2.0 (TID 1132) in 577544 ms on localhost (executor driver) (250/882) 2020-02-15 23:16:43 Executor: INFO: Running task 250.0 in stage 2.0 (TID 1133) 2020-02-15 23:16:43 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 23:16:43 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 23:16:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8388608000+33554432 2020-02-15 23:16:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 23:21:23 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000250_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000250 2020-02-15 23:21:23 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000250_0: Committed 2020-02-15 23:21:23 Executor: INFO: Finished task 250.0 in stage 2.0 (TID 1133). 959 bytes result sent to driver 2020-02-15 23:21:23 TaskSetManager: INFO: Starting task 251.0 in stage 2.0 (TID 1134, localhost, executor driver, partition 251, PROCESS_LOCAL, 9166 bytes) 2020-02-15 23:21:23 TaskSetManager: INFO: Finished task 250.0 in stage 2.0 (TID 1133) in 280154 ms on localhost (executor driver) (251/882) 2020-02-15 23:21:23 Executor: INFO: Running task 251.0 in stage 2.0 (TID 1134) 2020-02-15 23:21:23 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 23:21:23 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 23:21:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8422162432+33554432 2020-02-15 23:21:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 23:26:42 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000251_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000251 2020-02-15 23:26:42 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000251_0: Committed 2020-02-15 23:26:42 Executor: INFO: Finished task 251.0 in stage 2.0 (TID 1134). 959 bytes result sent to driver 2020-02-15 23:26:42 TaskSetManager: INFO: Starting task 252.0 in stage 2.0 (TID 1135, localhost, executor driver, partition 252, PROCESS_LOCAL, 9166 bytes) 2020-02-15 23:26:42 TaskSetManager: INFO: Finished task 251.0 in stage 2.0 (TID 1134) in 318548 ms on localhost (executor driver) (252/882) 2020-02-15 23:26:42 Executor: INFO: Running task 252.0 in stage 2.0 (TID 1135) 2020-02-15 23:26:42 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 23:26:42 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 23:26:42 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8455716864+33554432 2020-02-15 23:26:42 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 23:31:53 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000252_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000252 2020-02-15 23:31:53 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000252_0: Committed 2020-02-15 23:31:53 Executor: INFO: Finished task 252.0 in stage 2.0 (TID 1135). 959 bytes result sent to driver 2020-02-15 23:31:53 TaskSetManager: INFO: Starting task 253.0 in stage 2.0 (TID 1136, localhost, executor driver, partition 253, PROCESS_LOCAL, 9166 bytes) 2020-02-15 23:31:53 TaskSetManager: INFO: Finished task 252.0 in stage 2.0 (TID 1135) in 311346 ms on localhost (executor driver) (253/882) 2020-02-15 23:31:53 Executor: INFO: Running task 253.0 in stage 2.0 (TID 1136) 2020-02-15 23:31:53 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 23:31:53 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 23:31:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8489271296+33554432 2020-02-15 23:31:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 23:36:43 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000253_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000253 2020-02-15 23:36:43 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000253_0: Committed 2020-02-15 23:36:43 Executor: INFO: Finished task 253.0 in stage 2.0 (TID 1136). 959 bytes result sent to driver 2020-02-15 23:36:43 TaskSetManager: INFO: Starting task 254.0 in stage 2.0 (TID 1137, localhost, executor driver, partition 254, PROCESS_LOCAL, 9166 bytes) 2020-02-15 23:36:43 TaskSetManager: INFO: Finished task 253.0 in stage 2.0 (TID 1136) in 289708 ms on localhost (executor driver) (254/882) 2020-02-15 23:36:43 Executor: INFO: Running task 254.0 in stage 2.0 (TID 1137) 2020-02-15 23:36:43 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 23:36:43 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 23:36:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8522825728+33554432 2020-02-15 23:36:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 23:42:00 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000254_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000254 2020-02-15 23:42:00 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000254_0: Committed 2020-02-15 23:42:00 Executor: INFO: Finished task 254.0 in stage 2.0 (TID 1137). 959 bytes result sent to driver 2020-02-15 23:42:00 TaskSetManager: INFO: Starting task 255.0 in stage 2.0 (TID 1138, localhost, executor driver, partition 255, PROCESS_LOCAL, 9166 bytes) 2020-02-15 23:42:00 TaskSetManager: INFO: Finished task 254.0 in stage 2.0 (TID 1137) in 317373 ms on localhost (executor driver) (255/882) 2020-02-15 23:42:00 Executor: INFO: Running task 255.0 in stage 2.0 (TID 1138) 2020-02-15 23:42:00 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 23:42:00 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 23:42:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8556380160+33554432 2020-02-15 23:42:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 23:47:00 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000255_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000255 2020-02-15 23:47:00 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000255_0: Committed 2020-02-15 23:47:00 Executor: INFO: Finished task 255.0 in stage 2.0 (TID 1138). 959 bytes result sent to driver 2020-02-15 23:47:00 TaskSetManager: INFO: Starting task 256.0 in stage 2.0 (TID 1139, localhost, executor driver, partition 256, PROCESS_LOCAL, 9321 bytes) 2020-02-15 23:47:00 TaskSetManager: INFO: Finished task 255.0 in stage 2.0 (TID 1138) in 299836 ms on localhost (executor driver) (256/882) 2020-02-15 23:47:00 Executor: INFO: Running task 256.0 in stage 2.0 (TID 1139) 2020-02-15 23:47:00 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 23:47:00 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 23:47:00 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8589934592+33554432 2020-02-15 23:47:00 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 23:51:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8623489024+33554432 2020-02-15 23:51:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-15 23:55:59 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000256_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000256 2020-02-15 23:55:59 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000256_0: Committed 2020-02-15 23:55:59 Executor: INFO: Finished task 256.0 in stage 2.0 (TID 1139). 959 bytes result sent to driver 2020-02-15 23:55:59 TaskSetManager: INFO: Starting task 257.0 in stage 2.0 (TID 1140, localhost, executor driver, partition 257, PROCESS_LOCAL, 9136 bytes) 2020-02-15 23:55:59 TaskSetManager: INFO: Finished task 256.0 in stage 2.0 (TID 1139) in 538666 ms on localhost (executor driver) (257/882) 2020-02-15 23:55:59 Executor: INFO: Running task 257.0 in stage 2.0 (TID 1140) 2020-02-15 23:55:59 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-15 23:55:59 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-15 23:55:59 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8623489024+33554432 2020-02-15 23:55:59 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:00:05 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000257_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000257 2020-02-16 00:00:05 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000257_0: Committed 2020-02-16 00:00:05 Executor: INFO: Finished task 257.0 in stage 2.0 (TID 1140). 959 bytes result sent to driver 2020-02-16 00:00:05 TaskSetManager: INFO: Starting task 258.0 in stage 2.0 (TID 1141, localhost, executor driver, partition 258, PROCESS_LOCAL, 9321 bytes) 2020-02-16 00:00:05 TaskSetManager: INFO: Finished task 257.0 in stage 2.0 (TID 1140) in 246380 ms on localhost (executor driver) (258/882) 2020-02-16 00:00:05 Executor: INFO: Running task 258.0 in stage 2.0 (TID 1141) 2020-02-16 00:00:05 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 00:00:05 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 00:00:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8657043456+33554432 2020-02-16 00:00:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:04:37 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8690597888+33554432 2020-02-16 00:04:37 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:08:09 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000258_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000258 2020-02-16 00:08:09 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000258_0: Committed 2020-02-16 00:08:09 Executor: INFO: Finished task 258.0 in stage 2.0 (TID 1141). 959 bytes result sent to driver 2020-02-16 00:08:09 TaskSetManager: INFO: Starting task 259.0 in stage 2.0 (TID 1142, localhost, executor driver, partition 259, PROCESS_LOCAL, 9136 bytes) 2020-02-16 00:08:09 TaskSetManager: INFO: Finished task 258.0 in stage 2.0 (TID 1141) in 483773 ms on localhost (executor driver) (259/882) 2020-02-16 00:08:09 Executor: INFO: Running task 259.0 in stage 2.0 (TID 1142) 2020-02-16 00:08:09 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 00:08:09 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 00:08:09 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8690597888+33554432 2020-02-16 00:08:09 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:11:49 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000259_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000259 2020-02-16 00:11:49 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000259_0: Committed 2020-02-16 00:11:49 Executor: INFO: Finished task 259.0 in stage 2.0 (TID 1142). 959 bytes result sent to driver 2020-02-16 00:11:49 TaskSetManager: INFO: Starting task 260.0 in stage 2.0 (TID 1143, localhost, executor driver, partition 260, PROCESS_LOCAL, 9166 bytes) 2020-02-16 00:11:49 TaskSetManager: INFO: Finished task 259.0 in stage 2.0 (TID 1142) in 220022 ms on localhost (executor driver) (260/882) 2020-02-16 00:11:49 Executor: INFO: Running task 260.0 in stage 2.0 (TID 1143) 2020-02-16 00:11:49 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 00:11:49 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 00:11:49 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8724152320+33554432 2020-02-16 00:11:49 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:15:11 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000260_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000260 2020-02-16 00:15:11 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000260_0: Committed 2020-02-16 00:15:11 Executor: INFO: Finished task 260.0 in stage 2.0 (TID 1143). 959 bytes result sent to driver 2020-02-16 00:15:11 TaskSetManager: INFO: Starting task 261.0 in stage 2.0 (TID 1144, localhost, executor driver, partition 261, PROCESS_LOCAL, 9166 bytes) 2020-02-16 00:15:11 TaskSetManager: INFO: Finished task 260.0 in stage 2.0 (TID 1143) in 201956 ms on localhost (executor driver) (261/882) 2020-02-16 00:15:11 Executor: INFO: Running task 261.0 in stage 2.0 (TID 1144) 2020-02-16 00:15:11 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 00:15:11 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 00:15:11 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8757706752+33554432 2020-02-16 00:15:11 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:18:39 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000261_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000261 2020-02-16 00:18:39 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000261_0: Committed 2020-02-16 00:18:39 Executor: INFO: Finished task 261.0 in stage 2.0 (TID 1144). 959 bytes result sent to driver 2020-02-16 00:18:39 TaskSetManager: INFO: Starting task 262.0 in stage 2.0 (TID 1145, localhost, executor driver, partition 262, PROCESS_LOCAL, 9166 bytes) 2020-02-16 00:18:39 TaskSetManager: INFO: Finished task 261.0 in stage 2.0 (TID 1144) in 208444 ms on localhost (executor driver) (262/882) 2020-02-16 00:18:39 Executor: INFO: Running task 262.0 in stage 2.0 (TID 1145) 2020-02-16 00:18:39 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 00:18:39 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 00:18:39 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8791261184+33554432 2020-02-16 00:18:39 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:21:19 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000262_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000262 2020-02-16 00:21:19 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000262_0: Committed 2020-02-16 00:21:19 Executor: INFO: Finished task 262.0 in stage 2.0 (TID 1145). 959 bytes result sent to driver 2020-02-16 00:21:19 TaskSetManager: INFO: Starting task 263.0 in stage 2.0 (TID 1146, localhost, executor driver, partition 263, PROCESS_LOCAL, 9166 bytes) 2020-02-16 00:21:19 TaskSetManager: INFO: Finished task 262.0 in stage 2.0 (TID 1145) in 159400 ms on localhost (executor driver) (263/882) 2020-02-16 00:21:19 Executor: INFO: Running task 263.0 in stage 2.0 (TID 1146) 2020-02-16 00:21:19 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 00:21:19 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 00:21:19 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8824815616+33554432 2020-02-16 00:21:19 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:25:43 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000263_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000263 2020-02-16 00:25:43 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000263_0: Committed 2020-02-16 00:25:43 Executor: INFO: Finished task 263.0 in stage 2.0 (TID 1146). 959 bytes result sent to driver 2020-02-16 00:25:43 TaskSetManager: INFO: Starting task 264.0 in stage 2.0 (TID 1147, localhost, executor driver, partition 264, PROCESS_LOCAL, 9166 bytes) 2020-02-16 00:25:43 TaskSetManager: INFO: Finished task 263.0 in stage 2.0 (TID 1146) in 264364 ms on localhost (executor driver) (264/882) 2020-02-16 00:25:43 Executor: INFO: Running task 264.0 in stage 2.0 (TID 1147) 2020-02-16 00:25:43 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 00:25:43 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 00:25:43 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8858370048+33554432 2020-02-16 00:25:43 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:29:41 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000264_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000264 2020-02-16 00:29:41 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000264_0: Committed 2020-02-16 00:29:41 Executor: INFO: Finished task 264.0 in stage 2.0 (TID 1147). 959 bytes result sent to driver 2020-02-16 00:29:41 TaskSetManager: INFO: Starting task 265.0 in stage 2.0 (TID 1148, localhost, executor driver, partition 265, PROCESS_LOCAL, 9321 bytes) 2020-02-16 00:29:41 TaskSetManager: INFO: Finished task 264.0 in stage 2.0 (TID 1147) in 238417 ms on localhost (executor driver) (265/882) 2020-02-16 00:29:41 Executor: INFO: Running task 265.0 in stage 2.0 (TID 1148) 2020-02-16 00:29:41 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 00:29:41 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 00:29:41 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8891924480+33554432 2020-02-16 00:29:41 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:33:45 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8925478912+33554432 2020-02-16 00:33:45 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:38:08 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000265_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000265 2020-02-16 00:38:08 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000265_0: Committed 2020-02-16 00:38:08 Executor: INFO: Finished task 265.0 in stage 2.0 (TID 1148). 959 bytes result sent to driver 2020-02-16 00:38:08 TaskSetManager: INFO: Starting task 266.0 in stage 2.0 (TID 1149, localhost, executor driver, partition 266, PROCESS_LOCAL, 9136 bytes) 2020-02-16 00:38:08 TaskSetManager: INFO: Finished task 265.0 in stage 2.0 (TID 1148) in 506552 ms on localhost (executor driver) (266/882) 2020-02-16 00:38:08 Executor: INFO: Running task 266.0 in stage 2.0 (TID 1149) 2020-02-16 00:38:08 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 00:38:08 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 00:38:08 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8925478912+33554432 2020-02-16 00:38:08 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:42:40 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000266_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000266 2020-02-16 00:42:40 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000266_0: Committed 2020-02-16 00:42:40 Executor: INFO: Finished task 266.0 in stage 2.0 (TID 1149). 959 bytes result sent to driver 2020-02-16 00:42:40 TaskSetManager: INFO: Starting task 267.0 in stage 2.0 (TID 1150, localhost, executor driver, partition 267, PROCESS_LOCAL, 9166 bytes) 2020-02-16 00:42:40 TaskSetManager: INFO: Finished task 266.0 in stage 2.0 (TID 1149) in 272335 ms on localhost (executor driver) (267/882) 2020-02-16 00:42:40 Executor: INFO: Running task 267.0 in stage 2.0 (TID 1150) 2020-02-16 00:42:40 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 00:42:40 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 00:42:40 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8959033344+33554432 2020-02-16 00:42:40 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:46:29 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000267_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000267 2020-02-16 00:46:29 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000267_0: Committed 2020-02-16 00:46:29 Executor: INFO: Finished task 267.0 in stage 2.0 (TID 1150). 959 bytes result sent to driver 2020-02-16 00:46:29 TaskSetManager: INFO: Starting task 268.0 in stage 2.0 (TID 1151, localhost, executor driver, partition 268, PROCESS_LOCAL, 9166 bytes) 2020-02-16 00:46:29 TaskSetManager: INFO: Finished task 267.0 in stage 2.0 (TID 1150) in 228593 ms on localhost (executor driver) (268/882) 2020-02-16 00:46:29 Executor: INFO: Running task 268.0 in stage 2.0 (TID 1151) 2020-02-16 00:46:29 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 00:46:29 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 00:46:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:8992587776+33554432 2020-02-16 00:46:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:51:05 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000268_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000268 2020-02-16 00:51:05 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000268_0: Committed 2020-02-16 00:51:05 Executor: INFO: Finished task 268.0 in stage 2.0 (TID 1151). 959 bytes result sent to driver 2020-02-16 00:51:05 TaskSetManager: INFO: Starting task 269.0 in stage 2.0 (TID 1152, localhost, executor driver, partition 269, PROCESS_LOCAL, 9321 bytes) 2020-02-16 00:51:05 TaskSetManager: INFO: Finished task 268.0 in stage 2.0 (TID 1151) in 276522 ms on localhost (executor driver) (269/882) 2020-02-16 00:51:05 Executor: INFO: Running task 269.0 in stage 2.0 (TID 1152) 2020-02-16 00:51:05 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 00:51:05 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 00:51:05 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9026142208+33554432 2020-02-16 00:51:05 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 00:55:57 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9059696640+33554432 2020-02-16 00:55:57 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:00:05 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000269_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000269 2020-02-16 01:00:05 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000269_0: Committed 2020-02-16 01:00:05 Executor: INFO: Finished task 269.0 in stage 2.0 (TID 1152). 959 bytes result sent to driver 2020-02-16 01:00:05 TaskSetManager: INFO: Starting task 270.0 in stage 2.0 (TID 1153, localhost, executor driver, partition 270, PROCESS_LOCAL, 9136 bytes) 2020-02-16 01:00:05 TaskSetManager: INFO: Finished task 269.0 in stage 2.0 (TID 1152) in 540205 ms on localhost (executor driver) (270/882) 2020-02-16 01:00:05 Executor: INFO: Running task 270.0 in stage 2.0 (TID 1153) 2020-02-16 01:00:06 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 01:00:06 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 01:00:06 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9059696640+33554432 2020-02-16 01:00:06 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:04:23 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000270_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000270 2020-02-16 01:04:23 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000270_0: Committed 2020-02-16 01:04:23 Executor: INFO: Finished task 270.0 in stage 2.0 (TID 1153). 959 bytes result sent to driver 2020-02-16 01:04:23 TaskSetManager: INFO: Starting task 271.0 in stage 2.0 (TID 1154, localhost, executor driver, partition 271, PROCESS_LOCAL, 9166 bytes) 2020-02-16 01:04:23 TaskSetManager: INFO: Finished task 270.0 in stage 2.0 (TID 1153) in 257133 ms on localhost (executor driver) (271/882) 2020-02-16 01:04:23 Executor: INFO: Running task 271.0 in stage 2.0 (TID 1154) 2020-02-16 01:04:23 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 01:04:23 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 01:04:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9093251072+33554432 2020-02-16 01:04:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:08:53 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000271_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000271 2020-02-16 01:08:53 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000271_0: Committed 2020-02-16 01:08:53 Executor: INFO: Finished task 271.0 in stage 2.0 (TID 1154). 959 bytes result sent to driver 2020-02-16 01:08:53 TaskSetManager: INFO: Starting task 272.0 in stage 2.0 (TID 1155, localhost, executor driver, partition 272, PROCESS_LOCAL, 9166 bytes) 2020-02-16 01:08:53 TaskSetManager: INFO: Finished task 271.0 in stage 2.0 (TID 1154) in 270603 ms on localhost (executor driver) (272/882) 2020-02-16 01:08:53 Executor: INFO: Running task 272.0 in stage 2.0 (TID 1155) 2020-02-16 01:08:53 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 01:08:53 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 01:08:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9126805504+33554432 2020-02-16 01:08:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:13:12 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000272_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000272 2020-02-16 01:13:12 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000272_0: Committed 2020-02-16 01:13:12 Executor: INFO: Finished task 272.0 in stage 2.0 (TID 1155). 959 bytes result sent to driver 2020-02-16 01:13:12 TaskSetManager: INFO: Starting task 273.0 in stage 2.0 (TID 1156, localhost, executor driver, partition 273, PROCESS_LOCAL, 9167 bytes) 2020-02-16 01:13:12 TaskSetManager: INFO: Finished task 272.0 in stage 2.0 (TID 1155) in 258953 ms on localhost (executor driver) (273/882) 2020-02-16 01:13:12 Executor: INFO: Running task 273.0 in stage 2.0 (TID 1156) 2020-02-16 01:13:12 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 01:13:12 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 01:13:12 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9160359936+33554432 2020-02-16 01:13:12 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:17:07 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000273_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000273 2020-02-16 01:17:07 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000273_0: Committed 2020-02-16 01:17:07 Executor: INFO: Finished task 273.0 in stage 2.0 (TID 1156). 959 bytes result sent to driver 2020-02-16 01:17:07 TaskSetManager: INFO: Starting task 274.0 in stage 2.0 (TID 1157, localhost, executor driver, partition 274, PROCESS_LOCAL, 9166 bytes) 2020-02-16 01:17:07 TaskSetManager: INFO: Finished task 273.0 in stage 2.0 (TID 1156) in 234952 ms on localhost (executor driver) (274/882) 2020-02-16 01:17:07 Executor: INFO: Running task 274.0 in stage 2.0 (TID 1157) 2020-02-16 01:17:07 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 01:17:07 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 01:17:07 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9193914368+33554432 2020-02-16 01:17:07 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:21:32 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000274_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000274 2020-02-16 01:21:32 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000274_0: Committed 2020-02-16 01:21:32 Executor: INFO: Finished task 274.0 in stage 2.0 (TID 1157). 959 bytes result sent to driver 2020-02-16 01:21:32 TaskSetManager: INFO: Starting task 275.0 in stage 2.0 (TID 1158, localhost, executor driver, partition 275, PROCESS_LOCAL, 9166 bytes) 2020-02-16 01:21:32 TaskSetManager: INFO: Finished task 274.0 in stage 2.0 (TID 1157) in 265224 ms on localhost (executor driver) (275/882) 2020-02-16 01:21:32 Executor: INFO: Running task 275.0 in stage 2.0 (TID 1158) 2020-02-16 01:21:32 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 01:21:32 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 01:21:32 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9227468800+33554432 2020-02-16 01:21:32 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:26:23 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000275_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000275 2020-02-16 01:26:23 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000275_0: Committed 2020-02-16 01:26:23 Executor: INFO: Finished task 275.0 in stage 2.0 (TID 1158). 959 bytes result sent to driver 2020-02-16 01:26:23 TaskSetManager: INFO: Starting task 276.0 in stage 2.0 (TID 1159, localhost, executor driver, partition 276, PROCESS_LOCAL, 9166 bytes) 2020-02-16 01:26:23 TaskSetManager: INFO: Finished task 275.0 in stage 2.0 (TID 1158) in 290388 ms on localhost (executor driver) (276/882) 2020-02-16 01:26:23 Executor: INFO: Running task 276.0 in stage 2.0 (TID 1159) 2020-02-16 01:26:23 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 01:26:23 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 01:26:23 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9261023232+33554432 2020-02-16 01:26:23 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:31:13 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000276_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000276 2020-02-16 01:31:13 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000276_0: Committed 2020-02-16 01:31:13 Executor: INFO: Finished task 276.0 in stage 2.0 (TID 1159). 959 bytes result sent to driver 2020-02-16 01:31:13 TaskSetManager: INFO: Starting task 277.0 in stage 2.0 (TID 1160, localhost, executor driver, partition 277, PROCESS_LOCAL, 9321 bytes) 2020-02-16 01:31:13 TaskSetManager: INFO: Finished task 276.0 in stage 2.0 (TID 1159) in 290595 ms on localhost (executor driver) (277/882) 2020-02-16 01:31:13 Executor: INFO: Running task 277.0 in stage 2.0 (TID 1160) 2020-02-16 01:31:13 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 01:31:13 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 01:31:13 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9294577664+33554432 2020-02-16 01:31:13 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:36:29 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9328132096+33554432 2020-02-16 01:36:29 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:40:53 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000277_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000277 2020-02-16 01:40:53 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000277_0: Committed 2020-02-16 01:40:53 Executor: INFO: Finished task 277.0 in stage 2.0 (TID 1160). 959 bytes result sent to driver 2020-02-16 01:40:53 TaskSetManager: INFO: Starting task 278.0 in stage 2.0 (TID 1161, localhost, executor driver, partition 278, PROCESS_LOCAL, 8749 bytes) 2020-02-16 01:40:53 TaskSetManager: INFO: Finished task 277.0 in stage 2.0 (TID 1160) in 579542 ms on localhost (executor driver) (278/882) 2020-02-16 01:40:53 Executor: INFO: Running task 278.0 in stage 2.0 (TID 1161) 2020-02-16 01:40:53 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 01:40:53 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 01:40:53 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9328132096+33554432 2020-02-16 01:40:53 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:45:25 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9361686528+33554432 2020-02-16 01:45:25 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:48:21 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000278_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000278 2020-02-16 01:48:21 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000278_0: Committed 2020-02-16 01:48:21 Executor: INFO: Finished task 278.0 in stage 2.0 (TID 1161). 959 bytes result sent to driver 2020-02-16 01:48:21 TaskSetManager: INFO: Starting task 279.0 in stage 2.0 (TID 1162, localhost, executor driver, partition 279, PROCESS_LOCAL, 9136 bytes) 2020-02-16 01:48:21 TaskSetManager: INFO: Finished task 278.0 in stage 2.0 (TID 1161) in 447792 ms on localhost (executor driver) (279/882) 2020-02-16 01:48:21 Executor: INFO: Running task 279.0 in stage 2.0 (TID 1162) 2020-02-16 01:48:21 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 01:48:21 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 01:48:21 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9361686528+33554432 2020-02-16 01:48:21 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:51:24 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000279_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000279 2020-02-16 01:51:24 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000279_0: Committed 2020-02-16 01:51:24 Executor: INFO: Finished task 279.0 in stage 2.0 (TID 1162). 959 bytes result sent to driver 2020-02-16 01:51:24 TaskSetManager: INFO: Starting task 280.0 in stage 2.0 (TID 1163, localhost, executor driver, partition 280, PROCESS_LOCAL, 9166 bytes) 2020-02-16 01:51:24 TaskSetManager: INFO: Finished task 279.0 in stage 2.0 (TID 1162) in 183578 ms on localhost (executor driver) (280/882) 2020-02-16 01:51:24 Executor: INFO: Running task 280.0 in stage 2.0 (TID 1163) 2020-02-16 01:51:24 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 01:51:24 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 01:51:24 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9395240960+33554432 2020-02-16 01:51:24 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:55:52 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000280_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000280 2020-02-16 01:55:52 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000280_0: Committed 2020-02-16 01:55:52 Executor: INFO: Finished task 280.0 in stage 2.0 (TID 1163). 959 bytes result sent to driver 2020-02-16 01:55:52 TaskSetManager: INFO: Starting task 281.0 in stage 2.0 (TID 1164, localhost, executor driver, partition 281, PROCESS_LOCAL, 9321 bytes) 2020-02-16 01:55:52 TaskSetManager: INFO: Finished task 280.0 in stage 2.0 (TID 1163) in 267978 ms on localhost (executor driver) (281/882) 2020-02-16 01:55:52 Executor: INFO: Running task 281.0 in stage 2.0 (TID 1164) 2020-02-16 01:55:52 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 01:55:52 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 01:55:52 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9428795392+33554432 2020-02-16 01:55:52 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 01:59:27 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9462349824+33554432 2020-02-16 01:59:27 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 02:04:02 FileOutputCommitter: INFO: Saved output of task 'attempt_20200215030143_0017_m_000281_0' to file:/tmp/hail.CIysp3LY0gRC/KiyRSnH4Hp/_temporary/0/task_20200215030143_0017_m_000281 2020-02-16 02:04:02 SparkHadoopMapRedUtil: INFO: attempt_20200215030143_0017_m_000281_0: Committed 2020-02-16 02:04:02 Executor: INFO: Finished task 281.0 in stage 2.0 (TID 1164). 959 bytes result sent to driver 2020-02-16 02:04:02 TaskSetManager: INFO: Starting task 282.0 in stage 2.0 (TID 1165, localhost, executor driver, partition 282, PROCESS_LOCAL, 8749 bytes) 2020-02-16 02:04:02 TaskSetManager: INFO: Finished task 281.0 in stage 2.0 (TID 1164) in 489677 ms on localhost (executor driver) (282/882) 2020-02-16 02:04:02 Executor: INFO: Running task 282.0 in stage 2.0 (TID 1165) 2020-02-16 02:04:02 HadoopMapRedCommitProtocol: INFO: Using output committer class org.apache.hadoop.mapred.FileOutputCommitter 2020-02-16 02:04:02 FileOutputCommitter: INFO: File Output Committer Algorithm version is 1 2020-02-16 02:04:02 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9462349824+33554432 2020-02-16 02:04:02 CodecPool: INFO: Got brand-new decompressor [.bgz] 2020-02-16 02:08:46 HadoopRDD: INFO: Input split: file:/seq/tng/newCloudJointGenotyping/PO-23593/1.ccdgf2_qced_main.vcf.bgz:9495904256+33554432 2020-02-16 02:08:46 CodecPool: INFO: Got brand-new decompressor [.bgz]