Hi,
I have a problem with a merging gvcfs. vds.combiner returns the following error:
FatalError: StreamConstraintsException: String length (20019131) exceeds the maximum length (20000000)
I run hail locally with ipython:
PYSPARK_SUBMIT_ARGS=“–driver-memory 32g --executor-memory 32g --driver-java-options ‘-Dspring.jackson.max-string-length=50000000’ pyspark-shell” ipython
but jaava-options doesn’t change anything.
Could you help me, please?
PW
@chrisvittal Do you have any thoughts about this? Is this an IR size error?
This seems to be related to [query] StreamConstraintsException in Spark backend · Issue #14650 · hail-is/hail · GitHub which @chrisvittal fixed for 0.2.133.
@P_W , please upgrade to 0.2.133 when [release] Release 0.2.133 by chrisvittal · Pull Request #14701 · hail-is/hail · GitHub gets merged.
Sorry for the inconvenience.
As of today, hail 0.2.133 is out, and contains the fix for this issue.