The types=
kwarg to hl.import_table
lets you specify types for each field. I think it cannot be used in combination with impute, which is unfortunate.
Regarding memory, have you set PYSPARK_SUBMIT_ARGS?
The types=
kwarg to hl.import_table
lets you specify types for each field. I think it cannot be used in combination with impute, which is unfortunate.
Regarding memory, have you set PYSPARK_SUBMIT_ARGS?