undefined | Better HN

0 pointstomrod10mo ago0 comments

PySpark is a wrapper, so Scala is unnecessary and boggy.

0 comments

PySpark is great, except for UDF performance. This gap means that Scala is helpful for some Spark edge cases like column-level encryption/decryption with UDF

j / k navigate · click thread line to collapse

0 pointstomrod10mo ago0 comments

PySpark is a wrapper, so Scala is unnecessary and boggy.

0 comments

spark137748510mo ago

PySpark is great, except for UDF performance. This gap means that Scala is helpful for some Spark edge cases like column-level encryption/decryption with UDF

j / k navigate · click thread line to collapse