undefined | Better HN

0 pointscgio10mo ago0 comments

For when you need more executors without rewriting your logic.

0 comments

Using a Python solution like Dask might actually be better, because you can work with all of the Python data frameworks and tools, but you can also easily scale it if you need it without having to step into the Spark world.

threeseed10mo ago

But Dask is orders of magnitude slower to Spark.

And you can still use Python data frameworks with Spark so not sure what you're getting.

j / k navigate · click thread line to collapse

0 comments

this_user10mo ago

threeseed10mo ago

But Dask is orders of magnitude slower to Spark.

And you can still use Python data frameworks with Spark so not sure what you're getting.

j / k navigate · click thread line to collapse