undefined | Better HN

0 pointsRobinL3y ago0 comments

I think many users just see they can execute a query on huge data cheaply and incredibly quickly and are delighted. That's certainly my experience.

It's one of the backends available in Splink, our FOSS record linkage software and it's revolutionary how it allows users to execute large scale probabilistic record linkage ridiculously cheaply. It wasn't long ago you needed very expensive proprietary software plus a big on prem cluster, costing in the hundreds of thousands, to achieve this.

A lot of the magic for me is on the infrastructure side: how they can read/write large datasets from s3 so quickly, so the value isn't just in the SQL engine.

0 comments

jfim3y ago

The biggest value for corporate users is that they get everything already included as part of their existing cloud agreement.

Adding a new vendor to the mix needs to involve procurement, the legal team, vendor negotiations, while using a new AWS feature is just a matter of using it, even if it's not as good as the original ISV's version and doesn't support the long term viability of the project.

pbronez3y ago

Splink looks cool. I'm familiar with Tamr and Senzing, but this is the first FOSS option I've come across.

jjoonathan3y ago

Yes, it's good to be platform king. We know. Low friction for you, high friction for everyone else.

j / k navigate · click thread line to collapse