undefined | Better HN

0 pointsbalder199110mo ago0 comments

So in the end it had to be funneled to a single server keeping a list of requests to make serially to their API?

0 comments

lmm10mo ago

That's the easy way to do it, the fun one is implementing a distributed lock/queue.

Not actually that hard with a redis lock or any database (Postgres has a specific lock for this but you could also just use a record in a table)

Far easier than the original single threaded solution - and has fault tolerance baked in cause you can run it on multiple clients

lmm10mo ago

> Not actually that hard with a redis lock or any database (Postgres has a specific lock for this but you could also just use a record in a table)

Redis is just another SPOF, and so is Postgres without fiddly third party extensions (that are pretty unreliable in practice, IME). I'm talking about something truly distributed.

virgilp10mo ago

What, you need something truly "internet-scale" to make sure your thousands of clients can hit, sequentially, that one faulty api? Would you really be concerned more about Redis failure rates, than said API's failure rates?

1 more reply

DmitryOlshansky10mo ago

Or zookeeper for that matter.

j / k navigate · click thread line to collapse

0 comments

lmm10mo ago

That's the easy way to do it, the fun one is implementing a distributed lock/queue.

reillyse10mo ago

Not actually that hard with a redis lock or any database (Postgres has a specific lock for this but you could also just use a record in a table)

Far easier than the original single threaded solution - and has fault tolerance baked in cause you can run it on multiple clients

lmm10mo ago

> Not actually that hard with a redis lock or any database (Postgres has a specific lock for this but you could also just use a record in a table)

Redis is just another SPOF, and so is Postgres without fiddly third party extensions (that are pretty unreliable in practice, IME). I'm talking about something truly distributed.

virgilp10mo ago

1 more reply

DmitryOlshansky10mo ago

Or zookeeper for that matter.

j / k navigate · click thread line to collapse