undefined | Better HN

0 pointshalfcat2y ago0 comments

The app maker can screw the plug-in author at any moment.

For general cloud, avoiding screwing might mean multi cloud. But for LLM, there’s only one option at the highest level of quality for now.

People tend to over focus on resilience (minimizing probability of breaking) and neglect the plan for recovery when things do break.

I can’t tell you how weirdly foreign this is to many people, how many meetings I’ve been in where I ask what the plan is when it fails, and someone starts explaining RAID6 or BGP or something, with no actual plan, other than “it’s really unlikely to fail”, which old dogs know isn’t true.

I guess the point is, for now, we’re all de facto plug-in authors.

0 comments

dragonwriter2y ago

> For general cloud, avoiding screwing might mean multi cloud. But for LLM, there’s only one option at the highest level of quality for now.

There's always only one at the highest level of quality at a fine-grained enough resolution.

Whether there's only one at sufficient quality for use, and if it is possible to switch between them in realtime without problems caused by the switch (e.g., data locked up in the provider that is down) is the relevant question, and whether the cost of building the multi-provider switching capability is worth it given the cost vs. risk of outage. All those are complicated questions that are application specific, not ones that have an easy answer on a global, uniform basis.

TeMPOraL2y ago

> There's always only one at the highest level of quality at a fine-grained enough resolution.

Of course, but right now, there highest quality level option is an outlier, far ahead of everyone else, so if you need this level of quality (and I struggle to imagine user-facing products where you wouldn't!), there is only one option in the foreseeable future.

j / k navigate · click thread line to collapse