undefined | Better HN

0 pointsblululu4y ago0 comments

I was thinking of something like an ONNX file or something that can easily slot into different runtimes.

Makes sense that this would be less beginner friendly so maybe you're correct that this is a P2 feature.

I guess I was thinking more in terms of pricing models and scaling up a service which is obviously a complicated decision for a startup so I'm not really sure what makes sense here. My rationale for wanting to buy/rent the model is that as a service scales it becomes increasingly important to own the model and the hosting. One of my concerns with building on top of a service like this is that it will potentially reach a chokepoint in the future. In general training a model is expensive and unique but hosting it is a commodity service. This will incentivize customers to use the service when they are small and then drop it when they grow to a certain size which is not necessarily ideal for either party.

0 comments

danott4y ago

Yep. The pricing model does basically break down for model export, but I think there's a solution there. Or, said another way, if we could make it really easy to do then there's an adjacent business we could move into.

In terms of keeping customers as they grow, our view (hope?) is that these models will be continually updated because of new annotations on their end, and from new training techniques on ours. And that concept of continuous improvement will push people toward a SaaS model.

When you say chokepoint, are you referring to cost, or latency, or something else?

j / k navigate · click thread line to collapse

0 pointsblululu4y ago0 comments

I was thinking of something like an ONNX file or something that can easily slot into different runtimes.

Makes sense that this would be less beginner friendly so maybe you're correct that this is a P2 feature.

0 comments

danott4y ago

When you say chokepoint, are you referring to cost, or latency, or something else?

j / k navigate · click thread line to collapse