undefined | Better HN

0 pointsdiggan9mo ago0 comments

Are you saying that it's faster for them to get the hardware to run the weights themselves? Otherwise I'm not sure what the relevancy is.

0 comments

pegasus9mo ago

Unless they are already in the possession of such hardware (like an M3 mac, for example).

ChromaticPanic9mo ago

Yes some have existing infra

digganOP9mo ago

I'm having a somewhat hard time believing a corporation where getting a API key for a LLM service is very difficult, somehow has the (GPU) infrastructure already running for doing the same thing themselves, unless they happen to be a ML corporation, but I don't think we're talking about those in this context.

achierius9mo ago

No, this is very real. One reason why this can happen: a company has elaborate processes for protecting their internal data from leaking, but otherwise lets engineers do what they want with resources allocated to them.

oooyay9mo ago

Nah this is definitely a real scenario. Getting access to public models requires a lot of security review, but proving through Bedrock is much more simple. I may be spoiled in having worked for companies that have ML departments and developer XP departments though.

1 more reply

j / k navigate · click thread line to collapse