undefined | Better HN

0 pointsthrowawaymaths1y ago0 comments

And yet, it's so much easier to deploy an LLM, either through a service or on prem.

0 comments

It's easier to do a lot of things. That doesn't make it better.

But it does make people to feel like that action is now possible. And once someone believes something is possible, they're more likely to do it

golergka1y ago

Often makes things built on top of them better because of improved speed of iteration.

imdsm1y ago

Sometimes, doing something different does result in something better.

For example, EVs. Compare EVs to ICEVs and you can point out a lot of faults, but ICEVs have had 100 years of refinement. Perhaps you're comparing battle hardened SA with fledgling LLM based SA?

Never don't do new things, not only when its for fun, but especially when its for fun. If you want to be closed minded, that's your choice, but don't try to put that mentality onto others.

Keep your non-hacker mindset to yourself.

1 more reply

JimDabell1y ago

What do you mean? Deploying something like spaCy is far easier than deploying an LLM in my experience.

t-writescode1y ago

By "deploy", they almost certainly mean "set up to use" and they may have also included "learn how to use" and all its various forms, as well.

LLMs really are almost magic in how they can help in this space; and setting them up is often just getting an API key and throwing some money and webservice calls at them.

JimDabell1y ago

Set up to use, sure. Learn? Learning isn’t deployment in this context.

Setting up spaCy is just `pip install spacy`. No need to worry about GPUs or dedicated services like you do with LLMs.

1 more reply

throwawaymathsOP1y ago

pip install vllm, boom you have an openapi-compatible webserver. No further action necessary.

JimDabell1y ago

No, there is further action necessary. If you want any kind of decent performance, you need to run it with an appropriate GPU. This is not true of spaCy, which makes spaCy easier to deploy.

j / k navigate · click thread line to collapse

0 comments

tantalor1y ago

It's easier to do a lot of things. That doesn't make it better.

t-writescode1y ago

But it does make people to feel like that action is now possible. And once someone believes something is possible, they're more likely to do it

golergka1y ago

Often makes things built on top of them better because of improved speed of iteration.

imdsm1y ago

Sometimes, doing something different does result in something better.

For example, EVs. Compare EVs to ICEVs and you can point out a lot of faults, but ICEVs have had 100 years of refinement. Perhaps you're comparing battle hardened SA with fledgling LLM based SA?

Never don't do new things, not only when its for fun, but especially when its for fun. If you want to be closed minded, that's your choice, but don't try to put that mentality onto others.

Keep your non-hacker mindset to yourself.

1 more reply

JimDabell1y ago

What do you mean? Deploying something like spaCy is far easier than deploying an LLM in my experience.

t-writescode1y ago

By "deploy", they almost certainly mean "set up to use" and they may have also included "learn how to use" and all its various forms, as well.

LLMs really are almost magic in how they can help in this space; and setting them up is often just getting an API key and throwing some money and webservice calls at them.

JimDabell1y ago

Set up to use, sure. Learn? Learning isn’t deployment in this context.

Setting up spaCy is just `pip install spacy`. No need to worry about GPUs or dedicated services like you do with LLMs.

1 more reply

throwawaymathsOP1y ago

pip install vllm, boom you have an openapi-compatible webserver. No further action necessary.

JimDabell1y ago

No, there is further action necessary. If you want any kind of decent performance, you need to run it with an appropriate GPU. This is not true of spaCy, which makes spaCy easier to deploy.

j / k navigate · click thread line to collapse