undefined | Better HN

0 pointsJimDabell1y ago0 comments

What do you mean? Deploying something like spaCy is far easier than deploying an LLM in my experience.

0 comments

By "deploy", they almost certainly mean "set up to use" and they may have also included "learn how to use" and all its various forms, as well.

LLMs really are almost magic in how they can help in this space; and setting them up is often just getting an API key and throwing some money and webservice calls at them.

JimDabellOP1y ago

Set up to use, sure. Learn? Learning isn’t deployment in this context.

Setting up spaCy is just `pip install spacy`. No need to worry about GPUs or dedicated services like you do with LLMs.

throwawaymaths1y ago

yeah, then you have to learn the API. Basically every option for running LLMs have converged on the openAI (web) API.

JimDabellOP1y ago

“Learning the API” is not deployment.

throwawaymaths1y ago

pip install vllm, boom you have an openapi-compatible webserver. No further action necessary.

JimDabellOP1y ago

No, there is further action necessary. If you want any kind of decent performance, you need to run it with an appropriate GPU. This is not true of spaCy, which makes spaCy easier to deploy.

j / k navigate · click thread line to collapse

0 comments

t-writescode1y ago

By "deploy", they almost certainly mean "set up to use" and they may have also included "learn how to use" and all its various forms, as well.

LLMs really are almost magic in how they can help in this space; and setting them up is often just getting an API key and throwing some money and webservice calls at them.

JimDabellOP1y ago

Set up to use, sure. Learn? Learning isn’t deployment in this context.

Setting up spaCy is just `pip install spacy`. No need to worry about GPUs or dedicated services like you do with LLMs.

throwawaymaths1y ago

yeah, then you have to learn the API. Basically every option for running LLMs have converged on the openAI (web) API.

JimDabellOP1y ago

“Learning the API” is not deployment.

throwawaymaths1y ago

pip install vllm, boom you have an openapi-compatible webserver. No further action necessary.

JimDabellOP1y ago

No, there is further action necessary. If you want any kind of decent performance, you need to run it with an appropriate GPU. This is not true of spaCy, which makes spaCy easier to deploy.

j / k navigate · click thread line to collapse