undefined | Better HN

0 pointsHumanOstrich10mo ago0 comments

LM Studio is for hosting/serving local LLMs. Its chat UI is secondary and is pretty limited.

0 comments

4 comments · 1 top-level

apitman10mo ago· 3 in thread

Good to know, thanks. What do people generally use to connect to it for chat?

evgen10mo ago

OpenWebUI seems to be the standard. Easy to spin it up in a docker container pointed to 127.0.0.1:1234/v1 and away you go.

antimius10mo ago

Msty (msty.app). Currently they're working on Msty Studio which is only accessible to people with a license, but the desktop app is pretty good, it just doesn't have tool (MCP) support.

apitman10mo ago

Doesn't Msty alreayd run models? What is LM Studio needed for in this setup?

j / k navigate · click thread line to collapse