undefined | Better HN

0 pointszamadatix1y ago0 comments

I always see:

  /set parameter num_ctx <value>

Explained but never the follow up:

  /save <custom-name>

So you don't have to do the parameter change every load. Is there a better way or is it kind of like setting num_ctx in that "you're just supposed to know"?

0 comments

sReinwald1y ago

You can also set

    OLLAMA_CONTEXT_LENGTH=<tokens>

as an environment variable to change ollama's default context length.

Tepix1y ago

I think that will not work if you use the OpenAI compatible API endpoint.

svachalek1y ago

I tried this with ollama run, and it had no effect at all.

underlines1y ago

that env parameter is brand new, did you update ollama?

j / k navigate · click thread line to collapse