undefined | Better HN

0 pointssReinwald1y ago0 comments

You can also set

    OLLAMA_CONTEXT_LENGTH=<tokens>

as an environment variable to change ollama's default context length.

0 comments

Tepix1y ago

I think that will not work if you use the OpenAI compatible API endpoint.

I tried this with ollama run, and it had no effect at all.

that env parameter is brand new, did you update ollama?

j / k navigate · click thread line to collapse

Tepix1y ago

I think that will not work if you use the OpenAI compatible API endpoint.

I tried this with ollama run, and it had no effect at all.

that env parameter is brand new, did you update ollama?

j / k navigate · click thread line to collapse