In ollama api user can define advanced parameters:
truncate: truncates the end of each input to fit within context length. Returns error iffalseand context length is exceeded. Defaults totrueoptions: additional model parameters listed in the documentation for the Modelfile such astemperaturekeep_alive: controls how long the model will stay loaded into memory following the request (default:5m)dimensions: number of dimensions for the embedding
I mostly look forward to the “dimensions” option, but it would be great to be able to use all the options.