0xPlaygrounds / 0xPlaygrounds/rig
Update Ollama implementation
Open
bug
- Dominant language
- Rust
- Stars
- 8.6k
- Forks
- 959
- Avg merge
- 4h 32m
- Merged PRs (30d)
- 117
Description
Currently we treat the Ollama native API as if it was the OpenAI compatible API. We should distinguish and gives users the option between switching between the Ollama native, OpenAI, or Anthropic compatible APIs.
Inspired by this message from Erik Tews: There is one thing that is a bit surprising for me. Rig has a OllamaCompletionRequest with a max_tokens element, but apparently in Ollama there is no such option in the API: https://github.com/ollama/ollama/blob/main/docs/api.md
Contributor guide
Assessment
This issue has not been assessed yet.