0xPlaygrounds / 0xPlaygrounds/rig

Update Ollama implementation

Open
#2,156 2 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Rust
Stars
8.6k
Forks
959
Avg merge
4h 32m
Merged PRs (30d)
117

Description

Currently we treat the Ollama native API as if it was the OpenAI compatible API. We should distinguish and gives users the option between switching between the Ollama native, OpenAI, or Anthropic compatible APIs.

Inspired by this message from Erik Tews: There is one thing that is a bit surprising for me. Rig has a OllamaCompletionRequest with a max_tokens element, but apparently in Ollama there is no such option in the API: https://github.com/ollama/ollama/blob/main/docs/api.md

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.