mindsdb / mindsdb/anton

OrcaRouter provider support for Anton

Open
#449 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
753
Forks
123
Avg merge
1d 16h
Merged PRs (30d)
77

Description

Anton is a doing agent rather than a coding agent: you describe the outcome you want — a cleaned inbox, a live portfolio dashboard pulled from current prices, a scheduled report — and Anton figures out the steps, writing whatever code is needed along the way. Its multi-layer memory means lessons learned on one task carry into your next workflow, which is what makes it genuinely self-improving.

What also stands out is how model-agnostic Anton is: its setup already supports Anthropic and OpenAI BYOK, MindsHub's Model Router, and generic OpenAI-compatible endpoints such as Together, Groq, Ollama, and vLLM, and it can split planning from coding across different models. For anyone running Anton standalone with their own key, each extra OpenAI-compatible option is a real choice — more model availability, more resilience, and more control over cost.

I'm an engineer on the OrcaRouter team. This is a proposal — no code has been written or tested yet. OrcaRouter would be an optional, additional provider choice; it would not replace or alter any existing provider, and the MindsHub Model Router path you already expose would stay untouched.

OrcaRouter exposes an OpenAI-compatible API and uses standard API-key authentication, so it should fit the same provider/config abstraction Anton already uses for generic OpenAI-compatible endpoints (a base URL plus an API key, via the /setup Models wizard or .anton/.env). The expected integration point is exactly there — alongside Together, Groq, Ollama, vLLM, and similar.

Which users would this help? A few capabilities map naturally onto Anton's workflow:

  • Multiple chat, reasoning, image, and video models through one endpoint, so your planning/coding provider split stays stable while the models underneath can change.
  • Automatic model routing and provider failover, which matters for long-running or scheduled workflows where a single provider outage shouldn't kill a task.
  • Prompt caching, which cuts cost on the repetitive multi-turn loops agentic work generates.
  • Usage tracking and budgets, useful when several Anton sessions share one key.

OrcaRouter is already used with a number of open-source projects — Dify, RAGFlow, goose, and promptfoo among them — and we maintain a gallery of those integrations at https://www.orcarouter.ai/built-with.

One transparent disclosure: OrcaRouter runs an optional open-source partner program through which approved OSS projects can receive a 5% revenue share from OrcaRouter usage attributed to their integration. Participation is not a prerequisite for the integration, and I'm glad to follow whatever disclosure or governance rules Anton prefers — or to leave the program out entirely.

I'd welcome the maintainers' thoughts on whether an OrcaRouter option would be useful for Anton's users and where it would best slot into provider setup. If it seems like a good fit, I'd be glad to open an implementation PR.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the existing provider/config abstraction used by Together, Groq, Ollama, and vLLM, then trace how the /setup Models wizard and .anton/.env represent generic OpenAI-compatible endpoints. Done should mean OrcaRouter is an optional provider alongside the existing choices without changing the MindsHub Model Router path, with the integration behavior tested.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, backend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.