OpenRouter ?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 7.2k
- Forks
- 718
- Avg merge
- 3d 1h
- Merged PRs (30d)
- 23
Description
I'm trying to register a new LLM in the system by selecting "OpenAI" as the provider and changing the endpoint to point to OpenRouter.
However, I'm receiving an error stating that only OpenAI's standard models are allowed when using the "OpenAI" provider. This seems to be a limitation enforced by the platform, but in fact, OpenRouter supports a wide range of models via the OpenAI-compatible API.
How can I proceed to register a model like deepseek/deepseek-r1-distill-llama-70b using OpenRouter while still using the OpenAI protocol? I want to leverage OpenRouter for broader model support.
adapter_id: "openai|..."
adapter_metadata:
{model: "deepseek/deepseek-r1-distill-llama-70b", api_base: "https://openrouter.ai/api/v1",…}
adapter_name: "11"
api_base: "https://openrouter.ai/api/v1"
Failed
Error testing '11'. Error from LLM provider 'OpenAI'.
Unknown model 'deepseek/deepseek-r1-distill-llama-70b'. Please provide a valid OpenAI model name in: o1, o1-2024-12-17, o1-pro, o1-pro-2025-03-19, o1-preview
Thanks in advance
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing the OpenAI provider's model validation and the adapter metadata containing model and api_base. Check how the OpenAI-compatible endpoint is tested, then define completion as allowing the OpenRouter model while preserving the existing OpenAI protocol validation and successful provider testing.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, api
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100