Zipstack / Zipstack/unstract

OpenRouter ?

Open
#1,443 3 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Python
Stars
7.2k
Forks
718
Avg merge
3d 1h
Merged PRs (30d)
23

Description

I'm trying to register a new LLM in the system by selecting "OpenAI" as the provider and changing the endpoint to point to OpenRouter.

However, I'm receiving an error stating that only OpenAI's standard models are allowed when using the "OpenAI" provider. This seems to be a limitation enforced by the platform, but in fact, OpenRouter supports a wide range of models via the OpenAI-compatible API.

How can I proceed to register a model like deepseek/deepseek-r1-distill-llama-70b using OpenRouter while still using the OpenAI protocol? I want to leverage OpenRouter for broader model support.

adapter_id: "openai|..."
adapter_metadata:
{model: "deepseek/deepseek-r1-distill-llama-70b", api_base: "https://openrouter.ai/api/v1",…}
adapter_name: "11"
api_base: "https://openrouter.ai/api/v1"

Failed
Error testing '11'. Error from LLM provider 'OpenAI'.
Unknown model 'deepseek/deepseek-r1-distill-llama-70b'. Please provide a valid OpenAI model name in: o1, o1-2024-12-17, o1-pro, o1-pro-2025-03-19, o1-preview
Thanks in advance

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing the OpenAI provider's model validation and the adapter metadata containing model and api_base. Check how the OpenAI-compatible endpoint is tested, then define completion as allowing the OpenRouter model while preserving the existing OpenAI protocol validation and successful provider testing.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, api
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.