zai-org / zai-org/feedback

[Feature] Add Vercel AI Gateway as a built-in provider

Open
#366 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

priority: P2
Dominant language
No language data
Stars
22
Forks
1
PR merge metrics
No merged PRs in 30d

Description

I work on Vercel's AI Gateway. We verified ZCode 3.9.1 works with it end to end as a custom provider, and we're adding ZCode to our vercel ai-gateway coding-agents setup CLI command — a built-in entry on your side would complete the loop.

Verified on 3.9.1 (macOS arm64), all with real agent tasks including tool calls:

  • Chat completions (/chat/completions): Base URL https://ai-gateway.vercel.sh/coding-agent/v1 — works, including the reasoning effort levels
  • Responses (/responses): Base URL https://ai-gateway.vercel.sh/codex/v1 — works
  • Anthropic messages (/v1/messages): Base URL https://ai-gateway.vercel.sh — endpoint and auth work, but Claude models are blocked by the unconditional thinking.type: "enabled" injection tracked in #233

One key gives access to 147 models across providers with unified billing. ZCode already runs on Vercel's AI SDK (ai-sdk/provider-utils is in the request user-agent), so the wiring should be familiar: the chat-completions config above, plus model discovery from GET /coding-agent/v1/models — the catalog returns context_window, max_tokens, and modalities per model, which maps directly onto your model config fields.

Happy to test builds or send anything else you need.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the existing custom-provider wiring and the ai-sdk/provider-utils request path. Use the supplied chat-completions base URL and GET /coding-agent/v1/models response as the integration reference; done means the gateway is available as a built-in provider with model metadata mapped into the existing config fields.

Written by the indexing model from the issue text.

Assessment

Tech stack
ai-infra-agents
Domain
ai, api, backend
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
66/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.