Document / gate Ultra multi-agent features when using API-key custom model_providers
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 125k
- Forks
- 19.5k
- PR merge metrics
- PR metrics pending
Description
What version of Codex CLI is running?
0.147.0 (CLI + Desktop)
What subscription do you have?
ChatGPT Pro for account features; inference often via custom model_providers with API key (wire_api = "responses", env_key, requires_openai_auth = false).
Which model were you using?
gpt-5.6-sol with model_reasoning_effort = "ultra" on a custom API provider.
What platform is your computer?
macOS (applies generally)
What issue are you seeing?
Codex currently advertises or accepts Ultra-related settings for sessions that use a regular API-key model provider, but several Ultra product capabilities only work on the ChatGPT / first-party backend path.
Concretely:
| Capability | ChatGPT-auth / first-party provider | Regular API-key model_providers.* |
|---|---|---|
Reasoning effort ultra |
works | often works (effort enum only) |
Server-side multi-agent / Responses multi_agent |
works | fails (Unsupported parameter: multi_agent or no multi-agent tree) |
| Native Ultra-style parallel subagent product | works | incomplete / broken (see #17598, #37858) |
Client multi_agent_v2 / spawn_agent |
works | partial; known custom-provider bugs |
Users reasonably assume that:
model_provider = "my_api" # API key provider
model = "gpt-5.6-sol"
model_reasoning_effort = "ultra"
[features]
multi_agent_v2 = true
means they get the same Ultra multi-agent experience as ChatGPT-signed-in Codex. They do not. There is no clear in-product warning, and docs do not draw a hard line between:
- Ultra as reasoning effort (portable to many providers), vs
- Ultra as multi-agent product (ChatGPT-backend / first-party only today).
What steps can reproduce the bug?
- Configure any working custom Responses API provider with API key auth.
- Set Sol +
model_reasoning_effort = "ultra"+ enable multi-agent features. - Use Desktop/CLI as if Ultra multi-agent were fully available (spawn parallel subagents, multi-agent coordination).
- Observe failures or silent single-agent answers; switch to ChatGPT-auth default provider and see full behavior.
What is the expected behavior?
Please do one or both of:
- Document in config reference / subagents / models docs:
- which Ultra capabilities require ChatGPT authentication / first-party backend
- which work with arbitrary Responses-compatible API providers
- Gate or label in UI/CLI when
model_provideris a custom API-key provider:- show that multi-agent Ultra is unavailable or degraded
- avoid implying that effort=
ultraalone enables full Ultra multi-agent
Without this, power users waste time debugging config when the limit is product architecture.
Additional information
Related:
- #37858 — Ultra multi-agent / Responses multi_agent broken on regular API providers
- #17598 — native subagent orchestration with custom providers
- #31882 / #31870 — ChatGPT-backend-only headers / responses-lite assumptions on Sol/Terra/Luna
This issue is specifically about honest product surface + docs, not only the protocol fix requested in #37858.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the config reference, subagents and models documentation, then trace the CLI or UI handling for custom model_provider settings and multi_agent_v2. Document which Ultra capabilities require ChatGPT authentication or a first-party provider, and make the product surface clearly label unavailable or degraded multi-agent behavior for API-key providers.
Written by the indexing model from the issue text.
Assessment
- Domain
- cli, documentation
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 52/100