githubnext / githubnext/gh-aw-test

Suggested test: copilot/wire-api-auto-configure

Closed Beginner friendly
#7,780 0 comments 0 reactions 0 assignees View on GitHub
suggested new test
Dominant language
Shell
Stars
8
Forks
5
PR merge metrics
No merged PRs in 30d

Description

## Motivation

Link to the gh-aw PR: github/gh-aw#46156 — auto-configure COPILOT_PROVIDER_WIRE_API from model catalog

Models like `gpt-5-mini` and `mai-code-1-flash-picker` require `wire_api: responses` (OpenAI Responses API). Before this fix, the CLI defaulted to `completions`, causing HTTP 400 failures. A model catalog was added and a build-time case-statement auto-sets `COPILOT_PROVIDER_WIRE_API=responses` for affected models before Copilot CLI launches.

## Proposed test

- **Workflow file**: `test-copilot-wire-api-auto-configure.md`
- **Trigger**: `workflow_dispatch`
- **Engine**: copilot
- **Safe output**: `create_issue` (simple output to confirm the agent completed successfully)
- **Variant**: standard

## Minimal test prompt sketch

Set `model: mai-code-1-flash-picker` (or another Responses-API-only model) in the workflow frontmatter and ask the agent to create an issue. A successful run proves that `COPILOT_PROVIDER_WIRE_API` was auto-configured; a regression would produce an HTTP 400 and fail before any safe output.

## New fixtures or secrets needed

None — uses the standard `githubnext/gh-aw-test` fixtures. The model alias must be available in the GitHub org model catalog.

## Notes

Related to the open suggestion `test-copilot-model-alias-small`. This test specifically targets the wire-API auto-selection path introduced in #46156, not just model aliasing. Should confirm the catalog-driven `case` statement covers the intended model names.

> [!WARNING]
>
> Firewall blocked 1 domain
>
> The following domain was blocked by the firewall during workflow execution:
>
> - `awmgmcpg`
>> To allow these domains, add them to the `network.allowed` list in your workflow frontmatter:
>
> ```yaml
> network:
> allowed:
> - defaults
> - "awmgmcpg"
> ```
>
> See [Network Configuration](https://github.github.com/gh-aw/reference/network/) for more information.
>
>

> Generated by [🔍 Suggest New E2E Tests](https://github.com/githubnext/gh-aw-test/actions/runs/29638451077) · 25.7 AIC · ⌖ 5.37 AIC · ⊞ 5.6K · [◷](https://github.com/search?q=repo%3Agithubnext%2Fgh-aw-test+is%3Aissue+%22gh-aw-workflow-call-id%3A+githubnext%2Fgh-aw-test%2Fsuggest-new-e2e-tests%22&type=issues)

Contributor guide

No contributing guide indexed for this repository

Research direction

Create test-copilot-wire-api-auto-configure.md using the proposed workflow_dispatch trigger, copilot engine, standard variant, and create_issue safe output. Set the model to mai-code-1-flash-picker, then run the workflow and confirm the agent completes successfully without an HTTP 400, demonstrating that the wire API is auto-configured.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions
Domain
ci-cd, testing
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Clearly specified
Newbie friendliness
78/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.