githubnext / githubnext/gh-aw-test

Suggested test: codex/openai-model-prefix-stripping

Open
#15,235 0 comments 0 reactions 0 assignees View on GitHub
suggested new test
Dominant language
Shell
Stars
8
Forks
5
PR merge metrics
No merged PRs in 30d

Description

## Motivation

Link to the gh-aw PR: github/gh-aw#60423 — `codexModelID` stripped only the `copilot/` prefix from model identifiers, so `engine.model: openai/gpt-5.3-codex` was forwarded verbatim to the Codex CLI and failed with `model_not_supported_error`. The fix strips `openai/` (case-insensitively) too.

## Proposed test

- **Workflow file**: `test-codex-openai-model-prefix.md`
- **Trigger**: `workflow_dispatch`
- **Engine**: codex (engine-specific fix, not portable to copilot/claude)
- **Safe output**: `create-issue`
- **Variant**: standard

## Minimal test prompt sketch

Configure `engine: { id: codex, model: openai/gpt-5.3-codex }` and have the agent create a simple issue with a fixed title/body. Since the compiler bug affected the model ID actually forwarded to the Codex CLI (not just the compiled lock file), this scenario is only meaningfully exercised when the live engine runs (`--use-samples` would bypass the invocation). Flag this test for inclusion in `main-live` / non-samples runs only.

## New fixtures or secrets needed

None — uses existing repo and codex engine credentials already configured for other `test-codex-*` workflows.

## Notes

No existing `test-codex-*` workflow sets an explicit `model:` with a provider prefix. Open question: should this run under `--use-samples` at all, or be excluded (like `test-copilot-custom-safe-outputs`) since its whole value is exercising real Codex CLI invocation with the corrected model string?

> Generated by [🔍 Suggest New E2E Tests](https://github.com/githubnext/gh-aw-test/actions/runs/34747998916) · copilot · auto · 71.7 AIC · ⌖ 5.41 AIC · ⊞ 8.4K · [◷](https://github.com/search?q=repo%3Agithubnext%2Fgh-aw-test+is%3Aissue+%22gh-aw-workflow-call-id%3A+githubnext%2Fgh-aw-test%2Fsuggest-new-e2e-tests%22&type=issues)

Contributor guide

No contributing guide indexed for this repository

Research direction

Create test-codex-openai-model-prefix-stripping.md, using the existing test-codex-* workflows as a starting point. Configure the codex engine with model openai/gpt-5.3-codex and a fixed create-issue output, then run it through main-live or another non-samples path with the existing Codex credentials. Done means the live Codex invocation succeeds and creates the expected issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions, markdown
Domain
ci-cd, testing
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
72/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.