githubnext / githubnext/gh-aw-test
E2E status report — 2026-09-16 (gh-aw matrix)
- Dominant language
- Shell
- Stars
- 8
- Forks
- 5
- PR merge metrics
- No merged PRs in 30d
Description
**Run:** [https://github.com/githubnext/gh-aw-test/actions/runs/35074420446](https://github.com/githubnext/gh-aw-test/actions/runs/35074420446) · **Trigger:** `workflow_dispatch` · **Generated:** `2026-09-16T09:34:36Z` · **Outcome:** `failure`
## Matrix summary
**❌ Matrix incomplete: 1 failing test entry (30 failed test run(s)), 0 infrastructure error(s), 0 entries with no tests executed**
| entry | ref | mode | samples | exit code | passed | failed | status |
| :--- | :--- | :--- | :---: | :---: | ---: | ---: | :--- |
| main | [main](https://github.com/github/gh-aw/commit/0fea86e1185f) | source | false | 0 | 1 | 0 | ✅ pass |
| main | [main](https://github.com/github/gh-aw/commit/0fea86e1185f) | source | true | 1 | 91 | 30 | ❌ fail |
| release | [v0.88.7](https://github.com/github/gh-aw/releases/tag/v0.88.7) | extension | true | ? | 0 | 0 | ⚪ unknown |
| pre-release | [v0.89.15](https://github.com/github/gh-aw/releases/tag/v0.89.15) | extension | true | ? | 0 | 0 | ⚪ unknown |
## ❌ Test errors — samples mode
| test | [v0.88.7](https://github.com/github/gh-aw/releases/tag/v0.88.7) | [v0.89.15](https://github.com/github/gh-aw/releases/tag/v0.89.15) | [main](https://github.com/github/gh-aw/commit/0fea86e1185f) |
| :--- | :---: | :---: | :---: |
| [test-copilot-call-workflow](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-call-workflow.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35076929568) |
| [test-copilot-mcp](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-mcp.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35075902335) |
| [test-copilot-missing-data](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-missing-data.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996011) |
| [test-copilot-missing-tool](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-missing-tool.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077994430) |
| [test-copilot-noop](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-noop.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077995612) |
| [test-copilot-nosandbox-create-discussion](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-create-discussion.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077995296) |
| [test-copilot-nosandbox-create-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-create-issue.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996001) |
| [test-copilot-nosandbox-create-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-create-pull-request.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077995726) |
| [test-copilot-nosandbox-create-repository-code-scanning-alert](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-create-repository-code-scanning-alert.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996180) |
| [test-copilot-nosandbox-create-two-pull-requests](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-create-two-pull-requests.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996399) |
| [test-copilot-nosandbox-custom-safe-outputs](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-custom-safe-outputs.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077995846) |
| [test-copilot-nosandbox-mcp](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-mcp.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996524) |
| [test-copilot-siderepo-add-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-add-comment.md) | — | — | ❌ |
| [test-copilot-siderepo-add-discussion-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-add-discussion-comment.md) | — | — | ❌ |
| [test-copilot-siderepo-add-labels](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-add-labels.md) | — | — | ❌ |
| [test-copilot-siderepo-create-discussion](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-create-discussion.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996088) |
| [test-copilot-siderepo-create-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-create-issue.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077995661) |
| [test-copilot-siderepo-create-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-create-pull-request.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996400) |
| [test-copilot-siderepo-create-pull-request-review-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-create-pull-request-review-comment.md) | — | — | ❌ |
| [test-copilot-siderepo-create-two-pull-requests](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-create-two-pull-requests.md) | — | — | ❌ |
| [test-copilot-siderepo-link-sub-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-link-sub-issue.md) | — | — | ❌ |
| [test-copilot-siderepo-mcp](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-mcp.md) | — | — | ❌ |
| [test-copilot-siderepo-push-to-pull-request-branch-using-dispatch](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-push-to-pull-request-branch-using-dispatch.md) | — | — | ❌ |
| [test-copilot-siderepo-sparse-create-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-sparse-create-pull-request.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077995698) |
| [test-copilot-siderepo-sparse-push-to-pull-request-branch-using-dispatch](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-sparse-push-to-pull-request-branch-using-dispatch.md) | — | — | ❌ |
| [test-copilot-siderepo-subdir-create-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-subdir-create-pull-request.md) | — | — | ❌ |
| [test-copilot-siderepo-update-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-update-issue.md) | — | — | ❌ |
| [test-copilot-update-release](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-update-release.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077997416) |
| [test-copilot-upload-asset](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-upload-asset.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996198) |
| [test-copilot-upload-code-coverage](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-upload-code-coverage.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077994692) |
## ✅ Test successes — samples mode
| test | [v0.88.7](https://github.com/github/gh-aw/releases/tag/v0.88.7) | [v0.89.15](https://github.com/github/gh-aw/releases/tag/v0.89.15) | [main](https://github.com/github/gh-aw/commit/0fea86e1185f) |
| :--- | :---: | :---: | :---: |
| [test-claude-create-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-claude-create-issue.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902920) |
| [test-codex-create-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-codex-create-issue.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902523) |
| [test-copilot-add-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-add-comment.md) | — | — | ✅ |
| [test-copilot-add-discussion-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-add-discussion-comment.md) | — | — | ✅ |
| [test-copilot-add-labels](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-add-labels.md) | — | — | ✅ |
| [test-copilot-add-reviewer](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-add-reviewer.md) | — | — | ✅ |
| [test-copilot-assign-milestone](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-assign-milestone.md) | — | — | ✅ |
| [test-copilot-assign-to-agent](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-assign-to-agent.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076929555) |
| [test-copilot-assign-to-user](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-assign-to-user.md) | — | — | ✅ |
| [test-copilot-close-discussion](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-close-discussion.md) | — | — | ✅ |
| [test-copilot-close-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-close-issue.md) | — | — | ✅ |
| [test-copilot-close-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-close-pull-request.md) | — | — | ✅ |
| [test-copilot-command](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-command.md) | — | — | ✅ |
| [test-copilot-create-check-run](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-check-run.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902745) |
| [test-copilot-create-discussion](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-discussion.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902232) |
| [test-copilot-create-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-issue.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902762) |
| [test-copilot-create-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-pull-request.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902126) |
| [test-copilot-create-pull-request-review-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-pull-request-review-comment.md) | — | — | ✅ |
| [test-copilot-create-repository-code-scanning-alert](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-repository-code-scanning-alert.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902816) |
| [test-copilot-create-two-pull-requests](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-two-pull-requests.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075901863) |
| [test-copilot-custom-safe-outputs](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-custom-safe-outputs.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902443) |
| [test-copilot-dismiss-pull-request-review](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-dismiss-pull-request-review.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076936170) |
| [test-copilot-dispatch-workflow](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-dispatch-workflow.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076932070) |
| [test-copilot-gh-steps](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-gh-steps.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902045) |
| [test-copilot-hide-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-hide-comment.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076932401) |
| [test-copilot-inline-sub-agents](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-inline-sub-agents.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076929819) |
| [test-copilot-issue-intents](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-issue-intents.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076930079) |
| [test-copilot-link-sub-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-link-sub-issue.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076933454) |
| [test-copilot-mark-pull-request-as-ready-for-review](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-mark-pull-request-as-ready-for-review.md) | — | — | ✅ |
| [test-copilot-mcp-code-quality](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-mcp-code-quality.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075901893) |
| [test-copilot-network-isolation](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-network-isolation.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076929760) |
| [test-copilot-nosandbox-add-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-add-comment.md) | — | — | ✅ |
| [test-copilot-nosandbox-add-discussion-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-add-discussion-comment.md) | — | — | ✅ |
| [test-copilot-nosandbox-add-labels](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-add-labels.md) | — | — | ✅ |
| [test-copilot-nosandbox-command](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-command.md) | — | — | ✅ |
| [test-copilot-nosandbox-create-pull-request-review-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-create-pull-request-review-comment.md) | — | — | ✅ |
| [test-copilot-nosandbox-push-to-pull-request-branch](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-push-to-pull-request-branch.md) | — | — | ✅ |
| [test-copilot-nosandbox-update-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-update-issue.md) | — | — | ✅ |
| [test-copilot-push-to-pull-request-branch-using-dispatch](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-push-to-pull-request-branch-using-dispatch.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076939290) |
| [test-copilot-push-to-pull-request-branch-using-slash-command](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-push-to-pull-request-branch-using-slash-command.md) | — | — | ✅ |
| [test-copilot-remove-labels](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-remove-labels.md) | — | — | ✅ |
| [test-copilot-replace-label](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-replace-label.md) | — | — | ✅ |
| [test-copilot-reply-to-pull-request-review-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-reply-to-pull-request-review-comment.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076945533) |
| [test-copilot-report-incomplete](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-report-incomplete.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35077996240) |
| [test-copilot-resolve-pull-request-review-thread](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-resolve-pull-request-review-thread.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076942013) |
| [test-copilot-restore-memory-custom-job](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-restore-memory-custom-job.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902306) |
| [test-copilot-set-issue-field](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-set-issue-field.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076929084) |
| [test-copilot-set-issue-field-builtin-rejection](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-set-issue-field-builtin-rejection.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076929359) |
| [test-copilot-set-issue-type](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-set-issue-type.md) | — | — | ✅ |
| [test-copilot-skills-frontmatter](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-skills-frontmatter.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902641) |
| [test-copilot-submit-pull-request-review](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-submit-pull-request-review.md) | — | — | ✅ |
| [test-copilot-submit-pull-request-review-locked](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-submit-pull-request-review-locked.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076939160) |
| [test-copilot-unassign-from-user](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-unassign-from-user.md) | — | — | ✅ |
| [test-copilot-update-discussion](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-update-discussion.md) | — | — | ✅ |
| [test-copilot-update-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-update-issue.md) | — | — | ✅ |
| [test-copilot-update-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-update-pull-request.md) | — | — | ✅ |
## ✅ Test successes — inference mode
| test | [v0.88.7](https://github.com/github/gh-aw/releases/tag/v0.88.7) | [v0.89.15](https://github.com/github/gh-aw/releases/tag/v0.89.15) | [main](https://github.com/github/gh-aw/commit/0fea86e1185f) |
| :--- | :---: | :---: | :---: |
| [test-copilot-create-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-issue.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35074766458) |
## 🤖 Agent triage prompt
Copy the block below into a coding agent (e.g. Copilot) to investigate the failures:
```text
You are triaging failures from the gh-aw-test E2E suite.
Run: https://github.com/githubnext/gh-aw-test/actions/runs/35074420446
Repository under test: github/gh-aw (the gh-aw CLI/compiler).
Test harness repository: githubnext/gh-aw-test (this repo; runner is e2e.sh).
Focus: gh-aw main (commit 0fea86e1185f), sampling = true (--use-samples; AI engine was NOT called).
Failed tests (main, samples=true):
- test-copilot-mcp run: https://github.com/githubnext/gh-aw-test/actions/runs/35075902335
- test-copilot-call-workflow run: https://github.com/githubnext/gh-aw-test/actions/runs/35076929568
- test-copilot-missing-tool run: https://github.com/githubnext/gh-aw-test/actions/runs/35077994430
- test-copilot-upload-code-coverage run: https://github.com/githubnext/gh-aw-test/actions/runs/35077994692
- test-copilot-nosandbox-create-discussion run: https://github.com/githubnext/gh-aw-test/actions/runs/35077995296
- test-copilot-nosandbox-custom-safe-outputs run: https://github.com/githubnext/gh-aw-test/actions/runs/35077995846
- test-copilot-siderepo-sparse-create-pull-request run: https://github.com/githubnext/gh-aw-test/actions/runs/35077995698
- test-copilot-nosandbox-create-pull-request run: https://github.com/githubnext/gh-aw-test/actions/runs/35077995726
- test-copilot-siderepo-create-issue run: https://github.com/githubnext/gh-aw-test/actions/runs/35077995661
- test-copilot-noop run: https://github.com/githubnext/gh-aw-test/actions/runs/35077995612
- test-copilot-nosandbox-create-issue run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996001
- test-copilot-siderepo-create-discussion run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996088
- test-copilot-nosandbox-create-repository-code-scanning-alert run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996180
- test-copilot-upload-asset run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996198
- test-copilot-missing-data run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996011
- test-copilot-nosandbox-create-two-pull-requests run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996399
- test-copilot-nosandbox-mcp run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996524
- test-copilot-siderepo-create-pull-request run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996400
- test-copilot-update-release run: https://github.com/githubnext/gh-aw-test/actions/runs/35077997416
- test-copilot-siderepo-subdir-create-pull-request run:
- test-copilot-siderepo-sparse-push-to-pull-request-branch-using-dispatch run:
- test-copilot-siderepo-create-two-pull-requests run:
- test-copilot-siderepo-link-sub-issue run:
- test-copilot-siderepo-mcp run:
- test-copilot-siderepo-push-to-pull-request-branch-using-dispatch run:
- test-copilot-siderepo-create-pull-request-review-comment run:
- test-copilot-siderepo-add-discussion-comment run:
- test-copilot-siderepo-add-labels run:
- test-copilot-siderepo-add-comment run:
- test-copilot-siderepo-update-issue run:
Goal: for EACH failed test above, access the GitHub
Actions logs for the run above (and the per-entry artifacts e2e--samples-,
which contain e2e-test-*.log, e2e-output.log and fails.txt), determine the root
cause, and categorize the failure as exactly one of:
1. TRANSIENT — flaky/infra/network/rate-limit/timing; not a real defect.
Action: note it and recommend a re-run (./e2e.sh rerun).
2. TEST-FRAMEWORK BUG — a defect in this repo's harness (e2e.sh), a workflow
source file (.github/workflows/test-*.md), a sample, or CI config.
Action: propose a concrete fix (file + change) in githubnext/gh-aw-test.
3. GH-AW BUG — a defect in github/gh-aw itself (compiler output, runtime
engine behaviour, safe-output handling, etc.).
Action: open an issue in github/gh-aw with a minimal repro, the failing
test name, the gh-aw ref/mode/samples combination, and links to the
relevant log lines. Check for an existing open issue first and link it
instead of filing a duplicate.
Steps:
- Use 'gh run view --log' and 'gh run download ' to fetch logs/artifacts.
- Read AGENTS.md in githubnext/gh-aw-test for harness conventions before proposing fixes.
- Group failures by suspected root cause; the same gh-aw bug may explain several.
- Produce a table: test | category | root cause | recommended action | issue/PR link.
- Only open github/gh-aw issues for category 3, and only after confirming no duplicate exists.
```
## Previous status reports (closed by this run)
* #15996
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the linked GitHub Actions run and the failing sample workflows, such as .github/workflows/test-copilot-call-workflow.md and .github/workflows/test-copilot-mcp.md, then compare them with the passing samples. Identify the shared cause of the 30 failures and confirm the matrix completes with no failed test entries.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- github-actions, shell
- Domain
- ci-cd, testing
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100