githubnext / githubnext/gh-aw-test

E2E status report — 2026-09-16 (gh-aw matrix)

Closed
#16,059 0 comments 0 reactions 0 assignees View on GitHub
e2e-status-report
Dominant language
Shell
Stars
8
Forks
5
PR merge metrics
No merged PRs in 30d

Description

**Run:** [https://github.com/githubnext/gh-aw-test/actions/runs/35074420446](https://github.com/githubnext/gh-aw-test/actions/runs/35074420446)  ·  **Trigger:** `workflow_dispatch`  ·  **Generated:** `2026-09-16T09:34:36Z`  ·  **Outcome:** `failure`

## Matrix summary

**❌ Matrix incomplete: 1 failing test entry (30 failed test run(s)), 0 infrastructure error(s), 0 entries with no tests executed**

| entry | ref | mode | samples | exit code | passed | failed | status |
| :--- | :--- | :--- | :---: | :---: | ---: | ---: | :--- |
| main | [main](https://github.com/github/gh-aw/commit/0fea86e1185f) | source | false | 0 | 1 | 0 | ✅ pass |
| main | [main](https://github.com/github/gh-aw/commit/0fea86e1185f) | source | true | 1 | 91 | 30 | ❌ fail |
| release | [v0.88.7](https://github.com/github/gh-aw/releases/tag/v0.88.7) | extension | true | ? | 0 | 0 | ⚪ unknown |
| pre-release | [v0.89.15](https://github.com/github/gh-aw/releases/tag/v0.89.15) | extension | true | ? | 0 | 0 | ⚪ unknown |

## ❌ Test errors — samples mode

| test | [v0.88.7](https://github.com/github/gh-aw/releases/tag/v0.88.7) | [v0.89.15](https://github.com/github/gh-aw/releases/tag/v0.89.15) | [main](https://github.com/github/gh-aw/commit/0fea86e1185f) |
| :--- | :---: | :---: | :---: |
| [test-copilot-call-workflow](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-call-workflow.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35076929568) |
| [test-copilot-mcp](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-mcp.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35075902335) |
| [test-copilot-missing-data](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-missing-data.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996011) |
| [test-copilot-missing-tool](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-missing-tool.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077994430) |
| [test-copilot-noop](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-noop.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077995612) |
| [test-copilot-nosandbox-create-discussion](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-create-discussion.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077995296) |
| [test-copilot-nosandbox-create-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-create-issue.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996001) |
| [test-copilot-nosandbox-create-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-create-pull-request.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077995726) |
| [test-copilot-nosandbox-create-repository-code-scanning-alert](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-create-repository-code-scanning-alert.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996180) |
| [test-copilot-nosandbox-create-two-pull-requests](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-create-two-pull-requests.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996399) |
| [test-copilot-nosandbox-custom-safe-outputs](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-custom-safe-outputs.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077995846) |
| [test-copilot-nosandbox-mcp](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-mcp.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996524) |
| [test-copilot-siderepo-add-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-add-comment.md) | — | — | ❌ |
| [test-copilot-siderepo-add-discussion-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-add-discussion-comment.md) | — | — | ❌ |
| [test-copilot-siderepo-add-labels](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-add-labels.md) | — | — | ❌ |
| [test-copilot-siderepo-create-discussion](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-create-discussion.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996088) |
| [test-copilot-siderepo-create-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-create-issue.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077995661) |
| [test-copilot-siderepo-create-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-create-pull-request.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996400) |
| [test-copilot-siderepo-create-pull-request-review-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-create-pull-request-review-comment.md) | — | — | ❌ |
| [test-copilot-siderepo-create-two-pull-requests](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-create-two-pull-requests.md) | — | — | ❌ |
| [test-copilot-siderepo-link-sub-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-link-sub-issue.md) | — | — | ❌ |
| [test-copilot-siderepo-mcp](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-mcp.md) | — | — | ❌ |
| [test-copilot-siderepo-push-to-pull-request-branch-using-dispatch](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-push-to-pull-request-branch-using-dispatch.md) | — | — | ❌ |
| [test-copilot-siderepo-sparse-create-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-sparse-create-pull-request.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077995698) |
| [test-copilot-siderepo-sparse-push-to-pull-request-branch-using-dispatch](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-sparse-push-to-pull-request-branch-using-dispatch.md) | — | — | ❌ |
| [test-copilot-siderepo-subdir-create-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-subdir-create-pull-request.md) | — | — | ❌ |
| [test-copilot-siderepo-update-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-siderepo-update-issue.md) | — | — | ❌ |
| [test-copilot-update-release](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-update-release.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077997416) |
| [test-copilot-upload-asset](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-upload-asset.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077996198) |
| [test-copilot-upload-code-coverage](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-upload-code-coverage.md) | — | — | [❌](https://github.com/githubnext/gh-aw-test/actions/runs/35077994692) |

## ✅ Test successes — samples mode

| test | [v0.88.7](https://github.com/github/gh-aw/releases/tag/v0.88.7) | [v0.89.15](https://github.com/github/gh-aw/releases/tag/v0.89.15) | [main](https://github.com/github/gh-aw/commit/0fea86e1185f) |
| :--- | :---: | :---: | :---: |
| [test-claude-create-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-claude-create-issue.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902920) |
| [test-codex-create-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-codex-create-issue.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902523) |
| [test-copilot-add-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-add-comment.md) | — | — | ✅ |
| [test-copilot-add-discussion-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-add-discussion-comment.md) | — | — | ✅ |
| [test-copilot-add-labels](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-add-labels.md) | — | — | ✅ |
| [test-copilot-add-reviewer](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-add-reviewer.md) | — | — | ✅ |
| [test-copilot-assign-milestone](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-assign-milestone.md) | — | — | ✅ |
| [test-copilot-assign-to-agent](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-assign-to-agent.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076929555) |
| [test-copilot-assign-to-user](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-assign-to-user.md) | — | — | ✅ |
| [test-copilot-close-discussion](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-close-discussion.md) | — | — | ✅ |
| [test-copilot-close-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-close-issue.md) | — | — | ✅ |
| [test-copilot-close-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-close-pull-request.md) | — | — | ✅ |
| [test-copilot-command](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-command.md) | — | — | ✅ |
| [test-copilot-create-check-run](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-check-run.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902745) |
| [test-copilot-create-discussion](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-discussion.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902232) |
| [test-copilot-create-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-issue.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902762) |
| [test-copilot-create-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-pull-request.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902126) |
| [test-copilot-create-pull-request-review-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-pull-request-review-comment.md) | — | — | ✅ |
| [test-copilot-create-repository-code-scanning-alert](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-repository-code-scanning-alert.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902816) |
| [test-copilot-create-two-pull-requests](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-two-pull-requests.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075901863) |
| [test-copilot-custom-safe-outputs](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-custom-safe-outputs.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902443) |
| [test-copilot-dismiss-pull-request-review](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-dismiss-pull-request-review.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076936170) |
| [test-copilot-dispatch-workflow](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-dispatch-workflow.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076932070) |
| [test-copilot-gh-steps](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-gh-steps.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902045) |
| [test-copilot-hide-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-hide-comment.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076932401) |
| [test-copilot-inline-sub-agents](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-inline-sub-agents.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076929819) |
| [test-copilot-issue-intents](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-issue-intents.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076930079) |
| [test-copilot-link-sub-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-link-sub-issue.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076933454) |
| [test-copilot-mark-pull-request-as-ready-for-review](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-mark-pull-request-as-ready-for-review.md) | — | — | ✅ |
| [test-copilot-mcp-code-quality](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-mcp-code-quality.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075901893) |
| [test-copilot-network-isolation](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-network-isolation.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076929760) |
| [test-copilot-nosandbox-add-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-add-comment.md) | — | — | ✅ |
| [test-copilot-nosandbox-add-discussion-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-add-discussion-comment.md) | — | — | ✅ |
| [test-copilot-nosandbox-add-labels](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-add-labels.md) | — | — | ✅ |
| [test-copilot-nosandbox-command](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-command.md) | — | — | ✅ |
| [test-copilot-nosandbox-create-pull-request-review-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-create-pull-request-review-comment.md) | — | — | ✅ |
| [test-copilot-nosandbox-push-to-pull-request-branch](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-push-to-pull-request-branch.md) | — | — | ✅ |
| [test-copilot-nosandbox-update-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-nosandbox-update-issue.md) | — | — | ✅ |
| [test-copilot-push-to-pull-request-branch-using-dispatch](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-push-to-pull-request-branch-using-dispatch.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076939290) |
| [test-copilot-push-to-pull-request-branch-using-slash-command](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-push-to-pull-request-branch-using-slash-command.md) | — | — | ✅ |
| [test-copilot-remove-labels](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-remove-labels.md) | — | — | ✅ |
| [test-copilot-replace-label](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-replace-label.md) | — | — | ✅ |
| [test-copilot-reply-to-pull-request-review-comment](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-reply-to-pull-request-review-comment.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076945533) |
| [test-copilot-report-incomplete](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-report-incomplete.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35077996240) |
| [test-copilot-resolve-pull-request-review-thread](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-resolve-pull-request-review-thread.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076942013) |
| [test-copilot-restore-memory-custom-job](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-restore-memory-custom-job.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902306) |
| [test-copilot-set-issue-field](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-set-issue-field.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076929084) |
| [test-copilot-set-issue-field-builtin-rejection](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-set-issue-field-builtin-rejection.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076929359) |
| [test-copilot-set-issue-type](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-set-issue-type.md) | — | — | ✅ |
| [test-copilot-skills-frontmatter](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-skills-frontmatter.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35075902641) |
| [test-copilot-submit-pull-request-review](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-submit-pull-request-review.md) | — | — | ✅ |
| [test-copilot-submit-pull-request-review-locked](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-submit-pull-request-review-locked.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35076939160) |
| [test-copilot-unassign-from-user](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-unassign-from-user.md) | — | — | ✅ |
| [test-copilot-update-discussion](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-update-discussion.md) | — | — | ✅ |
| [test-copilot-update-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-update-issue.md) | — | — | ✅ |
| [test-copilot-update-pull-request](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-update-pull-request.md) | — | — | ✅ |

## ✅ Test successes — inference mode

| test | [v0.88.7](https://github.com/github/gh-aw/releases/tag/v0.88.7) | [v0.89.15](https://github.com/github/gh-aw/releases/tag/v0.89.15) | [main](https://github.com/github/gh-aw/commit/0fea86e1185f) |
| :--- | :---: | :---: | :---: |
| [test-copilot-create-issue](https://github.com/githubnext/gh-aw-test/blob/main/.github/workflows/test-copilot-create-issue.md) | — | — | [✅](https://github.com/githubnext/gh-aw-test/actions/runs/35074766458) |

## 🤖 Agent triage prompt

Copy the block below into a coding agent (e.g. Copilot) to investigate the failures:

```text
You are triaging failures from the gh-aw-test E2E suite.
Run: https://github.com/githubnext/gh-aw-test/actions/runs/35074420446
Repository under test: github/gh-aw (the gh-aw CLI/compiler).
Test harness repository: githubnext/gh-aw-test (this repo; runner is e2e.sh).

Focus: gh-aw main (commit 0fea86e1185f), sampling = true (--use-samples; AI engine was NOT called).

Failed tests (main, samples=true):
- test-copilot-mcp run: https://github.com/githubnext/gh-aw-test/actions/runs/35075902335
- test-copilot-call-workflow run: https://github.com/githubnext/gh-aw-test/actions/runs/35076929568
- test-copilot-missing-tool run: https://github.com/githubnext/gh-aw-test/actions/runs/35077994430
- test-copilot-upload-code-coverage run: https://github.com/githubnext/gh-aw-test/actions/runs/35077994692
- test-copilot-nosandbox-create-discussion run: https://github.com/githubnext/gh-aw-test/actions/runs/35077995296
- test-copilot-nosandbox-custom-safe-outputs run: https://github.com/githubnext/gh-aw-test/actions/runs/35077995846
- test-copilot-siderepo-sparse-create-pull-request run: https://github.com/githubnext/gh-aw-test/actions/runs/35077995698
- test-copilot-nosandbox-create-pull-request run: https://github.com/githubnext/gh-aw-test/actions/runs/35077995726
- test-copilot-siderepo-create-issue run: https://github.com/githubnext/gh-aw-test/actions/runs/35077995661
- test-copilot-noop run: https://github.com/githubnext/gh-aw-test/actions/runs/35077995612
- test-copilot-nosandbox-create-issue run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996001
- test-copilot-siderepo-create-discussion run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996088
- test-copilot-nosandbox-create-repository-code-scanning-alert run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996180
- test-copilot-upload-asset run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996198
- test-copilot-missing-data run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996011
- test-copilot-nosandbox-create-two-pull-requests run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996399
- test-copilot-nosandbox-mcp run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996524
- test-copilot-siderepo-create-pull-request run: https://github.com/githubnext/gh-aw-test/actions/runs/35077996400
- test-copilot-update-release run: https://github.com/githubnext/gh-aw-test/actions/runs/35077997416
- test-copilot-siderepo-subdir-create-pull-request run:
- test-copilot-siderepo-sparse-push-to-pull-request-branch-using-dispatch run:
- test-copilot-siderepo-create-two-pull-requests run:
- test-copilot-siderepo-link-sub-issue run:
- test-copilot-siderepo-mcp run:
- test-copilot-siderepo-push-to-pull-request-branch-using-dispatch run:
- test-copilot-siderepo-create-pull-request-review-comment run:
- test-copilot-siderepo-add-discussion-comment run:
- test-copilot-siderepo-add-labels run:
- test-copilot-siderepo-add-comment run:
- test-copilot-siderepo-update-issue run:

Goal: for EACH failed test above, access the GitHub
Actions logs for the run above (and the per-entry artifacts e2e--samples-,
which contain e2e-test-*.log, e2e-output.log and fails.txt), determine the root
cause, and categorize the failure as exactly one of:

1. TRANSIENT — flaky/infra/network/rate-limit/timing; not a real defect.
Action: note it and recommend a re-run (./e2e.sh rerun).
2. TEST-FRAMEWORK BUG — a defect in this repo's harness (e2e.sh), a workflow
source file (.github/workflows/test-*.md), a sample, or CI config.
Action: propose a concrete fix (file + change) in githubnext/gh-aw-test.
3. GH-AW BUG — a defect in github/gh-aw itself (compiler output, runtime
engine behaviour, safe-output handling, etc.).
Action: open an issue in github/gh-aw with a minimal repro, the failing
test name, the gh-aw ref/mode/samples combination, and links to the
relevant log lines. Check for an existing open issue first and link it
instead of filing a duplicate.

Steps:
- Use 'gh run view --log' and 'gh run download ' to fetch logs/artifacts.
- Read AGENTS.md in githubnext/gh-aw-test for harness conventions before proposing fixes.
- Group failures by suspected root cause; the same gh-aw bug may explain several.
- Produce a table: test | category | root cause | recommended action | issue/PR link.
- Only open github/gh-aw issues for category 3, and only after confirming no duplicate exists.
```

## Previous status reports (closed by this run)
* #15996

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the linked GitHub Actions run and the failing sample workflows, such as .github/workflows/test-copilot-call-workflow.md and .github/workflows/test-copilot-mcp.md, then compare them with the passing samples. Identify the shared cause of the 30 failures and confirm the matrix completes with no failed test entries.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions, shell
Domain
ci-cd, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.