githubnext / githubnext/gh-aw-test

Suggested test: copilot/sandbox-token-steering-opt-out

Closed Beginner friendly
#11,100 0 comments 0 reactions 0 assignees View on GitHub
[suggested new test] suggested new test
Dominant language
Shell
Stars
8
Forks
5
PR merge metrics
No merged PRs in 30d

Description

## Motivation

github/gh-aw#50122 — Add AWF token steering frontmatter opt-out (`sandbox.agent.token-steering: false`)

## Proposed test

- **Workflow file**: `test-copilot-sandbox-token-steering.md`
- **Trigger**: `workflow_dispatch`
- **Engine**: copilot
- **Safe output**: `create-issue` (or `noop`) — the frontmatter field itself is the thing under test, not a specific safe output
- **Variant**: standard

## Minimal test prompt sketch

Set `sandbox.agent.token-steering: false` in frontmatter and confirm the workflow compiles and runs, emitting `apiProxy.enableTokenSteering: false` in the generated AWF config. Prompt body can be trivial (e.g. emit a noop message) since the interesting assertion is on the compiled lock file / AWF config, not agent behavior.

## New fixtures or secrets needed

None. Uses existing `githubnext/gh-aw-test` fixture.

## Notes

This is a compiler/config-emission feature more than a runtime behavior difference, so the e2e assertion may need to inspect the generated `.lock.yml` for `enableTokenSteering: false` rather than relying purely on safe-output content. Not present in `existing-tests.json` or `open-suggestions.json`.

> Generated by [🔍 Suggest New E2E Tests](https://github.com/githubnext/gh-aw-test/actions/runs/30896082598) · auto · 36.6 AIC · ⌖ 3.13 AIC · ⊞ 8.3K · [◷](https://github.com/search?q=repo%3Agithubnext%2Fgh-aw-test+is%3Aissue+%22gh-aw-workflow-call-id%3A+githubnext%2Fgh-aw-test%2Fsuggest-new-e2e-tests%22&type=issues)

Contributor guide

No contributing guide indexed for this repository

Research direction

Create `test-copilot-sandbox-token-steering.md` with a `workflow_dispatch` trigger, the copilot engine, the standard variant, and the existing `githubnext/gh-aw-test` fixture. Run the workflow with `sandbox.agent.token-steering: false`, then inspect the generated `.lock.yml` or AWF config to confirm `apiProxy.enableTokenSteering: false`.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions
Domain
ci-cd, testing
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Clearly specified
Newbie friendliness
76/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.