githubnext / githubnext/gh-aw-test

Suggested test: copilot/network-engine-domain-explicit-opt-in

Open
#12,914 0 comments 0 reactions 0 assignees View on GitHub
suggested new test
Dominant language
Shell
Stars
8
Forks
5
PR merge metrics
No merged PRs in 30d

Description

## Motivation

Link to the gh-aw PR: github/gh-aw#56447 — "Make engine domain sets explicit opt-in"

Compiler no longer auto-merges agent engine domain sets (e.g. `copilot`, `claude`, `codex`) into firewall allow-lists; workflows must reference them explicitly in `network.allowed`, like `defaults`/other domain sets. No existing test in `existing-tests.json` exercises `network.allowed` domain-set resolution or firewall behavior when the engine domain set is omitted vs included.

## Proposed test

- **Workflow file**: `test-copilot-network-engine-domain-opt-in.md`
- **Trigger**: `workflow_dispatch`
- **Engine**: copilot
- **Safe output**: `create-issue`
- **Variant**: standard

## Minimal test prompt sketch

Configure `network: { allowed: [defaults, copilot] }` explicitly in frontmatter, then have the agent make a trivial network-dependent action (or just report success) and create an issue confirming the firewall allowed the copilot domain set — verifying the explicit opt-in resolves correctly post-compile.

## New fixtures or secrets needed

None — reuses `githubnext/gh-aw-test`.

## Notes

Existing `test-copilot-network-isolation.md` tests default sandboxing/isolation but does not exercise the new explicit `network.allowed` engine-domain-set opt-in behavior. Worth confirming via `gh aw compile` that the lockfile firewall config differs based on whether `copilot` is listed.

> Generated by [🔍 Suggest New E2E Tests](https://github.com/githubnext/gh-aw-test/actions/runs/33170338931) · copilot · auto · 22.6 AIC · ⌖ 3.81 AIC · ⊞ 8.8K · [◷](https://github.com/search?q=repo%3Agithubnext%2Fgh-aw-test+is%3Aissue+%22gh-aw-workflow-call-id%3A+githubnext%2Fgh-aw-test%2Fsuggest-new-e2e-tests%22&type=issues)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the proposed test-copilot-network-engine-domain-opt-in.md and compare it with test-copilot-network-isolation.md. Run gh aw compile for workflows with and without copilot in network.allowed, then inspect the lockfile firewall configuration. Done means the explicit copilot domain set resolves and the test confirms the expected firewall behavior without new fixtures or secrets.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions, markdown
Domain
ci-cd, networking, testing-qa
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
76/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.