githubnext / githubnext/gh-aw-test

Suggested test: copilot/lazy-skill-blocks

Closed Beginner friendly
#8,304 0 comments 0 reactions 0 assignees View on GitHub
suggested new test
Dominant language
Shell
Stars
8
Forks
5
PR merge metrics
No merged PRs in 30d

Description

## Motivation

Link to the gh-aw PR: github/gh-aw#46969 — feat(copilot-opt): reduce first-turn context size with lazy skill blocks and pre-agent guards

This change introduced lazy-load `## skill:` blocks in workflow source files that are stripped from the initial system message and only loaded on demand. The existing test-copilot-skills-frontmatter.md only tests skills declared via the `skills:` frontmatter field, not inline `## skill:` prompt blocks.

## Proposed test

- **Workflow file**: `test-copilot-inline-skill-block.md`
- **Trigger**: `workflow_dispatch`
- **Engine**: copilot
- **Safe output**: `create-issue`
- **Variant**: standard

## Minimal test prompt sketch

Define a workflow with an inline `## skill: my-skill` block containing a small instruction set. The main prompt asks the agent to invoke the skill by name and confirm it received the skill content. The agent creates an issue whose body confirms the skill block was accessible at runtime (not stripped).

## New fixtures or secrets needed

None — inline skill blocks are defined in the workflow source file itself, requiring no external fixture or secret.

## Notes

The test-copilot-skills-frontmatter.md tests externally-referenced skills (GitHub-hosted). This would be the first test for inline skill block parsing and lazy-load behavior. Overlaps conceptually with test-copilot-inline-sub-agents.md but exercises a different feature (skill lazy-load vs. sub-agent dispatch).

> [!WARNING]
>
> Firewall blocked 1 domain
>
> The following domain was blocked by the firewall during workflow execution:
>
> - `awmgmcpg`
>> To allow these domains, add them to the `network.allowed` list in your workflow frontmatter:
>
> ```yaml
> network:
> allowed:
> - defaults
> - "awmgmcpg"
> ```
>
> See [Network Configuration](https://github.github.com/gh-aw/reference/network/) for more information.
>
>

> Generated by [🔍 Suggest New E2E Tests](https://github.com/githubnext/gh-aw-test/actions/runs/29817660169) · 27.7 AIC · ⌖ 5.71 AIC · ⊞ 5.7K · [◷](https://github.com/search?q=repo%3Agithubnext%2Fgh-aw-test+is%3Aissue+%22gh-aw-workflow-call-id%3A+githubnext%2Fgh-aw-test%2Fsuggest-new-e2e-tests%22&type=issues)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with test-copilot-skills-frontmatter.md and test-copilot-inline-sub-agents.md as nearby examples. Add test-copilot-inline-skill-block.md with a workflow_dispatch trigger, copilot engine, standard variant, and create-issue safe output. Done means the workflow’s issue body confirms the inline skill content was available at runtime.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions
Domain
ci-cd, testing
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Clearly specified
Newbie friendliness
78/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.