github / github/gh-aw

[model-resolution] Daily model-resolution audit — no mismatches in sampled runs

Closed
#61,050 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
5.1k
Forks
541
Avg merge
5h 48m
Merged PRs (30d)
773

Description

### 🔬 Sub-Agent Model Resolution Audit — 2026-09-15

**Period**: last 2 days · **Runs analyzed**: 30 · **With sub-agents**: 23

---

### ⚠️ Mismatches Found (0 total)

| Workflow | Sub-agent | Declared | Actual Model | Status |
|---|---|---|---|---|
| — | — | — | — | No clear size mismatches observed in the sampled runs |

---

### ✅ Correct Resolutions

| Workflow | Declared | Observed |
|---|---|---|
| GitHub Remote MCP Authentication Test | `copilot/gpt-5.3-codex` | `gpt-5.3-codex` |
| Schema Consistency Checker | `openai/gpt-5.3-codex` | `gpt-5.3-codex` |
| CLI Version Checker | `copilot/gpt-5.4` | `gpt-5.4` |
| PR Sous Chef | `openai/gpt-5.4` | `gpt-5.4-2026-03-05` |
| Sighthound Security Scan | `copilot/gpt-5.3-codex` | `gpt-5.3-codex` |
| Issue Arborist | `openai/gpt-5.3-codex` | `gpt-5.3-codex` |
| Daily Windows Terminal Integration Builder | `copilot/gpt-5.3-codex` | `gpt-5.3-codex` |
| Daily Go Test Parallelizer | `copilot/gpt-5.3-codex` | `gpt-5.3-codex` |
| Impeccable Skills Reviewer | `claude-sonnet-5` | `claude-sonnet-5` |
| Matt Pocock Skills Reviewer | `claude-sonnet-5` | `claude-sonnet-5` |
| Daily GitHub Docs SEO Optimizer | `gpt-5.4` | `gpt-5.4` |

---

### 📋 Analysis Notes

- 4 sampled runs had no sub-agent activity.
- 3 sampled runs produced no audit payload and were skipped from resolution checks.
- The remaining sampled workflows either used explicit large-model declarations or lacked an explicit model declaration; no size-class mismatch was confirmed.
- Confidence: high for runs with explicit `model:` lines and token-usage entries; unknown for workflows without explicit model declarations.

> [!WARNING]
>
> Firewall blocked 1 domain
>
> The following domain was blocked by the firewall during workflow execution:
>
> - `api.github.com`
>
> [!TIP]
> `api.github.com` is blocked because GitHub API access uses the built-in GitHub tools by default. Instead of adding `api.github.com` to `network.allowed`, use `tools.github.mode: gh-proxy` for direct pre-authenticated GitHub CLI access without requiring network access to `api.github.com`:
>
> ```yaml
> tools:
> github:
> mode: gh-proxy
> ```
>
> See [GitHub Tools](https://github.github.com/gh-aw/reference/github-tools/) for more information on `gh-proxy` mode.
>
> To allow these domains, add them to the `network.allowed` list in your workflow frontmatter:
>
> ```yaml
> network:
> allowed:
> - defaults
> - "api.github.com"
> ```
>
> See [Network Configuration](https://github.github.com/gh-aw/reference/network/) for more information.
>
>

> Generated by [🔬 Daily Sub-Agent Model Resolution Audit](https://github.com/github/gh-aw/actions/runs/34933078206) · copilot · gpt54mini · 80.4 AIC · ⊞ 18.2K · [◷](https://github.com/search?q=repo%3Agithub%2Fgh-aw+is%3Aissue+%22gh-aw-workflow-call-id%3A+github%2Fgh-aw%2Fdaily-model-resolution%22&type=issues)
> - [x] expires on Sep 17, 2026, 9:56 PM UTC-08:00

Contributor guide

Open the contributing guide

Research direction

This issue is an automated audit report and does not identify a requested change, source file, or test. Start by confirming whether a model-resolution mismatch or follow-up action is intended; the work is complete only when a concrete scope and validation method are defined.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions
Domain
ci-cd, observability
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.