open-telemetry / open-telemetry/shared-workflows
Migrate PR dashboard classifiers to Copilot SDK empty mode
Open
@trask is already working on this.
Since Sep 16, 2026.
- Dominant language
- No language data
- Stars
- 7
- Forks
- 18
- Avg merge
- 22h 1m
- Merged PRs (30d)
- 75
Description
Migrate the PR dashboard's Luna classification runner from copilot -p to the Copilot SDK.
The scanner measurement reduced one representative classification from 12,627 input tokens and 0.32634 AI credits to 1,340 input tokens and 0.04432 credits while keeping Copilot billing. The dashboard should get similar per-batch savings and a tighter boundary around untrusted PR text.
Acceptance criteria:
- Keep one SDK client alive per dashboard job and create a fresh session for each classification batch.
- Use
mode="empty",available_tools=[], isolated temporary storage, and a replacement system message. - Put trusted classification policy in the system message and untrusted PR content in the user message.
- Keep the existing
GITHUB_TOKENauthentication withcopilot-requests: writeand organization billing. - Preserve batching, classification caching, strict output validation, fallback behavior, and diagnostics.
- Compare Copilot OpenTelemetry before and after the migration, including input, output, cache tokens, AI credits, latency, and failures.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.