open-telemetry / open-telemetry/shared-workflows

Migrate PR dashboard classifiers to Copilot SDK empty mode

Open
#381 0 comments 0 reactions 1 assignee View on GitHub

@trask is already working on this.

Since Sep 16, 2026.

Dominant language
No language data
Stars
7
Forks
18
Avg merge
22h 1m
Merged PRs (30d)
75

Description

Migrate the PR dashboard's Luna classification runner from copilot -p to the Copilot SDK.

The scanner measurement reduced one representative classification from 12,627 input tokens and 0.32634 AI credits to 1,340 input tokens and 0.04432 credits while keeping Copilot billing. The dashboard should get similar per-batch savings and a tighter boundary around untrusted PR text.

Acceptance criteria:

  • Keep one SDK client alive per dashboard job and create a fresh session for each classification batch.
  • Use mode="empty", available_tools=[], isolated temporary storage, and a replacement system message.
  • Put trusted classification policy in the system message and untrusted PR content in the user message.
  • Keep the existing GITHUB_TOKEN authentication with copilot-requests: write and organization billing.
  • Preserve batching, classification caching, strict output validation, fallback behavior, and diagnostics.
  • Compare Copilot OpenTelemetry before and after the migration, including input, output, cache tokens, AI credits, latency, and failures.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.