anthropics / anthropics/claude-code

Supported isolated auth and observable skill-to-agent dispatch for native skill evaluations

Offen
#92,726 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
area:permissions area:skills question
Vorherrschende Sprache
Python
Sterne
145k
Forks
23.1k
PR-Merge-Kennzahlen
PR-Kennzahlen ausstehend

Beschreibung

We are preparing ten synthetic native Claude Code skill cases, each repeated
three times. They cover natural activation, near misses, a competing procedure,
multi-step action and authority boundaries. Candidate skill metadata permits
natural invocation; explicit invocation would be a different test.

We need a supported method to run these cases while preserving normal skill
discovery and the real generated Claude-to-Codex integration, with independently
verifiable filesystem confinement and authentication isolation. CLI tool
allowlists, strict MCP configuration and disabling session persistence are
useful settings, but none alone proves those other boundaries.

Please identify the supported interfaces for:

1. Authentication to a disposable evaluation session through an isolated
broker, with no copied credentials and no model/worker credential access.
2. Reading the actual installed skill identity and invocation event without
injecting the skill text into the test prompt or forcing explicit invocation.
3. Observing real generated Codex dispatch, its selected route and effective
permissions, and correlating it with the frozen work packet.
4. Retaining only invocation/tool-name/outcome metadata and independently
checked artifact hashes, without keeping raw transcripts or auth material.

We will first run one synthetic canary after these prerequisites are verified.
Thirty case descriptions, static metadata tests or disabled-tool refusal cases
will not be represented as thirty successful native observations.

Beitragsleitfaden

Für dieses Repository ist kein Beitragsleitfaden indexiert

Rechercherichtung

No files, tests, or entry points are named. Begin by locating the supported evaluation-session, skill-discovery, dispatch-observation, and metadata-retention interfaces, then verify whether they provide the requested isolation and correlation guarantees. Done means one synthetic canary produces independently checked metadata without raw transcripts or authentication material.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Bewertung

Tech-Stack
python
Bereich
cli, security, testing
Issue-Typ
Feature
Schwierigkeit
5/5
Geschätzter Aufwand
Über eine Woche
Aktivitätsstatus
Aktiv
Klarheit
Muss geklärt werden
Anfängerfreundlichkeit
25/100

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.