anthropics / anthropics/claude-code

First-class "adversarial-verify + live-source check" review mode for multi-agent workflows

Aperta
#91,045 1 commento 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Python
Stelle
145k
Fork
23.1k
Metriche di merge delle PR
Metriche PR in attesa

Descrizione

**Type:** enhancement · **Area:** multi-agent workflows / verification patterns

### Motivation
A repeatedly high-value workflow shape is: **produce, then adversarially verify against the source of truth.** Concretely, in a codebase audit:
1. A "mapper" agent extracts claims (invariants, risks, behaviors) from code + history + docs.
2. A separate "verifier" agent is instructed to *refute* each claim by opening the actual files.
3. Claims that survive are confirmed; claims marked `needs-live-db` are settled by read-only queries against the running system.

In real runs this caught defects the mapper asserted confidently, **and** corrected the verifier itself — a claim derived from static source (a migration file) was wrong about the live system, and only the read-only production check surfaced the truth. Neither single agent, and no static-only pass, would have caught it.

### Proposed feature
A documented, first-class pattern / helper for "generate → adversarial-verify → live-source settle," including:
- a verifier role prompt template that defaults to skepticism (refute-by-default, cite `file:line`),
- a structured verdict schema (`confirmed` / `refuted` / `partly-true` / `needs-live-db`),
- guidance/guardrails for a **read-only** live-source settle step (e.g. enforced read-only transactions) so verification against a running system is safe by construction.

### Why it helps everyone
"One agent confidently produces a plausible-but-wrong artifact" is the central failure mode of LLM automation. Making adversarial verification a supported, low-friction mode — rather than something each author hand-rolls — raises the floor on trustworthiness for audits, reviews, migrations, and research.

*Filed from real multi-agent workflow usage.*

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Direzione di ricerca

The issue names no files or tests; start by getting maintainer agreement on whether this should be a documented pattern, a helper, or both. Use the proposed pieces as acceptance criteria: skeptical verifier prompt citing file:line, structured verdict schema, and read-only live-source guardrails. Done means the workflow is first-class and documented with safe settle behavior.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
ai-infra-agents, python
Ambito
ai-infra-agents, developer-experience, documentation
Tipo di issue
Funzionalità
Difficoltà
5/5
Tempo stimato
Più di una settimana
Stato di attività
Attiva
Chiarezza
Abbastanza chiara
Idoneità per principianti
28/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.