anthropics / anthropics/claude-code

First-class "adversarial-verify + live-source check" review mode for multi-agent workflows

Open
#91,045 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
145k
Forks
23.1k
PR merge metrics
PR metrics pending

Description

**Type:** enhancement · **Area:** multi-agent workflows / verification patterns

### Motivation
A repeatedly high-value workflow shape is: **produce, then adversarially verify against the source of truth.** Concretely, in a codebase audit:
1. A "mapper" agent extracts claims (invariants, risks, behaviors) from code + history + docs.
2. A separate "verifier" agent is instructed to *refute* each claim by opening the actual files.
3. Claims that survive are confirmed; claims marked `needs-live-db` are settled by read-only queries against the running system.

In real runs this caught defects the mapper asserted confidently, **and** corrected the verifier itself — a claim derived from static source (a migration file) was wrong about the live system, and only the read-only production check surfaced the truth. Neither single agent, and no static-only pass, would have caught it.

### Proposed feature
A documented, first-class pattern / helper for "generate → adversarial-verify → live-source settle," including:
- a verifier role prompt template that defaults to skepticism (refute-by-default, cite `file:line`),
- a structured verdict schema (`confirmed` / `refuted` / `partly-true` / `needs-live-db`),
- guidance/guardrails for a **read-only** live-source settle step (e.g. enforced read-only transactions) so verification against a running system is safe by construction.

### Why it helps everyone
"One agent confidently produces a plausible-but-wrong artifact" is the central failure mode of LLM automation. Making adversarial verification a supported, low-friction mode — rather than something each author hand-rolls — raises the floor on trustworthiness for audits, reviews, migrations, and research.

*Filed from real multi-agent workflow usage.*

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files or tests; start by getting maintainer agreement on whether this should be a documented pattern, a helper, or both. Use the proposed pieces as acceptance criteria: skeptical verifier prompt citing file:line, structured verdict schema, and read-only live-source guardrails. Done means the workflow is first-class and documented with safe settle behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
ai-infra-agents, python
Domain
ai-infra-agents, developer-experience, documentation
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.