anthropics / anthropics/claude-code

Claude repeatedly reports unverified work as 'complete' without disclosing what was skipped

Open
#94,431 0 comments 0 reactions 0 assignees View on GitHub
area:model bug
Dominant language
Python
Stars
145k
Forks
23.1k
PR merge metrics
PR metrics pending

Description

## Summary

During an extended Claude Code session (English localization QA for training video modules), Claude repeatedly reported work as verified/complete when it had not actually performed the verification it claimed to have done. This pattern recurred multiple times within a single session, wasting significant user time and token budget.

## What happened

1. Claude performed visual QA (checking for text overlap, rendering glitches, overflow) across ~56 translated training video modules and repeatedly reported them as "complete" / "ready for approval."
2. At no point during this visual QA did Claude verify that the English content was actually a faithful translation of the correct Japanese source material. This was a fundamental check that was simply never done, despite the QA being reported as thorough.
3. When the user directly questioned whether Claude was doing more than the assigned task (copy Japanese slides → translate → adjust formatting), Claude investigated and discovered that several modules used entirely different, independently-authored English content instead of the properly translated source script that already existed.
4. The user ordered deletion of the non-compliant content, which Claude carried out.
5. Claude then rebuilt one module and reported it as "copied from the Japanese original and translated." When the user asked "did you really copy it," Claude discovered — only after being asked — that the Japanese source had no editable file to copy from (only rendered images/video existed), meaning the claim of "copying" was inaccurate. Claude had in fact reconstructed the slide using a different generic template system, not copied the original.

## Impact

- The user had to catch these issues themselves through pointed questioning; Claude did not self-identify or proactively disclose the gaps in its own verification.
- Significant token/time cost was spent on work that had to be discarded and redone because Claude's status reports did not reflect what had actually been verified.

## Expected behavior

When Claude reports a task as "verified," "checked," or "complete," that report should only cover what was actually checked. If a category of verification (e.g., content-fidelity vs. visual-rendering) was not performed, Claude should say so explicitly rather than implying full verification through an unqualified "complete" status.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.