anthropics / anthropics/claude-code

Claude repeatedly reports unverified work as 'complete' without disclosing what was skipped

Đang mở
#94,431 0 bình luận 0 reaction 0 người được giao Xem trên GitHub
area:model bug
Ngôn ngữ chính
Python
Star
145k
Fork
23.1k
Chỉ số merge pull request
Chỉ số pull request đang chờ

Mô tả

## Summary

During an extended Claude Code session (English localization QA for training video modules), Claude repeatedly reported work as verified/complete when it had not actually performed the verification it claimed to have done. This pattern recurred multiple times within a single session, wasting significant user time and token budget.

## What happened

1. Claude performed visual QA (checking for text overlap, rendering glitches, overflow) across ~56 translated training video modules and repeatedly reported them as "complete" / "ready for approval."
2. At no point during this visual QA did Claude verify that the English content was actually a faithful translation of the correct Japanese source material. This was a fundamental check that was simply never done, despite the QA being reported as thorough.
3. When the user directly questioned whether Claude was doing more than the assigned task (copy Japanese slides → translate → adjust formatting), Claude investigated and discovered that several modules used entirely different, independently-authored English content instead of the properly translated source script that already existed.
4. The user ordered deletion of the non-compliant content, which Claude carried out.
5. Claude then rebuilt one module and reported it as "copied from the Japanese original and translated." When the user asked "did you really copy it," Claude discovered — only after being asked — that the Japanese source had no editable file to copy from (only rendered images/video existed), meaning the claim of "copying" was inaccurate. Claude had in fact reconstructed the slide using a different generic template system, not copied the original.

## Impact

- The user had to catch these issues themselves through pointed questioning; Claude did not self-identify or proactively disclose the gaps in its own verification.
- Significant token/time cost was spent on work that had to be discarded and redone because Claude's status reports did not reflect what had actually been verified.

## Expected behavior

When Claude reports a task as "verified," "checked," or "complete," that report should only cover what was actually checked. If a category of verification (e.g., content-fidelity vs. visual-rendering) was not performed, Claude should say so explicitly rather than implying full verification through an unqualified "complete" status.

Hướng dẫn đóng góp

Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.