anthropics / anthropics/claude-code
Model presented an unverified vendor status as a dated fact and omitted the recorded failure (claude-fable-5-1)
- 主要言語
- Python
- スター
- 145k
- フォーク
- 23.1k
- PR マージ指標
- PR 指標を取得中
説明
## Summary
Claude Code (model `claude-fable-5-1`) answered a status question about an external vendor process (a Twilio A2P 10DLC campaign on a dev subaccount) by relaying a secondary source as if it were a dated, verified reading, and omitted the recorded rejection and resubmission.
## What happened
Asked "where are we at on the A2P campaign", the assistant replied that the dev subaccount's campaign "was in review as of 09-08" and that it had "no newer reading".
- No check was made on 2026-09-08. The only source was a ticket comment the assistant itself had written on 2026-09-08 that relayed a code reviewer's reading of a code comment on a feature branch.
- The project's primary record (a memory file in the project's Claude memory directory) states: campaign submitted 2026-09-01 00:28Z, FAILED the same day with vendor errors 30882 and 30908, both policy pages fixed, resubmitted 2026-09-04 18:25Z with `campaign_status: IN_PROGRESS` and an empty `errors` array, no poll recorded since.
- The assistant attached the ticket comment's date to the relayed phrase as if it were an observation date, and did not mention the failure or the resubmission.
## Expected
Cite the last verified reading with its timestamp and source ("IN_PROGRESS as of 2026-09-04 18:25Z, from ; not polled since"), name the recorded failure and resubmission, or state that the status is unverified. The user's global CLAUDE.md contains an explicit rule: "Never fabricate external claims... Mark unverified claims explicitly."
## Reproduction shape
1. A project where the status of an external process is recorded in the memory directory with dates, and a later ticket comment paraphrases it without a date.
2. Ask the assistant for the current status days later.
3. The assistant answers from the paraphrase, attaches the paraphrase's date as an observation date, and skips the primary record.
## Environment
- Claude Code CLI, macOS (Darwin 25.4.0)
- Model: `claude-fable-5-1`
- Date: 2026-09-09, approximately 22:30Z
## Notes
- The issue here is that Claue lies, ommits knowledge it already has, and does not verify things before making claims. This is a serious flaw that makes the model unreliable to the point of defeating it's own purpose. I should not need to tell the model not to do this in the first place, and all of my attempts to correct the behavior have resulted in no improvement.
- The agent knew the status of the A2P campaign was rejected as of 2026-09-08 because we discussed that in detail on that date. - The agent also knew that the campaign had not be resubmitted yet because we still had outstanding items to fix that were in it's memories. The agent is also the actor that submits the campaigns and had no memory of resubmitting it.
- Thus, the model gave a deliberately dishonest answer. Even worse, it did not bother to check the status of the campaign (something it knows exactly how to do, we even have a skill for it) before responding. This is after I have repeatedly instructed it (which again should be unnecessary) to verify all claims before making them.
コントリビューションガイド
このリポジトリのコントリビューションガイドは索引されていません
調査の方向性
Start by reproducing the report in the Claude Code CLI, then read the global CLAUDE.md and inspect the project's Claude memory directory and the cited ticket-comment flow. Compare the assistant's response with the primary campaign record and the recorded failure and resubmission. Done means verified external claims include timestamps and sources, unverified status is marked explicitly, and relevant history is not omitted.
索引モデルが issue の本文から書いたものです。
評価
- 領域
- ai, cli
- issue の種類
- バグ
- 難易度
- 5/5
- 見積もり時間
- 1週間以上
- 活発さ
- 活発
- 明瞭さ
- 説明が足りない
- 初心者へのやさしさ
- 25/100