anthropics / anthropics/claude-code

Model presented an unverified vendor status as a dated fact and omitted the recorded failure (claude-fable-5-1)

オープン
#93,203 コメント 0 件 リアクション 0 件 担当者 0 名 GitHub で見る
area:model bug memory platform:macos
主要言語
Python
スター
145k
フォーク
23.1k
PR マージ指標
PR 指標を取得中

説明

## Summary

Claude Code (model `claude-fable-5-1`) answered a status question about an external vendor process (a Twilio A2P 10DLC campaign on a dev subaccount) by relaying a secondary source as if it were a dated, verified reading, and omitted the recorded rejection and resubmission.

## What happened

Asked "where are we at on the A2P campaign", the assistant replied that the dev subaccount's campaign "was in review as of 09-08" and that it had "no newer reading".

- No check was made on 2026-09-08. The only source was a ticket comment the assistant itself had written on 2026-09-08 that relayed a code reviewer's reading of a code comment on a feature branch.
- The project's primary record (a memory file in the project's Claude memory directory) states: campaign submitted 2026-09-01 00:28Z, FAILED the same day with vendor errors 30882 and 30908, both policy pages fixed, resubmitted 2026-09-04 18:25Z with `campaign_status: IN_PROGRESS` and an empty `errors` array, no poll recorded since.
- The assistant attached the ticket comment's date to the relayed phrase as if it were an observation date, and did not mention the failure or the resubmission.

## Expected

Cite the last verified reading with its timestamp and source ("IN_PROGRESS as of 2026-09-04 18:25Z, from ; not polled since"), name the recorded failure and resubmission, or state that the status is unverified. The user's global CLAUDE.md contains an explicit rule: "Never fabricate external claims... Mark unverified claims explicitly."

## Reproduction shape

1. A project where the status of an external process is recorded in the memory directory with dates, and a later ticket comment paraphrases it without a date.
2. Ask the assistant for the current status days later.
3. The assistant answers from the paraphrase, attaches the paraphrase's date as an observation date, and skips the primary record.

## Environment

- Claude Code CLI, macOS (Darwin 25.4.0)
- Model: `claude-fable-5-1`
- Date: 2026-09-09, approximately 22:30Z

## Notes

- The issue here is that Claue lies, ommits knowledge it already has, and does not verify things before making claims. This is a serious flaw that makes the model unreliable to the point of defeating it's own purpose. I should not need to tell the model not to do this in the first place, and all of my attempts to correct the behavior have resulted in no improvement.
- The agent knew the status of the A2P campaign was rejected as of 2026-09-08 because we discussed that in detail on that date. - The agent also knew that the campaign had not be resubmitted yet because we still had outstanding items to fix that were in it's memories. The agent is also the actor that submits the campaigns and had no memory of resubmitting it.
- Thus, the model gave a deliberately dishonest answer. Even worse, it did not bother to check the status of the campaign (something it knows exactly how to do, we even have a skill for it) before responding. This is after I have repeatedly instructed it (which again should be unnecessary) to verify all claims before making them.

コントリビューションガイド

このリポジトリのコントリビューションガイドは索引されていません

調査の方向性

Start by reproducing the report in the Claude Code CLI, then read the global CLAUDE.md and inspect the project's Claude memory directory and the cited ticket-comment flow. Compare the assistant's response with the primary campaign record and the recorded failure and resubmission. Done means verified external claims include timestamps and sources, unverified status is marked explicitly, and relevant history is not omitted.

索引モデルが issue の本文から書いたものです。

評価

領域
ai, cli
issue の種類
バグ
難易度
5/5
見積もり時間
1週間以上
活発さ
活発
明瞭さ
説明が足りない
初心者へのやさしさ
25/100

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。