anthropics / anthropics/claude-code

Model presented an unverified vendor status as a dated fact and omitted the recorded failure (claude-fable-5-1)

Abierto
#93,203 0 comentarios 0 reacciones 0 asignados Ver en GitHub
area:model bug memory platform:macos
Lenguaje dominante
Python
Estrellas
145k
Forks
23.1k
Métricas de merge de PR
Métricas de PR pendientes

Descripción

## Summary

Claude Code (model `claude-fable-5-1`) answered a status question about an external vendor process (a Twilio A2P 10DLC campaign on a dev subaccount) by relaying a secondary source as if it were a dated, verified reading, and omitted the recorded rejection and resubmission.

## What happened

Asked "where are we at on the A2P campaign", the assistant replied that the dev subaccount's campaign "was in review as of 09-08" and that it had "no newer reading".

- No check was made on 2026-09-08. The only source was a ticket comment the assistant itself had written on 2026-09-08 that relayed a code reviewer's reading of a code comment on a feature branch.
- The project's primary record (a memory file in the project's Claude memory directory) states: campaign submitted 2026-09-01 00:28Z, FAILED the same day with vendor errors 30882 and 30908, both policy pages fixed, resubmitted 2026-09-04 18:25Z with `campaign_status: IN_PROGRESS` and an empty `errors` array, no poll recorded since.
- The assistant attached the ticket comment's date to the relayed phrase as if it were an observation date, and did not mention the failure or the resubmission.

## Expected

Cite the last verified reading with its timestamp and source ("IN_PROGRESS as of 2026-09-04 18:25Z, from ; not polled since"), name the recorded failure and resubmission, or state that the status is unverified. The user's global CLAUDE.md contains an explicit rule: "Never fabricate external claims... Mark unverified claims explicitly."

## Reproduction shape

1. A project where the status of an external process is recorded in the memory directory with dates, and a later ticket comment paraphrases it without a date.
2. Ask the assistant for the current status days later.
3. The assistant answers from the paraphrase, attaches the paraphrase's date as an observation date, and skips the primary record.

## Environment

- Claude Code CLI, macOS (Darwin 25.4.0)
- Model: `claude-fable-5-1`
- Date: 2026-09-09, approximately 22:30Z

## Notes

- The issue here is that Claue lies, ommits knowledge it already has, and does not verify things before making claims. This is a serious flaw that makes the model unreliable to the point of defeating it's own purpose. I should not need to tell the model not to do this in the first place, and all of my attempts to correct the behavior have resulted in no improvement.
- The agent knew the status of the A2P campaign was rejected as of 2026-09-08 because we discussed that in detail on that date. - The agent also knew that the campaign had not be resubmitted yet because we still had outstanding items to fix that were in it's memories. The agent is also the actor that submits the campaigns and had no memory of resubmitting it.
- Thus, the model gave a deliberately dishonest answer. Even worse, it did not bother to check the status of the campaign (something it knows exactly how to do, we even have a skill for it) before responding. This is after I have repeatedly instructed it (which again should be unnecessary) to verify all claims before making them.

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Línea de trabajo

Start by reproducing the report in the Claude Code CLI, then read the global CLAUDE.md and inspect the project's Claude memory directory and the cited ticket-comment flow. Compare the assistant's response with the primary campaign record and the recorded failure and resubmission. Done means verified external claims include timestamps and sources, unverified status is marked explicitly, and relevant history is not omitted.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Área
ai, cli
Tipo de issue
Error
Dificultad
5/5
Tiempo estimado
Más de una semana
Estado de actividad
Activo
Claridad
Necesita aclaración
Aptitud para principiantes
25/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.