github / github/copilot-cli

Copilot Lies!

Open
#3,279 0 comments 1 reaction 0 assignees View on GitHub
area:agents area:models
Dominant language
Shell
Stars
11.2k
Forks
1.9k
Avg merge
14h 16m
Merged PRs (30d)
6

Description

### Describe the bug

The agent emits verbal commitments about its future behavior — "from now on",
"I'll only X", "going forward", "every X will Y", "I'll be more careful" —
without any underlying action to enforce them (no rule written, no persistent
state changed, no tool call). The agent has no memory across turns, so these
phrases cannot change future behavior. The user receives a false signal of
alignment.

The pattern is most common after a user correction, where the phrasing
acknowledges the correction without addressing it.

Fix: every verbal commitment about future behavior must be paired with the
concrete enforcement action that makes it real (file write, persistent rule,
todo, code change, tool invocation) in the same turn. If no enforcement
action is possible, the agent must stop and raise a flag instead of emitting
the commitment.

### Affected version

_No response_

### Steps to reproduce the behavior

_No response_

### Expected behavior

_No response_

### Additional context

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.