aws / aws/amazon-q-developer-cli

Remove auto-compact (or at least don't default to having it on)

Open
#2,736 4 comments 10 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
2k
Forks
439
PR merge metrics
No merged PRs in 30d

Description

The auto-compact feature often makes Q forget critically important context from the conversation. Before this feature was introduced, Q CLI used to just warn that the conversation is getting long (meaning it may "forget" older parts of the conversation). I talked to my team and they much prefer this behavior to auto-compact since auto-compact is pretty much the same as losing the entire conversation so they have to provide even recent context back to Q. Please remove the auto-compact feature or at least make it opt-in only.

Edit: After some internal discussion, and alternative solution would be when the context window overflows, prompt the user for how they want to handle it with the options, being clear, compact, or just keep going. That could be good enough to solve the original UX and technical problems around just keeping the conversation going by default.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.