aws-samples / aws-samples/bedrock-chat

[Feature Request] Compress the context of conversation

Open
#970 0 comments 2 reactions 0 assignees View on GitHub
enhancement
Dominant language
TypeScript
Stars
1.3k
Forks
535
Avg merge
1d 12h
Merged PRs (30d)
10

Description

## Describe the solution you'd like

I would like the ability to compress the context of conversation to reduce the context volume.

## Why the solution needed

While the number of tokens that generative AI can handle is limited, users hope to be able to continue conversations by taking over their memories of conversations up until then.

## Additional context

Add any other context or screenshots about the feature request here.

## Implementation feasibility

Are you willing to collaborate with us to discuss the solution, decide on the approach, and assist with the implementation?

- [x] Yes, I am able to implement the feature and create a pull request.
- [ ] No, I am unable to implement the feature, but I am open to discussing the solution.

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start by clarifying the compression approach, integration point, and acceptance criteria with the maintainers; done should be a reviewed implementation that reduces conversation context while preserving the required conversational memory.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python, typescript
Domain
ai, backend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.