agentscope-ai / agentscope-ai/agentscope-java
[Feature]: Add Hooks to SessionManager and Implement Memory Limits
- Linguagem predominante
- Java
- Estrelas
- 5.6k
- Forks
- 1.3k
- Merge médio
- 4d 12h
- PRs com merge (30d)
- 77
Descrição
1. **Add a hooks mechanism to SessionManager**
Allow developers to inject custom logic at key lifecycle stages (e.g., before/after state updates, on save/load).
Refactor internal state to be strongly typed for better developer experience and safer operations.
2. **Introduce configurable memory limits**
Support setting max message count and max token limit per session or memory instance.
Provide eviction strategies (e.g., FIFO, LRU) to automatically trim history when limits are reached.
**Use Cases & Benefits**
- **External Storage & Memory Control**:
We use Minio for external session storage. With hooks, we can precisely enforce token/window limits—keeping short-term memory lightweight while preserving long-term context separately.
- **Dual Storage for Business Needs**: We store full conversation history in a relational database (by message) for on-demand paginated access. Hooks allow clean extraction and persistence without wrapping layers or workarounds.
- **Prevent OOM**: Enforcing token/message limits ensures system stability in long-running or high-volume conversation scenarios.
**Suggested Implementation Outline**
- Define a SessionManagerHooks interface with methods like onStateUpdate, beforeSave, afterLoad.
- Add MemoryLimitConfig with maxMessages and maxTokens options, coupled with a trimming mechanism.
- Refactor state to use typed structures instead of map.
Guia de contribuição
Avaliação
Esta issue ainda não foi avaliada.