cloudwego / cloudwego/eino

Provide means to access Messages for ChatModelAgentMiddleware

Open
#868 0 comments 0 reactions 0 assignees View on GitHub
C-feature-request D-adk
Dominant language
Go
Stars
13k
Forks
1.1k
Avg merge
4h 6m
Merged PRs (30d)
41

Description

Since `ProcessState` is `compose` layer API, we prefer to hide it from ChatModelAgent users. To fully replace it's functionality, we need to provide first-class support to 'Get' current message list in ChatModelAgentMiddleware, other than from Before/AfterModelRewriteState.

We already have concrete user request for this feature.

Contributor guide

Open the contributing guide

Research direction

Start by tracing ChatModelAgentMiddleware and the BeforeModelRewriteState and AfterModelRewriteState APIs to understand how current messages are exposed today. Compare that with the ProcessState compose-layer API and identify the middleware-facing access point needed to replace it. Done means ChatModelAgent users can retrieve the current message list without depending on ProcessState or rewrite-state details.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
ai, backend-api-design
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.