ModelEngine-Group / ModelEngine-Group/app-platform
所有节点支持流式输出
Open
Nobody has claimed this yet.
in: builder
status: waiting-for-internal-feedback
type: feature
- Dominant language
- Java
- Stars
- 1.5k
- Forks
- 233
- PR merge metrics
- No merged PRs in 30d
Description
当前业界并不支持“真”流式,而是每个节点串行的“假”流式,例如说,A、B、C三个节点串行,当数据流式传入时,一定是A把所有数据输出,然后到B,B把所有数据输出,才到C,C再把所有数据输出。期望能够做到A输出了一段数据之后,B也开始有数据输出,然后以此类推,C也能有数据输出,从用户表现来看,就是真的水流。
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are identified in the issue. First map how node execution and streamed data currently move through a serial workflow. Done means downstream nodes can begin producing output after upstream nodes emit partial data, so A, B, and C visibly overlap rather than waiting for each node to finish.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- ai
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100