ModelEngine-Group / ModelEngine-Group/app-platform

所有节点支持流式输出

Open
#36 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

in: builder status: waiting-for-internal-feedback type: feature
Dominant language
Java
Stars
1.5k
Forks
233
PR merge metrics
No merged PRs in 30d

Description

当前业界并不支持“真”流式,而是每个节点串行的“假”流式,例如说,A、B、C三个节点串行,当数据流式传入时,一定是A把所有数据输出,然后到B,B把所有数据输出,才到C,C再把所有数据输出。期望能够做到A输出了一段数据之后,B也开始有数据输出,然后以此类推,C也能有数据输出,从用户表现来看,就是真的水流。

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are identified in the issue. First map how node execution and streamed data currently move through a serial workflow. Done means downstream nodes can begin producing output after upstream nodes emit partial data, so A, B, and C visibly overlap rather than waiting for each node to finish.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
ai
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.