baidu / baidu/babylon

请教:【微流水线并行机制】是如何执行的

Open
#70 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
653
Forks
101
PR merge metrics
No merged PRs in 30d

Description

想请教下,介绍中的【微流水线并行机制】是指GraphProcessor间并行,还是在GraphProcessor内并行。通常有这样的场景:当服务收到的数据集比较大时,一般会分batch并行处理,一种是分多个GraphProcessor并行,但目前看example中,在构图阶段,GraphProcessor的数量是固定的,是否可以在运行阶段调整GraphProcessor数量? 还一种方式在GraphProcessor内并行,研读代码时貌似没有这种支持。

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the introduction's description of the micro-pipeline parallel mechanism and the example's graph-construction code. Trace how GraphProcessor instances are created and how data batches are handled, then document whether parallelism is between processors or within one processor and whether the processor count can change at runtime.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
distributed-systems
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.