aliyun / aliyun/SimAI

仿真中AllReduce和AllGather产生的流量完全一致

Open
#147 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
1.2k
Forks
184
Avg merge
13h 4m
Merged PRs (30d)
1

Description

拓扑文件如下:

Spectrum-X_128g_8gps_100Gbps_A100.txt

负载文件的内容如下图所示:

Image

我希望运行负载文件中的不同的集合通信元语,以验证每种集合通信操作生成流是否符合预期
每次运行结束后我通过解析/etc/astra-sim/simulation/llama_hpn7_fct.txt文件来观察集合通信操作生成的流情况
在分别运行Allgather和Allreduce后生成的流情况如下图所示

Image

Image

可见两种集合通信操作生成的流完全一致,这令我感到困惑

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the attached Spectrum-X_128g_8gps_100Gbps_A100.txt topology and the workload shown in the issue. Run the AllGather and AllReduce cases separately, then compare the generated flows in /etc/astra-sim/simulation/llama_hpn7_fct.txt. Done means determining whether identical traffic is expected or identifying why the two collective operations produce the same result.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.