Bluefog-Lib / Bluefog-Lib/bluefog

Symmetrical argument for self_weight, src_weights, dst_weights

Open
#82 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
257
Forks
50
PR merge metrics
No merged PRs in 30d

Description

The pattern for neighbor_allreduce arguments may be
1. self_weight, src_weights, dst_weights are all none (Disable dynamic)
2. self_weight + src_weights (Enable dynamic, infer dst_weights using Python API)
3. self_weight + dst_weights (Enable dynamic, infer src_weights using Python API)
4. self_weight + src_weights + dst_weights (Enable dynamic)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the neighbor_allreduce entry point and its Python API. Trace how self_weight, src_weights, and dst_weights are currently handled, then compare behavior for the four argument combinations listed in the issue. Done means the API supports the intended symmetric combinations and their behavior is covered by the relevant tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
distributed-systems, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.