microsoft / microsoft/nnscaler

Request for Communication Performance Evaluation and Subset Parallelization Support

Open
#4 5 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
136
Forks
26
PR merge metrics
No merged PRs in 30d

Description

First of all, thank you for your amazing work on the nnScaler project. It has been incredibly inspiring, and I’ve been learning and using the contents from this repository in my own work.
I have a few suggestions and questions:

1. Performance Evaluation:

It would be great if you could provide some sample code or a reference implementation to evaluate the computation and communication performance with the profiling tool.

2. Subset Parallelization Support:

Following the README, I have successfully implemented end-to-end parallelization of an entire model. However, I’m wondering if it is possible to perform parallelization on a subset of the model and generate parallelized code only for that portion.
If this functionality already exists, could you provide documentation or examples on how to use it?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the README and the profiling tool documentation or entry points mentioned there. Determine whether subset parallelization already exists and what sample performance workflow is supported; done would require a documented, reproducible example for evaluation and a clear answer or implementation path for subset code generation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
compilers, distributed-systems, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.