mindspore-ai / mindspore-ai/hyper-parallel

MF联调问题:没参与切分的Tensor无法获取layout信息

Open
#749 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
53
Forks
63
Avg merge
23h 45m
Merged PRs (30d)
63

Description

当前问题:

对于没有转换成DTensor的Parameter(例如fully_shard的ignored_params),拿不到layout信息,后续的相关操作(权重转换)无法正常处理。

解决办法:

给layout一个默认值None,而不是跳过处理。后续get到None时,Tensor当做没切分处理。

schema_version: 1
source: gitcode
gitcode_repo: mindspore/hyper-parallel
gitcode_issue: 100
source_url: https://gitcode.com/mindspore/hyper-parallel/issues/100

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files or tests are named. Start by locating the layout-handling path for Parameters that are not converted to DTensor, including fully_shard ignored_params. Ensure the default layout is None and check the related weight-conversion behavior for an unsharded Tensor; done means the conversion no longer skips these Parameters and treats None as unsharded.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
distributed-systems
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
67/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.