deepspeedai / deepspeedai/DeepSpeed
[BUG] deepspeed get_model_profile custom module zero MACs
Open
Nobody has claimed this yet.
bug
- Dominant language
- Python
- Stars
- 43.1k
- Forks
- 5k
- Avg merge
- 4d 15h
- Merged PRs (30d)
- 112
Description
Describe the bug
When i use deepspeed get_model_profile, I got custom module "global filter" zero MACs which is not correct.
"global filter" module is implemented by⬇️
https://github.com/raoyongming/GFNet/blob/master/gfnet.py
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start at the get_model_profile entry point and inspect the custom module implementation linked in gfnet.py. Reproduce the profile for the “global filter” module, trace why its MAC count is reported as zero, and verify that profiling reports a nonzero count for this module.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning, performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100