huggingface / huggingface/accelerate
Accumulate the gradients of 2 models
Open
enhancement
feature request
- Dominant language
- Python
- Stars
- 9.9k
- Forks
- 1.5k
- Avg merge
- 5d 2h
- Merged PRs (30d)
- 27
Description
Thanks for the great work! I met an issue where I hoped to accumulate the gradients of 2 networks. How can I handle it with accelerator.accumulate() function? Looking forward to hearing from you!
Contributor guide
Assessment
This issue has not been assessed yet.