facebookresearch / facebookresearch/fairscale
[feat] make sure AdaScale works with Lightning trainer loop
Open
good first issue
icebox
- Dominant language
- Python
- Stars
- 3.4k
- Forks
- 293
- PR merge metrics
- No merged PRs in 30d
Description
## 🚀 Feature
as title
## Motivation
changing the LR schedule based on the effective step is not easy to do for the user, it would be nice to support it without user's change.
## Pitch
make sure adascale works without or with small user impacts
## Alternatives
not supporting it
## Additional context
surface from an internal discussion and use case
Contributor guide
Assessment
This issue has not been assessed yet.