facebookresearch / facebookresearch/fairscale

[feat] make sure AdaScale works with Lightning trainer loop

Open
#293 3 comments 0 reactions 0 assignees View on GitHub
good first issue icebox
Dominant language
Python
Stars
3.4k
Forks
293
PR merge metrics
No merged PRs in 30d

Description

## 🚀 Feature
as title

## Motivation

changing the LR schedule based on the effective step is not easy to do for the user, it would be nice to support it without user's change.

## Pitch

make sure adascale works without or with small user impacts

## Alternatives

not supporting it

## Additional context

surface from an internal discussion and use case

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.