facebookresearch / facebookresearch/fairscale
[test] AdaScale: ensure interoperability with activation checkpointing
Open
AdaScale
icebox
- Dominant language
- Python
- Stars
- 3.4k
- Forks
- 293
- PR merge metrics
- No merged PRs in 30d
Description
Activation checkpointing can be useful in saving GPU memory. It would be useful to ensure AdaScale works with that.
Contributor guide
Research direction
Start by locating AdaScale and activation-checkpointing entry points and any existing interoperability tests. Run the relevant test suite to understand current behavior; done means AdaScale works with activation checkpointing and the compatibility is covered by a test.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning, testing
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100