facebookresearch / facebookresearch/fairscale
[feat] Create a benchmark pulling in both Pipe and Zero
Open
enhancement
- Dominant language
- Python
- Stars
- 3.4k
- Forks
- 293
- PR merge metrics
- No merged PRs in 30d
Description
## 🚀 Feature
Add a new toy benchmark which mobilizes Pipe and Zero at the same time
## Motivation
- check that the interfaces, codebases are compatible
- expose hypothetical perf problems
- expose combined gains
- get a baseline asap to monitor progress on both fronts
## Pitch
New benchmark, either vision or NLP, to be implemented which Pipes the model and zeros the optimizer
## Alternatives
Head in the sand and hoping for the best
## Additional context
Nope
Contributor guide
Assessment
This issue has not been assessed yet.