facebookresearch / facebookresearch/fairscale

[feat] Create a benchmark pulling in both Pipe and Zero

Open
#84 1 comment 0 reactions 1 assignee Claimed by @blefaudeux View on GitHub
enhancement
Dominant language
Python
Stars
3.4k
Forks
293
PR merge metrics
No merged PRs in 30d

Description

## 🚀 Feature
Add a new toy benchmark which mobilizes Pipe and Zero at the same time

## Motivation
- check that the interfaces, codebases are compatible
- expose hypothetical perf problems
- expose combined gains
- get a baseline asap to monitor progress on both fronts

## Pitch
New benchmark, either vision or NLP, to be implemented which Pipes the model and zeros the optimizer

## Alternatives
Head in the sand and hoping for the best

## Additional context
Nope

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.