Add large-scale AutoSharding example
Open
- Dominant language
- Python
- Stars
- 6
- Forks
- 4
- PR merge metrics
- No merged PRs in 30d
Description
E.g. Gemma 27B.
Potentially switch to this implementation:
https://github.com/jax-ml/bonsai/tree/main/bonsai/models/gemma3
Contributor guide
Assessment
This issue has not been assessed yet.