bigscience-workshop / bigscience-workshop/petals
Grok | Mixture-of-Experts | Model Support
Open
- Dominant language
- Python
- Stars
- 10.6k
- Forks
- 650
- PR merge metrics
- No merged PRs in 30d
Description
[Grok](https://github.com/xai-org/grok-1) architecture and weights were just released, do Petals support, or is it in plan to support Grok and MOE models?
Having a first in class 314B parameter model running on consumer hardware would be great!
Thanks in advance.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.