Add support XGLM model
Open
feature request
- Dominant language
- Python
- Stars
- 4.8k
- Forks
- 487
- PR merge metrics
- No merged PRs in 30d
Description
### 🚀 The feature, motivation, and pitch
I think trlx should support XGLM model for training PPO because XGLM has support 134 languages in [XGLM-4.5B model](https://huggingface.co/facebook/xglm-4.5B), so many researcher can do multilingual research with multilingual RLHF model if trlx support XGLM model.
### Alternatives
_No response_
### Additional context
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.