Issue since most recent transformers update
Open
bug
- Dominant language
- Python
- Stars
- 4.8k
- Forks
- 487
- PR merge metrics
- No merged PRs in 30d
Description
### 🐛 Describe the bug
The new version of transformers saves model checkpoints in `safetensors` format, which is incompatible with the way that trlx loads checkpoints using `PreTrainedModelWrapper.from_pretrained`. Specifically, the code fails `pytorch_model.bin` is not present anymore.
### Which trlX version are you using?
`trlx==0.7`
### Additional system and package information
`transformers==4.34.0`
Contributor guide
Assessment
This issue has not been assessed yet.