CarperAI / CarperAI/trlx

Issue since most recent transformers update

Open
#580 1 comment 4 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
4.8k
Forks
487
PR merge metrics
No merged PRs in 30d

Description

### 🐛 Describe the bug

The new version of transformers saves model checkpoints in `safetensors` format, which is incompatible with the way that trlx loads checkpoints using `PreTrainedModelWrapper.from_pretrained`. Specifically, the code fails `pytorch_model.bin` is not present anymore.

### Which trlX version are you using?

`trlx==0.7`

### Additional system and package information

`transformers==4.34.0`

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.