Colab + Accelerate Integration issue
Open
bug
- Dominant language
- Python
- Stars
- 4.8k
- Forks
- 487
- PR merge metrics
- No merged PRs in 30d
Description
### 🐛 Describe the bug
Running into the following on colab notebook: `AttributeError: 'AccelerateSFTTrainer' object has no attribute 'make_experience'`

### Which trlX version are you using?
Pulled from git and installed
### Additional system and package information
3.8, using colab
Contributor guide
Assessment
This issue has not been assessed yet.