CarperAI / CarperAI/trlx

Add support for Falcon 7B/40B

Open
#532 1 comment 0 reactions 0 assignees View on GitHub
feature request
Dominant language
Python
Stars
4.8k
Forks
487
PR merge metrics
No merged PRs in 30d

Description

### 🚀 The feature, motivation, and pitch

As Falcon 7B/40B have been dominating the open source LLM community, it would be amazing to use RLHF tuning on them. Are there any plans on adding support for these models?

### Alternatives

_No response_

### Additional context

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.