关于RLHF的问题
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 12.3k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
请问这些微调模型都是通过SFT微调得来的吗？关于RM和PPO阶段的微调，是没有用到呢？还是没有开源呢？
如果是没有用到RLHF，仅仅只是通过SFT就可以达到不错的效果，说明问答数据集是非常充分的。对于特定领域，
这可能不太可行。
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No file, test, or entry point is named. The issue needs clarification of whether SFT, RM, and PPO are used or released; done would be a documented answer grounded in repository references.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- machine-learning
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100