LAION-AI / LAION-AI/Open-Assistant
Few-shot prefix a LLM to prompt it into an instruction following mode
Open
@wangrui6 is already working on this.
Since Feb 27, 2023.
ml
- Dominant language
- Python
- Stars
- 37.4k
- Forks
- 3.3k
- PR merge metrics
- No merged PRs in 30d
Description
One of the baselines presented in the InstructGPT paper is a "properly" prompted GPT-3 model (see footnote 6 and section 3.5). Before the specified instruction/prompt by the user, a specified prefix is prepended to the user-specified instructions.
Requirements:
- A base model (eventually the same as the actual model we are going to be using).
- A trained reward model.
After some fine-tuning on the prefixes, compare the base model and the propmpted model based on the reward attained by the reward model.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.