Consider using a fixed version of GPT-4 for llm_judge
Open
@infwinston is already working on this.
Since Aug 23, 2023.
- Dominant language
- Python
- Stars
- 39.5k
- Forks
- 4.8k
- PR merge metrics
- No merged PRs in 30d
Description
Since the OpenAI API is changing, please consider using a fixed GPT-4 version such as `gpt-4-0314`. Using `gpt-4` can cause fluctuating results and make old results stale.
Btw, I can help re-run the results with a fixed GPT-4 version.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.