New dataset release?
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 39.5k
- Forks
- 4.8k
- PR merge metrics
- No merged PRs in 30d
Description
When will the updated Chatbot Arena data be released to the public? Also, the previous version of Chatbot Arena allowed you to vote chats after the models were revealed, but did not count toward the leaderboard, but will this data be added to the dataset? What about data that was never voted?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points. First review how FastChat handles Chatbot Arena data releases and determine whether the requested post-reveal and unvoted data are available; done requires a maintainer decision and a defined public-release scope.
Written by the indexing model from the issue text.
Assessment
- Domain
- data
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100