Tencent / Tencent/digitalhuman
Questions about the chit chat benchmark in RLVER
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 361
- Forks
- 52
- PR merge metrics
- No merged PRs in 30d
Description
Excellent project! Your paper is really instructive to us!
I found that your fine-tuned models' performance in chit chat is not particularly impressive. But I think, in fact, such everyday scenarios might be more common for chatbots. I would like to know if you have tried training on more chit chat scenarios? Also, I would like to know if you are willing to open-source the chit chat test data?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no file, test, or entry point. Read the RLVER chit chat benchmark context first, then clarify whether the request concerns additional training scenarios or releasing test data; done requires a concrete, scoped follow-up or a maintainer response.
Written by the indexing model from the issue text.
Assessment
- Domain
- data, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100