mlfoundations / mlfoundations/evalchemy
LCB benchmarks are duplicated
Open
Nobody has claimed this yet.
- Dominant language
- HTML
- Stars
- 610
- Forks
- 87
- PR merge metrics
- No merged PRs in 30d
Description
LCB benchmarks are duplicated.
by exposing the 'version_tag' as an arg, we can refactor code into one benchmark code (instead of 3).
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the three LCB benchmark implementations and compare how version_tag is currently handled. Refactor them around one benchmark implementation with version_tag exposed as an argument. Done means the duplicated benchmark code is consolidated while LCB benchmark behavior remains consistent.
Written by the indexing model from the issue text.
Assessment
- Domain
- machine-learning
- Issue type
- Refactor
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100