OpenEuroLLM / OpenEuroLLM/Taskboard
Make oellm-eval use OELLM fork of lm-eval harness by default.
Open
@geoalgo is already working on this.
Since Jun 9, 2026.
- Dominant language
- No language data
- Stars
- 3
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Description
oellm-eval should use the fork of lm-eval harness we just created and will populate with our testsets.
It needs to be decided if it should use the main branch:
https://github.com/OpenEuroLLM/lm-evaluation-harness
or if it should use the branch oellm:
https://github.com/OpenEuroLLM/lm-evaluation-harness/tree/oellm
Our novel testsets will be first added to the oellm branch but it is not clear if our main branch in our fork should be the merger, or if our oellm branch should be the merger.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.