OpenEuroLLM / OpenEuroLLM/Taskboard
Long context extension of prelude final checkpoint
Open
Nobody has claimed this yet.
4.6 post-training
- Dominant language
- No language data
- Stars
- 3
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Description
Goal
Context extend the final prelude checkpoint
Description
Context extend to 256k for the final prelude checkpoint
Deliverable scope
A context extended checkpoint that works in Needle In Haystack eval published on HF
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the final prelude checkpoint and the Needle In Haystack evaluation workflow. Determine how context length is configured and how checkpoints are published on Hugging Face. Done means a checkpoint supporting 256k context passes the Needle In Haystack evaluation and is published on HF.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- huggingface
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100