OpenEuroLLM / OpenEuroLLM/Taskboard

Compute for 32B Dense context extension

Open
#369 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

4.6 post-training T4.4 - model training
Dominant language
No language data
Stars
3
Forks
0
PR merge metrics
No merged PRs in 30d

Description

Goal
Need to find compute for running context extension on 32B Dense and possible other models in plans

Description
Context extension pipeline needs to be deployed and parallel configuration tested to be able to run context extension on 32B Dense model. Currently no compute allocated

Deliverable scope
Agreement on where to run context extension and access to that resource

Dependencies

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the context extension pipeline and the plans for compute allocation. Determine where the 32B Dense model can run, secure access to that resource, and validate the parallel configuration. Done means the deployment location is agreed and access is available for running context extension.

Written by the indexing model from the issue text.

Assessment

Domain
infrastructure, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.