Reproduction of Olmo3
Abierto
- Lenguaje dominante
- Python
- Estrellas
- 395
- Forks
- 105
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
Hi Dear Author,
I'm trying to reproduce Olmo3's result, but for intermediate checkpoints, whenever I wanted to eval on mmlu(mmlu:cot::olmo3:midtrain), it seems the memory just gradually increases until OOM, seems the COT is too long?
the model I was trying to reproduce is: https://huggingface.co/allenai/Olmo-3-7B-Think-SFT
Much appreciated!
Guía de contribución
No hay ninguna guía de contribución indexada para este repositorio
Evaluación
Este issue todavía no se ha evaluado.