Missing Intermediate Pre-training Checkpoints for OLMo-1B-hf (494B to 1383B)
Abierto
- Lenguaje dominante
- Python
- Estrellas
- 1.5k
- Forks
- 315
- Merge medio
- 1 d 9 h
- PR fusionados (30 d)
- 11
Descripción
I am writing to report that a significant range of intermediate checkpoints is missing from the [allenai/OLMo-1B-hf](https://huggingface.co/allenai/OLMo-1B-hf) repository on Hugging Face.
Specifically, while the repository provides early-stage and late-stage checkpoints, there is a gap between step 494B tokens and step 1383B tokens.
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.