allenai / allenai/open-instruct
How to reproduce the OLMo 3 SFT stage and obtain OLMo-3-7B-Instruct?
- Dominant language
- Python
- Stars
- 3.9k
- Forks
- 585
- Avg merge
- 5d 17h
- Merged PRs (30d)
- 16
Description
Hi, thanks for releasing the training code!
I have a few questions about reproducing the SFT stage of OLMo 3.
If I directly run the SFT script provided in this repository, will it reproduce the OLMo-3-7B-Instruct model?
In particular, should BASE_CKPT="/weka/oe-training-default/ai2-llm/path/to-base/checkpoint/step12345/model_and_optim" point to the checkpoint of OLMo-3-1025-7B?
According to the model-flow figure in the OLMo 3 paper, there appears to be a separate Think SFT stage before Instruct SFT. Therefore, I am not sure whether the released SFT script alone is sufficient to reproduce OLMo-3-7B-Instruct, or whether an additional Think SFT stage is required first.
Could you please provide more details about the exact SFT pipeline used in the paper, including the starting checkpoint and the sequence of SFT stages needed to reproduce the released model?
Thanks!
Contributor guide
Assessment
This issue has not been assessed yet.