bigscience-workshop / bigscience-workshop/Megatron-DeepSpeed
Question about downloading checkpoints of 6.3B,2.5B,1.3B
- Dominant language
- Python
- Stars
- 1.4k
- Forks
- 226
- PR merge metrics
- No merged PRs in 30d
Description
Does BigScience also provide the original BLOOM checkpoints (without conversion to Huggingface 🤗).
I am working on finetuning BLOOM (6.3B,2.5B,1.3B) and I need those checkpoint files.
[issues/315](https://github.com/bigscience-workshop/Megatron-DeepSpeed/issues/315)
In [https://github.com/bigscience-workshop/bigscience/tree/master/train/tr1-13B-base](url) ,I found some urls but they are all offline.
```
I created 4 repos at https://huggingface.co/bigscience/ and now we can clone those as the dirs data will be output into:
cd $six_ALL_CCFRSCRATCH/checkpoints/tr1-13B
git clone https://huggingface.co/bigscience/tr1-13B-checkpoints checkpoints
git clone https://huggingface.co/bigscience/tr1-13B-tensorboard tensorboard
git clone https://huggingface.co/bigscience/tr1-13B-codecarbon codecarbon
git clone https://huggingface.co/bigscience/tr1-13B-logs logs
```
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.