bigscience-workshop / bigscience-workshop/bigscience

Is the 13B - unmodified Megatron gpt2 - baseline available? ( tr1-13B-base)

Open
#21 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
Shell
Stars
1k
Forks
102
PR merge metrics
No merged PRs in 30d

Description

I was super excited to hear about this project! I was wondering if the model is available anywhere?

In the [chronicles of tr1-13B-base](https://github.com/bigscience-workshop/bigscience/blob/master/train/tr1-13B-base/chronicles.md
) it says at the end: "All checkpoints converted to HF format and uploaded to HUB.", which I thought meant that it is available on Huggingface, but I can't seem to find it.

Is it available and I'm just not able to find it, or did I misunderstand and it's not available?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.