How to Load OpenELM Pre-training Checkpoints using Hugging Face AutoModelForCausalLM ?
Open
- Dominant language
- Jupyter Notebook
- Stars
- 7k
- Forks
- 541
- PR merge metrics
- No merged PRs in 30d
Description
Hi there,
First, really admire the work on OpenELM! Thank you for making your models and code available.
Question regarding the [pre-training checkpoints linked here](https://github.com/apple/corenet/blob/main/projects/openelm/README-pretraining.md#pretraining-checkpoints-model-weights-and-logs): how can we convert these checkpoints into the format expected by ```AutoModelForCausalLM.from_pretrained```?
I presume there's a script that was used for conversion of the final model weights into HF format, but I couldn't find it in the repo.
Would very much appreciate any help on this!
Best,
Jason
Contributor guide
Assessment
This issue has not been assessed yet.