apple / apple/corenet

How to Load OpenELM Pre-training Checkpoints using Hugging Face AutoModelForCausalLM ?

Open
#43 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
7k
Forks
541
PR merge metrics
No merged PRs in 30d

Description

Hi there,

First, really admire the work on OpenELM! Thank you for making your models and code available.

Question regarding the [pre-training checkpoints linked here](https://github.com/apple/corenet/blob/main/projects/openelm/README-pretraining.md#pretraining-checkpoints-model-weights-and-logs): how can we convert these checkpoints into the format expected by ```AutoModelForCausalLM.from_pretrained```?

I presume there's a script that was used for conversion of the final model weights into HF format, but I couldn't find it in the repo.

Would very much appreciate any help on this!

Best,
Jason

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.