facebookresearch / facebookresearch/SpinQuant
llama 3.2 1B instruct spinquant int 4 as .pte
Open
- Dominant language
- Python
- Stars
- 428
- Forks
- 93
- PR merge metrics
- No merged PRs in 30d
Description
Hi everyone,
Has anyone successfully created a .pte of llama 3.2 1B instruct spinquant from https://huggingface.co/meta-llama/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8/tree/main
Asking because I am facing issues trying to convert it using spinquant and also while trying to use the executorch export scripts.
Thank you.
Contributor guide
Assessment
This issue has not been assessed yet.