facebookresearch / facebookresearch/SpinQuant

Qwen2.5 support

Open
#33 14 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
428
Forks
93
PR merge metrics
No merged PRs in 30d

Description

Hi, I am deploying the Qwen2.5 0.5B model via executorch, I want to use quantized version with spinquant, I want to know, what should I do? Many thanks for considering my request.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.