facebookresearch / facebookresearch/SpinQuant

Performance on LLama2-7b model

Open
#49 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
428
Forks
93
PR merge metrics
No merged PRs in 30d

Description

Hi, I' would like to ask what might be the reason for small accuracy gain compared to naive Quarot approach in Llama-2-7b. Your table shows performance gain in llama3 based models. what might be the difference?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.