facebookresearch / facebookresearch/LLM-QAT
How to run inference
Open
- Dominant language
- Python
- Stars
- 328
- Forks
- 25
- PR merge metrics
- No merged PRs in 30d
Description
Thank you for sharing the data generation and training code! Suppose that I have a quantized model now, how may I run autoregression with it to make sure that it works as before the quantization?
Contributor guide
Assessment
This issue has not been assessed yet.