huggingface / huggingface/optimum-nvidia
GPTQ support?
Open
enhancement
- Dominant language
- Python
- Stars
- 1k
- Forks
- 103
- Avg merge
- 2m
- Merged PRs (30d)
- 1
Description
Very new to this library...just need a quick answer if GPTQ is going to be supported.
Need to inference LLaMA2-13b-GPTQ on RTX 4060 ti
Contributor guide
Assessment
This issue has not been assessed yet.