请问什么时候会支持对CogVLM2的量化
Open
- Dominant language
- Python
- Stars
- 8.1k
- Forks
- 748
- Avg merge
- 6d 2h
- Merged PRs (30d)
- 54
Description
您好，请问什么时候会支持对CogVLM2的量化，模型来自zhipu的https://huggingface.co/THUDM/cogvlm2-llama3-chat-19B，能否用https://github.com/InternLM/lmdeploy/blob/main/docs/en/quantization/w4a16.md来辅助进行量化，谢谢！
Contributor guide
Assessment
This issue has not been assessed yet.