ByteDance-Seed / ByteDance-Seed/decoupleQ
量化后nan问题
Open
- Dominant language
- Cuda
- Stars
- 153
- Forks
- 10
- PR merge metrics
- No merged PRs in 30d
Description
您好，非常好的工作。尝试复现论文中的指标，我的模型是llama2-7b，使用run_llama.sh脚本量化后，模型输出包含大量nan，数据集为c4，类似情况如何解决呢。谢谢！
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.