ByteDance-Seed/decoupleQ
View on GitHubA quantization algorithm for LLM
- Stars
- 153
- Forks
- 10
- Open beginner issues
- 0
- Indexed issues
- 16
- Dominant language
- Cuda
- License
- Apache-2.0
- Last GitHub push
- Jun 21, 2024
- Latest indexed
- Sep 14, 2026
- Contributing guide
- No contributing guide
- Code of conduct
- No code of conduct
- Beginner labels
- No beginner labels indexed
- PR merge metrics
- No merged PRs in 30d
-
关于量化模型推理 Open
ByteDance-Seed/decoupleQ#1 · 16 comments · 0 reactions · 0 assignees ·
-
量化后nan问题 Open
ByteDance-Seed/decoupleQ#3 · 4 comments · 0 reactions · 0 assignees ·
-
如何用在custom model上？ Open
ByteDance-Seed/decoupleQ#4 · 5 comments · 0 reactions · 0 assignees ·
-
ByteDance-Seed/decoupleQ#6 · 20 comments · 0 reactions · 0 assignees ·
-
关于加速效果 Open
ByteDance-Seed/decoupleQ#7 · 4 comments · 0 reactions · 0 assignees ·
-
ByteDance-Seed/decoupleQ#8 · 9 comments · 0 reactions · 0 assignees ·
-
ByteDance-Seed/decoupleQ#9 · 2 comments · 0 reactions · 0 assignees ·
-
ByteDance-Seed/decoupleQ#11 · 1 comment · 0 reactions · 0 assignees ·
-
ByteDance-Seed/decoupleQ#12 · 6 comments · 0 reactions · 0 assignees ·
-
你好，量化后推理模型出现nan的问题 Open
ByteDance-Seed/decoupleQ#13 · 11 comments · 0 reactions · 0 assignees ·
-
trtllm推理 Open
ByteDance-Seed/decoupleQ#15 · 0 comments · 0 reactions · 0 assignees ·
-
llama3 Open
ByteDance-Seed/decoupleQ#16 · 0 comments · 0 reactions · 0 assignees ·
-
batchsize不同情况的推理 Open
ByteDance-Seed/decoupleQ#18 · 1 comment · 0 reactions · 0 assignees ·
-
量化结果差异咨询 Open
ByteDance-Seed/decoupleQ#19 · 1 comment · 0 reactions · 0 assignees ·
-
关于decoupleQ文献所述的结果异常 Open
ByteDance-Seed/decoupleQ#20 · 3 comments · 0 reactions · 0 assignees ·
-
可复现的docker image Open
ByteDance-Seed/decoupleQ#21 · 0 comments · 0 reactions · 0 assignees ·