ByteDance-Seed / ByteDance-Seed/decoupleQ

关于加速效果

Open
#7 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Cuda
Stars
153
Forks
10
No merged PRs in 30d

Description

非常棒的工作，请问有在GPU上实际的推理加速效果吗？比如说Llama2-13B，输入512，输出512下的推理速度？谢谢！

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.