ByteDance-Seed / ByteDance-Seed/decoupleQ
trtllm推理
Open
- Dominant language
- Cuda
- Stars
- 153
- Forks
- 10
- PR merge metrics
- No merged PRs in 30d
Description
您好，请问方便开源一些使用trtllm进行推理的例子demo吗，模型权重转换和接口构建等，感谢感谢
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue requests examples for trtllm inference, including model-weight conversion and interface construction, but names no files, tests, or entry points. Start by locating any existing inference or conversion material in the repository, then define the example scope and verify that the requested workflows are documented and runnable.
Written by the indexing model from the issue text.
Assessment
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100