deepseek-ai / deepseek-ai/DeepSeek-Coder
使用deepspeed mii加速推理的时候,输出全是特殊字符,比如“(”、"{"等,该如何解决呢
Open
- Dominant language
- Python
- Stars
- 24.3k
- Forks
- 2.9k
- PR merge metrics
- No merged PRs in 30d
Description
This issue has no description.
Contributor guide
No contributing guide indexed for this repository
Research direction
The report mentions DeepSpeed MII inference and output consisting of special characters, but provides no files, commands, model details, or tests. Start by reproducing the reported inference behavior with the same DeepSpeed MII setup and inspect the output-generation path. Done means identifying the cause and obtaining normal decoded output.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100