推理结果的长度不足怎么调整，或者怎么让它继续推理
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 12.3k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
目前设备的量是够的，性能都是够的，配了4卡，但是推理的时候发现性能都没有拉满，慢就不说了，还非常的短，每次废话讲半天到重要的地方就截断了
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no file, test, model, or inference entry point. Begin by identifying the inference command and configuration used on the four GPUs, then reproduce the truncated response while recording generation settings and logs. Done means the cause of the short output is identified and a documented, verifiable adjustment or fix is available.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100