PaddlePaddle / PaddlePaddle/FastDeploy
[AIStudio] Inference Request Stalls After Enabling logprobs
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 3.7k
- Forks
- 756
- Avg merge
- 19h 28m
- Merged PRs (30d)
- 4
Description
AIStudio 中无法正确使用 logprobs，根据 https://paddlepaddle.github.io/FastDeploy/best_practices/FAQ/#4-inference-request-stalls-after-enabling-logprobs 的说法，需要修改系统参数，但是 AIStudio 没有权限 ～
- 文档中说 FD 未来会使用其他方式解决此问题，下个版本会有吗？
- AIStudio 是否可以将镜像默认就修改好这些参数？（这个问题似乎跟 FD 关系不大，希望能内部沟通一下？）
感谢！
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the linked FastDeploy FAQ section on inference requests stalling after enabling logprobs, then inspect how AIStudio images and system parameters are configured. Clarify whether the fix belongs in FastDeploy or the AIStudio image, and define completion as either documented support in a release or verified default parameters in the image.
Written by the indexing model from the issue text.
Assessment
- Domain
- infrastructure
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100