agentscope-ai / agentscope-ai/AgentTeams

本地vllm启动的模型,长度超限 || The model started by local vllm has a length exceeding the limit.

未關閉
#346 3 則留言 0 個 reaction 已指派 1 人 已被 @qiacheng7 認領 在 GitHub 檢視
area:model-higress
主要語言
Go
星號
5.6k
分支
692
平均合併
5 天 4 小時
30 天內合併 PR
23

描述

400 You passed 74655 input characters and requested 32000 output tokens. However, the model's context length is only 32000 tokens, resulting in a maximum input length of 0 tokens (at most 0 characters). Please reduce the length of the input prompt. (parameter=input_text, value=74655)

1. 本地vllm启动的模型。配置了32K长度,openAI->自定义服务->url方式配置
2. windows10 docker部署。
3. 就问了一句你好 就提示超长了。

---
400 You passed 74655 input characters and requested 32000 output tokens. However, the model's context length is only 32000 tokens, resulting in a maximum input length of 0 tokens (at most 0 characters). Please reduce the length of the input prompt. (parameter=input_text, value=74655)

1. Local vllm startup model. 32K length is configured, openAI->custom service->url configuration
2. windows10 docker deployment.
3. I just asked hello and the prompt was too long.

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。