phodal / phodal/auto-dev

自定义大模型无响应问题

Open
#461 6 comments 1 reaction 1 assignee View on GitHub

Nobody has claimed this yet.

Dominant language
Kotlin
Stars
4.5k
Forks
501
PR merge metrics
No merged PRs in 30d

Description

当我在idea中自定义一个大模型时,测试链接显示通过,但是在ai对话框里似乎没有影响。
1、自定义模型时,stream参数勾选效果与显示指定stream参数效果好像不一样,当我指定"stream": 0时,测试链接显示成功,但是此时跟ai对话是没有反应的

Image

2、自定义模型时,stream参数勾选上,不显示定义stream参数,测试链接显示400,似乎传递到后端的参数类型不相符。去掉勾选,显示指定,"stream": 1时,可以得到返回值,但是流式结果是解析不了的,报错如下
Test Connection:
Connectionfailed:cannotparse withresponseResolver:$.result.content,ori data: data:(data:"id":*chatcmpl-297481cb2051b1e050903f57fba436b9",data:"index":0,data:"result":"",data:"role":"",data:"toolcalls":null,data:"finishreason":false,data:
返回结果形如:
data:{
data: "id" : "chatcmpl-5a7eb967-3139-45e5-83de-473cb9e543bf",
data: "index" : 0,
data: "result" : "",
data: "role" : "",
data: "tool_calls" : null,
data: "finish_reason" : false,
data: "finish_detail" : null,
data: "usage" : null,
data: "audioUsage" : null,
data: "extraReturn" : null

问题:
1)自定义模型参数"stream"只支持0或1时,而不是true或false,此时智能显示定义在请求体中,但是下次在再打开时,显示定义参数就丢失了
2)对于自定义大模型,是不是不支持流式返回结果?
3)非流式结果,测试链接通过,为何ai对话无响应?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.