ChatGPTNextWeb / ChatGPTNextWeb/NextChat
[Bug] 使用nvidia提供的llama3接口,消息被截断
- Dominant language
- TypeScript
- Stars
- 88.8k
- Forks
- 59.1k
- PR merge metrics
- No merged PRs in 30d
Description
### Bug Description
当我在[ChatGPT-Next-Web](https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web)中使用nvidia提供的llama3接口时,出现消息被截断的问题,已尝试max_tokens设置为4000、39999

接口在测试中表现良好

### Steps to Reproduce
如上
### Expected Behavior
能接收到完整信息
### Screenshots
_No response_
### Deployment Method
- [ ] Docker
- [X] Vercel
- [ ] Server
### Desktop OS
_No response_
### Desktop Browser
_No response_
### Desktop Browser Version
_No response_
### Smartphone Device
_No response_
### Smartphone OS
_No response_
### Smartphone Browser
_No response_
### Smartphone Browser Version
_No response_
### Additional Logs
data: {"id":"chatcmpl-a77268e0-c815-4f0b-8a7e-3452ea838046","object":"chat.completion.chunk","created":1714240413,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"delta":{"role":"assistant","content":""},"finish_reason":null,"logprobs":null}]}
data: {"id":"chatcmpl-a77268e0-c815-4f0b-8a7e-3452ea838046","object":"chat.completion.chunk","created":1714240413,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null,"logprobs":{"content":[{"token":null,"logprob":0.0,"bytes":null,"top_logprobs":null}]}}]}
data: {"id":"chatcmpl-a77268e0-c815-4f0b-8a7e-3452ea838046","object":"chat.completion.chunk","created":1714240413,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"delta":{"role":"assistant","content":"What is a Computer?**\n\nA computer is an electronic device that can perform"},"finish_reason":null,"logprobs":{"content":[{"token":null,"logprob":0.0,"bytes":null,"top_logprobs":null}]}}]}
data: {"id":"chatcmpl-a77268e0-c815-4f0b-8a7e-3452ea838046","object":"chat.completion.chunk","created":1714240413,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"delta":{"role":"assistant","content":""},"finish_reason":"stop","logprobs":null}]}
data: [DONE]
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.