ChatGPTNextWeb / ChatGPTNextWeb/NextChat

[Bug] 使用nvidia提供的llama3接口,消息被截断

Open
#4,577 3 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
TypeScript
Stars
88.8k
Forks
59.1k
PR merge metrics
No merged PRs in 30d

Description

### Bug Description

当我在[ChatGPT-Next-Web](https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web)中使用nvidia提供的llama3接口时,出现消息被截断的问题,已尝试max_tokens设置为4000、39999
![image](https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web/assets/112610152/b79f4385-de82-4d1d-8458-1d3b7b09d1b7)
接口在测试中表现良好
![image](https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web/assets/112610152/643c816b-4468-496f-b707-292d25fb281f)

### Steps to Reproduce

如上

### Expected Behavior

能接收到完整信息

### Screenshots

_No response_

### Deployment Method

- [ ] Docker
- [X] Vercel
- [ ] Server

### Desktop OS

_No response_

### Desktop Browser

_No response_

### Desktop Browser Version

_No response_

### Smartphone Device

_No response_

### Smartphone OS

_No response_

### Smartphone Browser

_No response_

### Smartphone Browser Version

_No response_

### Additional Logs

data: {"id":"chatcmpl-a77268e0-c815-4f0b-8a7e-3452ea838046","object":"chat.completion.chunk","created":1714240413,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"delta":{"role":"assistant","content":""},"finish_reason":null,"logprobs":null}]}

data: {"id":"chatcmpl-a77268e0-c815-4f0b-8a7e-3452ea838046","object":"chat.completion.chunk","created":1714240413,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"delta":{"role":"assistant","content":"**"},"finish_reason":null,"logprobs":{"content":[{"token":null,"logprob":0.0,"bytes":null,"top_logprobs":null}]}}]}

data: {"id":"chatcmpl-a77268e0-c815-4f0b-8a7e-3452ea838046","object":"chat.completion.chunk","created":1714240413,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"delta":{"role":"assistant","content":"What is a Computer?**\n\nA computer is an electronic device that can perform"},"finish_reason":null,"logprobs":{"content":[{"token":null,"logprob":0.0,"bytes":null,"top_logprobs":null}]}}]}

data: {"id":"chatcmpl-a77268e0-c815-4f0b-8a7e-3452ea838046","object":"chat.completion.chunk","created":1714240413,"model":"meta/llama3-70b-instruct","choices":[{"index":0,"delta":{"role":"assistant","content":""},"finish_reason":"stop","logprobs":null}]}

data: [DONE]

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.