ChatGPTNextWeb / ChatGPTNextWeb/NextChat

[Bug] Non -GPT model disable system prompt

Open
#3,962 1 comment 0 reactions 0 assignees View on GitHub
backlog
Dominant language
TypeScript
Stars
88.8k
Forks
59.1k
PR merge metrics
No merged PRs in 30d

Description

**Describe the bug**
A clear and concise description of what the bug is.
Self-deployed large models will automatically inject system-level prompts, resulting in incorrect answers.
It should be that only gpt api injects the default system prompt.
自部署大模型会默认注入系统提示 导致回答错误
应该是只有gpt api注入才对
https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web/pull/3684
这个pull似乎没有考虑到自部署大模型的情况
V2.10.1
**To Reproduce**
Steps to reproduce the behavior:
1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error
docker deployment and add environment variables.
docker部署并添加环境变量
```
CUSTOM_MODELS=-all,+Balanced-g4t-offline,+Creative-g4t,+Balanced-g4t,+Precise-g4t,+Creative,+Balanced,+Precise,+Creative-g4t-offline,+Precise-g4t-offline,+Creative-offline,+Balanced-offline,+Precise-offline
BASE_URL=https://bingai.zklcdc.xyz
HIDE_USER_API_KEY=1
```
**Expected behavior**
A clear and concise description of what you expected to happen.

**Screenshots**
If applicable, add screenshots to help explain your problem.
![image](https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web/assets/64531014/1ba49dc5-dec0-45f7-941c-cee91229439b)

**Deployment**
- [y] Docker
- [ ] Vercel
- [ ] Server

**Desktop (please complete the following information):**
- OS: [e.g. iOS]
- Browser [e.g. chrome, safari]
- Version [e.g. 22]

**Smartphone (please complete the following information):**
- Device: [e.g. iPhone6]
- OS: [e.g. iOS8.1]
- Browser [e.g. stock browser, safari]
- Version [e.g. 22]

**Additional Logs**
Add any logs about the problem here.
`
{"messages":[{"role":"system","content":"\nYou are ChatGPT, a large language model trained by OpenAI.\nKnowledge cutoff: 2021-09\nCurrent model: Balanced-g4t-offline\nCurrent time: 2024/1/31 20:21:45\nLatex inline: $x^2$ \nLatex block: $$e=mc^2$$\n\n"},{"role":"user","content":"hi"}],"stream":true,"model":"Balanced-g4t-offline","temperature":0.5,"presence_penalty":0,"frequency_penalty":0,"top_p":1}
`

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.