ChatGPTNextWeb / ChatGPTNextWeb/NextChat
[Bug] Adding Custom Endpoint, Azure, Breaks default Google Gemini
- Dominant language
- TypeScript
- Stars
- 88.8k
- Forks
- 59.1k
- PR merge metrics
- No merged PRs in 30d
Description
**Describe the bug**
Adding a custom endpoint (Azure) breaks the Google Gemini model endpoint.
I have added a GOOGLE_API_KEY to my Vercel deployment. After deployment, the gemini-pro chat works as expected.
If I then add a custom endpoint via the GUI by going to settings, setting up Azure Endpoint, API key, API version and giving the model endpoint a custom name, this new model endpoints work. But now the gemini-pro does not work, and returns "Empty response" after a while. I have attempted to relaunch Vercel app, clear cookies etc., the problem repeats.
**To Reproduce**
Steps to reproduce the behavior:
1. Set GOOGLE_API_KEY in vercel environment, deploy app
2. Check that gemini-pro works in chat UI
3. Go to settings, set up custom endpoint (Azure in this case)
4. Try to chat to gemini-pro in chat UI again, it now fails.
**Expected behavior**
Adding a custom Azure endpoint should not affect the gemini-pro model
**Screenshots**

**Deployment**
- [ ] Docker
- [ X ] Vercel
- [ ] Server
**Desktop (please complete the following information):**
- OS: [e.g. iOS]
- Browser [Chrome]
- Version [Forked and deployed on latest version per 13/2/2024]
**Additional Logs**
Add any logs about the problem here.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.