ChatGPTNextWeb / ChatGPTNextWeb/NextChat

[Bug] Adding Custom Endpoint, Azure, Breaks default Google Gemini

Open
#4,044 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
88.8k
Forks
59.1k
PR merge metrics
No merged PRs in 30d

Description

**Describe the bug**
Adding a custom endpoint (Azure) breaks the Google Gemini model endpoint.

I have added a GOOGLE_API_KEY to my Vercel deployment. After deployment, the gemini-pro chat works as expected.

If I then add a custom endpoint via the GUI by going to settings, setting up Azure Endpoint, API key, API version and giving the model endpoint a custom name, this new model endpoints work. But now the gemini-pro does not work, and returns "Empty response" after a while. I have attempted to relaunch Vercel app, clear cookies etc., the problem repeats.

**To Reproduce**
Steps to reproduce the behavior:
1. Set GOOGLE_API_KEY in vercel environment, deploy app
2. Check that gemini-pro works in chat UI
3. Go to settings, set up custom endpoint (Azure in this case)
4. Try to chat to gemini-pro in chat UI again, it now fails.

**Expected behavior**
Adding a custom Azure endpoint should not affect the gemini-pro model

**Screenshots**
![image](https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web/assets/17813449/f7322064-7def-4bac-aab1-a4e6eeb1d6b2)

**Deployment**
- [ ] Docker
- [ X ] Vercel
- [ ] Server

**Desktop (please complete the following information):**
- OS: [e.g. iOS]
- Browser [Chrome]
- Version [Forked and deployed on latest version per 13/2/2024]

**Additional Logs**
Add any logs about the problem here.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.