ChatGPTNextWeb / ChatGPTNextWeb/NextChat

[Feature Request] Load custom models as ENV variables in docker or some other way to load custom models.

Open
#5,896 3 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
TypeScript
Stars
88.8k
Forks
59.1k
PR merge metrics
No merged PRs in 30d

Description

### 🥰 Feature Description

I am using own locally run model api under open ai name, but the models for open ai are hard coded into the ui, and without going into settings and changing the custom model name each time will output a wrong model error.

I is not a problem if my PC has only one model loaded, but multiple loaded model need to specify what model to use in the api request. I am using this chat UI as front end to expose on a website to the public. And a common man wont know what model are loaded on my pc and that he has to go to settings to manually load a model.

Please provide a feature to load models on the server side and show it as a list to the public to select from.

### 🧐 Proposed Solution

Please provide a feature to load models on the server side and show it as a list to the public to select from.

### 📝 Additional Information

_No response_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.