FireCubeStudios / FireCubeStudios/Run

(Feature Request) Allow setting a custom OpenAI API endpoint to experiment with locally hosted LLMs

Open
#32 2 comments 2 reactions 0 assignees View on GitHub
Dominant language
C#
Stars
179
Forks
13
PR merge metrics
No merged PRs in 30d

Description

Some open-source, locally run LLMs have the capability to emulate key features of the OpenAI API to "appear" to an application as GPT. Can you add support for a custom API endpoint to experiment with this and see if the performance of something like WizardLM or Falcon may be up to the task of generating commands?
I would then envision an input field in the Settings window with the default OpenAI API endpoint URL replaceable with your own.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.