How to connect an LLM that is not on the supported list
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 7.2k
- Forks
- 718
- Avg merge
- 3d 1h
- Merged PRs (30d)
- 23
Description
We are using a private LLM, such as OpenAI or Gemini, which is not supported by the Unstract.
To use this private LLM, various parameters like a jwt token, a subscription key, and an endpoint address are required.
We would like to test connecting this private LLM to the Unstract open-source version.
Could you advise if this is possible?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points; start by identifying the existing supported-LLM integration path. Done would require a documented, working way to configure the JWT token, subscription key, and endpoint for a private LLM in the open-source version.
Written by the indexing model from the issue text.
Assessment
- Domain
- ai
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100