Add support for local custom LLM providers (OpenAI-compatible, e.g. Ollama)
Nobody has claimed this yet.
- Dominant language
- TypeScript
- Stars
- 39k
- Forks
- 2.1k
- Avg merge
- 1d 4h
- Merged PRs (30d)
- 10
Description
Clear and concise description of the problem
As a user of Folo Desktop, I want to use a local LLM (such as Ollama) as the AI backend so that I can run summaries and analysis offline, privately, and without per-request costs. Impossible to integrate Folo with locally hosted models, even though many users already run these successfully in tools like RSS-Deck or Open WebUI.
Suggested solution
Add a “Custom / OpenAI-compatible LLM provider” option in AI settings with the following fields:
Provider type: OpenAI-compatible
Base URL (e.g. http://127.0.0.1:11434/v1)
API key (optional / dummy for local runtimes)
Model name (free text or auto-discovered)
Toggles for:
Streaming (on/off)
Tools / function calling (on/off)
Vision (on/off)
This would allow seamless integration with:
Ollama
LM Studio
Open WebUI
Any self-hosted OpenAI-compatible API
Alternative
No response
Additional context
I have a working local Ollama setup (http://127.0.0.1:11434) with models like mistral, but there is currently no place in the Folo UI to configure or select a custom LLM endpoint.
Happy to test or provide feedback if this feature is implemented.
Validations
- Check that there isn't already an issue that request the same feature to avoid creating a duplicate.
- This issue is valid
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating Folo Desktop's AI settings and its existing provider configuration or integration entry points. Review how provider URLs, models, API keys, streaming, tools, and vision are currently represented, then define the custom OpenAI-compatible option and verify it can connect to a local Ollama endpoint and support the requested settings.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- ollama, typescript
- Domain
- ai, desktop
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100