RSSNext / RSSNext/Folo

Add support for local custom LLM providers (OpenAI-compatible, e.g. Ollama)

Open
#4,828 2 comments 5 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
TypeScript
Stars
39k
Forks
2.1k
Avg merge
1d 4h
Merged PRs (30d)
10

Description

Clear and concise description of the problem

As a user of Folo Desktop, I want to use a local LLM (such as Ollama) as the AI backend so that I can run summaries and analysis offline, privately, and without per-request costs. Impossible to integrate Folo with locally hosted models, even though many users already run these successfully in tools like RSS-Deck or Open WebUI.

Suggested solution

Add a “Custom / OpenAI-compatible LLM provider” option in AI settings with the following fields:
Provider type: OpenAI-compatible
Base URL (e.g. http://127.0.0.1:11434/v1)
API key (optional / dummy for local runtimes)
Model name (free text or auto-discovered)
Toggles for:
Streaming (on/off)
Tools / function calling (on/off)
Vision (on/off)
This would allow seamless integration with:
Ollama
LM Studio
Open WebUI
Any self-hosted OpenAI-compatible API

Alternative

No response

Additional context

I have a working local Ollama setup (http://127.0.0.1:11434) with models like mistral, but there is currently no place in the Folo UI to configure or select a custom LLM endpoint.

Happy to test or provide feedback if this feature is implemented.

Validations
  • Check that there isn't already an issue that request the same feature to avoid creating a duplicate.
  • This issue is valid

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating Folo Desktop's AI settings and its existing provider configuration or integration entry points. Review how provider URLs, models, API keys, streaming, tools, and vision are currently represented, then define the custom OpenAI-compatible option and verify it can connect to a local Ollama endpoint and support the requested settings.

Written by the indexing model from the issue text.

Assessment

Tech stack
ollama, typescript
Domain
ai, desktop
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.