mudler/LocalAI

View on GitHub

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

Stars: 49.2k
Forks: 4.5k
Open beginner issues: 0
Indexed issues: 97
Avg merge: 1d 3m
Merged PRs (30d): 239

Dominant language: Go
License: MIT
Last GitHub push: Sep 19, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

97 open issues indexed

Add cachyllama as backend Open

area/backends enhancement new-backend

Difficulty 4/5 3-5 days Newbie friendliness 38/100

mudler/LocalAI#10590 · 1 comment · Opened Jun 29, 2026
CPU/RAM Offload CPU+GPU inference Open

area/backends enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/LocalAI#10557 · Opened Jun 27, 2026
Feature Discussion: P2P Federation, Realtime Ephemeral Keys, Reasoning Parser, and Distributed Cache Open

area/p2p enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/LocalAI#10317 · Opened Jun 13, 2026
Document Engineering Open

kind/documentation

Difficulty 3/5 1-2 days Newbie friendliness 48/100

mudler/LocalAI#10197 · 1 comment · Opened Jun 6, 2026
Feature: Add FunASR as a self-hosted ASR backend Open

area/backends enhancement new-backend

Difficulty 4/5 3-5 days Newbie friendliness 20/100

mudler/LocalAI#10073 · 3 comments · 1 reaction · Opened May 29, 2026
not possible to install on MacOS Tahoe 26.5 Open

bug os/macOS unconfirmed waiting-from-reporter

Difficulty 3/5 1-2 days Newbie friendliness 35/100

mudler/LocalAI#9947 · Opened May 22, 2026
Failed to load MTP Qwen3.6-35B-A3B-UD-Q4_K_S.gguf Open

area/llama.cpp bug unconfirmed upstream issue waiting-from-reporter

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mudler/LocalAI#9893 · Opened May 19, 2026
Skills are not available in Agent. Open

area/webui bug unconfirmed waiting-from-reporter

Difficulty 3/5 1-2 days Newbie friendliness 55/100

mudler/LocalAI#9868 · 2 comments · Opened May 17, 2026
Consider Vynly Integration for LocalAI Open

community-integrations enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

mudler/LocalAI#9861 · Opened May 17, 2026
To allow video as an input Open

area/api enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/LocalAI#9732 · 2 comments · Opened May 9, 2026
multiple regressions in llama.cpp backend: `max_tokens` loops in streaming mode, first token duplicated Open

area/llama.cpp bug unconfirmed waiting-from-reporter

Difficulty 4/5 3-5 days Newbie friendliness 48/100

mudler/LocalAI#9716 · 3 comments · Opened May 8, 2026
LocalAI使用llama.cpp时无法像LM Studio一样实现并发任务。 Open

area/llama.cpp kind/question

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mudler/LocalAI#9704 · 1 comment · Opened May 7, 2026
reasoning extraction only happens at end of stream Open

area/api bug unconfirmed waiting-from-reporter

Difficulty 3/5 1-2 days Newbie friendliness 58/100

mudler/LocalAI#9658 · 1 comment · Opened May 4, 2026
RFC: Add pkg/tokens — in-process token counter helper (tiktoken-go wrapper) Open

area/golang enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/LocalAI#9537 · 1 comment · Opened Apr 24, 2026
feat: persist Chat History server-side Open

area/api area/webui enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/LocalAI#9432 · 6 comments · 1 reaction · Opened Apr 19, 2026
RPC Internal Error when loading Gemma 3 (llama-cpp backends) Open

area/llama.cpp bug unconfirmed waiting-from-reporter

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mudler/LocalAI#9414 · Opened Apr 18, 2026
Add backend support dgx spark arm64 Open

area/backends arm64 enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/LocalAI#9386 · 4 comments · Opened Apr 16, 2026
Streaming + JSON Schema produces invalid JSON Open

area/llama.cpp bug unconfirmed waiting-from-reporter

Difficulty 4/5 3-5 days Newbie friendliness 42/100

mudler/LocalAI#9363 · 8 comments · Opened Apr 15, 2026
qwen3-tts-1.7b-custom-voice vllm-omni backend map fails. Qwen backend map has errors Open

area/backends area/vllm bug unconfirmed

Difficulty 4/5 3-5 days Newbie friendliness 48/100

mudler/LocalAI#9293 · 1 comment · Opened Apr 9, 2026
flux.1 kontext won't do image edits Open

area/backends bug diffusers unconfirmed

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mudler/LocalAI#9232 · 4 comments · Opened Apr 4, 2026
install python based backends in v4.0.0 nvidia-12 docker image not successful. Open

area/backends bug unconfirmed waiting-from-reporter

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mudler/LocalAI#9162 · 2 comments · Opened Mar 29, 2026
FlashAttention2 not available in hipblas docker images Open

area/backends bug unconfirmed upstream issue waiting-from-reporter

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mudler/LocalAI#9138 · Opened Mar 26, 2026
Streaming TTS support for other backends Open

enhancement roadmap

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mudler/LocalAI#9051 · 1 comment · Opened Mar 18, 2026
Intel GPU is not utilized by intel-qwen-asr Open

area/backends bug unconfirmed waiting-from-reporter

Difficulty 4/5 3-5 days Newbie friendliness 48/100

mudler/LocalAI#8934 · 4 comments · Opened Mar 10, 2026
Integrate Codanna codebase indexing Open

community-integrations enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/LocalAI#8110 · 3 comments · Opened Jan 18, 2026
Jobs monitor Open

area/webui enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/LocalAI#7906 · 5 comments · Opened Jan 7, 2026
MCP / Agent mode is not working when model file is shared Open

bug need-more-information roadmap unconfirmed

mudler/LocalAI#7143 · 1 comment · 1 reaction · 1 assignee · Opened Nov 6, 2025
Revamp CI Build Process Open

area/ci enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/LocalAI#5701 · 7 comments · Opened Jun 21, 2025
Expanded model back-ends Open

enhancement roadmap

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/LocalAI#5447 · 1 comment · Opened May 23, 2025
Hierarchical Model LRU/ARC and Manual Reclaim Open

enhancement roadmap

Difficulty 5/5 Over a week Newbie friendliness 20/100

mudler/LocalAI#5352 · 4 comments · 5 reactions · Opened May 12, 2025
Add support for framepack Open

enhancement roadmap

Difficulty 5/5 Over a week Newbie friendliness 20/100

mudler/LocalAI#5248 · 2 comments · Opened Apr 26, 2025
[epic] llama.cpp enhancements Open

enhancement roadmap

Difficulty 5/5 Over a week Newbie friendliness 20/100

mudler/LocalAI#5162 · Opened Apr 12, 2025
llama.cpp(outetts): add tts functionality to llama.cpp backend Open

roadmap

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/LocalAI#5161 · 2 comments · Opened Apr 12, 2025
Implement Web Search tool in /chat/completions Open

enhancement roadmap Stale

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/LocalAI#5018 · 2 comments · 1 reaction · Opened Mar 14, 2025
Support audio input and output in `/chat/completions` Open

enhancement roadmap

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/LocalAI#3877 · 1 comment · Opened Oct 18, 2024
Allow Setting `original_config_file` for Diffusers Backend Open

diffusers enhancement roadmap up for grabs

Difficulty 3/5 1-2 days Newbie friendliness 68/100

mudler/LocalAI#3250 · 1 comment · 1 reaction · Opened Aug 15, 2024
Automatically sync model folder Open

area/p2p enhancement roadmap

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/LocalAI#3216 · 6 comments · Opened Aug 11, 2024
Support RKLLM Open

enhancement roadmap up for grabs

Difficulty 5/5 Over a week Newbie friendliness 32/100

mudler/LocalAI#3192 · 5 comments · 7 reactions · Opened Aug 7, 2024
new engine: add whisper-medusa support Open

area/backends enhancement roadmap

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mudler/LocalAI#3127 · 2 comments · 1 reaction · Opened Aug 5, 2024
Please integrate chatTTS Open

area/backends enhancement new-backend roadmap

Difficulty 5/5 Over a week Newbie friendliness 30/100

mudler/LocalAI#2441 · 2 comments · Opened May 30, 2024
Native windows version? Open

enhancement roadmap

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/LocalAI#2368 · 7 comments · 16 reactions · Opened May 22, 2024
AudioLDM2Pipeline Open

enhancement roadmap

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/LocalAI#1699 · 2 comments · Opened Feb 12, 2024
Support DeepSpeed FastGen Open

area/ai-model area/backends enhancement roadmap

mudler/LocalAI#1538 · 2 comments · 1 assignee · Opened Jan 3, 2024
Vcoder Open

area/ai-model area/backends enhancement roadmap

mudler/LocalAI#1529 · 1 assignee · Opened Jan 1, 2024
unify transformer-based backends Open

enhancement roadmap

mudler/LocalAI#1411 · 1 assignee · Opened Dec 9, 2023
feat(outlines): Add support pf outlines Open

area/backends new-backend roadmap

mudler/LocalAI#1261 · 1 assignee · Opened Nov 8, 2023
diffusers: add esrgan Open

area/backends enhancement high prio roadmap up for grabs

Difficulty 4/5 3-5 days Newbie friendliness 25/100

mudler/LocalAI#917 · 1 comment · Opened Aug 17, 2023

mudler/LocalAI

Get new issues in your inbox