mudler/vllm.cpp

View on GitHub

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)

Stars: 423
Forks: 53
Open beginner issues: 0
Indexed issues: 351
Avg merge: 20h 26m
Merged PRs (30d): 310

Dominant language: C++
License: Apache-2.0
Last GitHub push: Sep 20, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

351 open issues indexed

Port GLiNER2.5 (fastino/gliner2.5-multi-v1) zero-shot NER to vllm.cpp Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/vllm.cpp#3216 · Opened Sep 18, 2026
[Vulkan][32-bit] non-dispatchable handles do not fit in void* on i586 Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

mudler/vllm.cpp#3182 · Opened Sep 13, 2026
[32-bit] nvfp4_plan_cache.h fails with size_t narrowing on i586 Open

Difficulty 1/5 Under an hour Newbie friendliness 88/100

mudler/vllm.cpp#3181 · Opened Sep 13, 2026
MODEL-MM-GLM53-FLASH: the compose — glm5_next_device.cpp and the remaining nine arms Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/vllm.cpp#3174 · Opened Sep 13, 2026
vLLM oracle: GPU page fault in ROCm Triton paged-attention fallback (Qwen3.5 GDN, IQ3_XXS, gfx1200) Open

Difficulty 5/5 Over a week Newbie friendliness 32/100

mudler/vllm.cpp#3167 · Opened Sep 12, 2026
Captured-pair gates: score fresh runs against an oracle-side-only top-K golden instead of the self-anchor Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/vllm.cpp#3160 · Opened Sep 12, 2026
test_tower_skip_rss_arm: over half the suite fails, fake health server exits before ready Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mudler/vllm.cpp#3158 · Opened Sep 12, 2026
test_drop_file_cache: posix_fadvise cache-drop proof fails when /tmp is tmpfs Open

Difficulty 4/5 3-5 days Newbie friendliness 50/100

mudler/vllm.cpp#3157 · Opened Sep 12, 2026
fix(WINDOWS): test_openai_api_server.exe crashes with STATUS_ACCESS_VIOLATION on Windows CI Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 48/100

mudler/vllm.cpp#3151 · Opened Sep 12, 2026
test_cpu_threadpool: the 100x dispatch ratio is calibrated on 20 cores and flakes on 4-vCPU CI runners Open

Difficulty 3/5 1-2 days Newbie friendliness 58/100

mudler/vllm.cpp#3130 · 1 comment · Opened Sep 11, 2026
fix(BACKEND-ROCM-QUANT-GATHER): label the comparison scope from the run, not a literal Open

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

mudler/vllm.cpp#3126 · Opened Sep 10, 2026
test_backend_cross_device: MoeRouterTopK flakes intermittently on gfx1200 Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mudler/vllm.cpp#3121 · Opened Sep 10, 2026
test_backend_cross_device: causal conv1d fwd/update flakes intermittently on gfx1200 Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

mudler/vllm.cpp#3119 · Opened Sep 10, 2026
fix(BACKEND-ROCM-QUANT-GATHER): reject unqualified model captures Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

mudler/vllm.cpp#3113 · Opened Sep 9, 2026
fix(BACKEND-ROCM-ATTN-GATE-SPLIT): identify the actual F16 head in the forward test Open

Difficulty 3/5 1-2 days Newbie friendliness 65/100

mudler/vllm.cpp#3112 · Opened Sep 9, 2026
fix(BACKEND-GATE-ROCM-SGLANG): diagnose Qwen3-4B first-inference GPU hang on Strix Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/vllm.cpp#3111 · 10 comments · Opened Sep 9, 2026
test(BACKEND-GATE-ROCM-SGLANG): publish lifecycle diagnostic aggregate once Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

mudler/vllm.cpp#3110 · 2 comments · Opened Sep 9, 2026
Carry per-group slot mappings into multi-KV forwards Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

mudler/vllm.cpp#3109 · Opened Sep 9, 2026
fix: reap the Strix adapter resource tracker before exit Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/vllm.cpp#3108 · 14 comments · Opened Sep 9, 2026
bench: extend matched Strix qualification to c1 c4 and c32 Open

Difficulty 5/5 Over a week Newbie friendliness 28/100

mudler/vllm.cpp#3107 · 6 comments · Opened Sep 9, 2026
ROCm unfused gated attention cannot dispatch AttnGateSplit Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

mudler/vllm.cpp#3106 · Opened Sep 9, 2026
fix(BACKEND-ROCM): diagnose the gfx1100 Qwen3 paged anchor drift Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mudler/vllm.cpp#3105 · Opened Sep 9, 2026
fix(MODEL-TEXT-qwen3-qwen3-for-causal-lm): diagnose the CPU paged anchor drift Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

mudler/vllm.cpp#3102 · Opened Sep 9, 2026
fix(BACKEND-ROCM): bind resource operations to the requested device Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/vllm.cpp#3100 · Opened Sep 9, 2026
feat(BACKEND-ROCM-QUANT-GATHER): gather quantized embeddings on ROCm Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/vllm.cpp#3093 · Opened Sep 9, 2026
feat(BACKEND-ROCM-F16-WEIGHTS): retain F16 dense and embedding weights on ROCm Open

Difficulty 5/5 Over a week Newbie friendliness 28/100

mudler/vllm.cpp#3092 · Opened Sep 9, 2026
fix(BACKEND-ROCM): bound HRX decode writes to each KV group Open

Difficulty 4/5 3-5 days Newbie friendliness 28/100

mudler/vllm.cpp#3091 · Opened Sep 8, 2026
fix: accept proven loader reservations in profiler preflight Open

Difficulty 5/5 Over a week Newbie friendliness 42/100

mudler/vllm.cpp#3090 · 2 comments · Opened Sep 8, 2026
Require distinct Q and K projections in native HRX Qwen fusion Open

Difficulty 3/5 1-2 days Newbie friendliness 72/100

mudler/vllm.cpp#3089 · Opened Sep 8, 2026
Reject non-finite values in the native HRX numerical comparator Open

Difficulty 2/5 1-3 hours Newbie friendliness 78/100

mudler/vllm.cpp#3088 · Opened Sep 8, 2026
Correct native HRX explicit RoPE frequency factors Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mudler/vllm.cpp#3086 · Opened Sep 8, 2026
research(KERNEL-CUDA-DECODE-MEGAKERNEL): evaluate tile-scheduled persistent decode Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/vllm.cpp#3084 · Opened Sep 8, 2026
Qualify native HRX Qwen prefill graph scheduling Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

mudler/vllm.cpp#3083 · Opened Sep 8, 2026
Qualify HRX HIP function attributes for registered host kernels Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mudler/vllm.cpp#3082 · Opened Sep 8, 2026
Qualify HRX dense WMMA after Loom removes a live template provider Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/vllm.cpp#3081 · Opened Sep 8, 2026
Evaluate native HRX and Loom on gfx1100 with matched measurements Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/vllm.cpp#3080 · Opened Sep 8, 2026
test(BACKEND-GATE-ROCM-SGLANG): calibrate a Qwen3-4B correctness proposal Open

Difficulty 5/5 Over a week Newbie friendliness 28/100

mudler/vllm.cpp#3077 · 3 comments · Opened Sep 8, 2026
perf(BACKEND-GATE-ROCM-SGLANG): close the Qwen3-4B Strix c4 gap Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/vllm.cpp#3076 · 14 comments · Opened Sep 8, 2026
fix(BACKEND-GATE-ROCM-SGLANG): isolate llama c4 input corruption Open

Difficulty 5/5 Over a week Newbie friendliness 28/100

mudler/vllm.cpp#3075 · 6 comments · Opened Sep 8, 2026
fix(BACKEND-GATE-ROCM-SGLANG): isolate offload inspection from installed kernels Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

mudler/vllm.cpp#3074 · 2 comments · Opened Sep 8, 2026
fix(BACKEND-GATE-ROCM-SGLANG): query shared memory through pinned HIP driver Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mudler/vllm.cpp#3072 · Opened Sep 8, 2026
test(BACKEND-ROCM): reconcile the Strix full-suite failures Open

Difficulty 5/5 Over a week Newbie friendliness 28/100

mudler/vllm.cpp#3070 · 1 comment · Opened Sep 8, 2026
test(KERNEL-QUANT-CIQ-GEMM-ROCM): match cooperative-tile toggle parsing Open

Difficulty 3/5 1-2 days Newbie friendliness 68/100

mudler/vllm.cpp#3063 · Opened Sep 8, 2026
KV-WARMUP-PROFILE: reconcile actual startup and generation config observations Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/vllm.cpp#3061 · 1 comment · Opened Sep 8, 2026
Capture the actual startup graph-manager fields before profile finalization Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mudler/vllm.cpp#3059 · Opened Sep 8, 2026
fix(GATE-PR-SIZE-TEMPDIR): honor caller temporary storage for semantic evidence Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

mudler/vllm.cpp#3058 · Opened Sep 8, 2026
BACKEND-ROCM: graph state checker rejects the quantized SiLU provider Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

mudler/vllm.cpp#3056 · Opened Sep 8, 2026
BACKEND-ROCM: ROCGdb CFA failure blocks causal-convolution instruction capture Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/vllm.cpp#3054 · Opened Sep 8, 2026
bench(BACKEND-GATE-ROCM-SGLANG): qualify Qwen3-4B BF16 for matched Strix comparison Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

mudler/vllm.cpp#3053 · 15 comments · Opened Sep 8, 2026
ROCm: resolve malformed rocprofv3 argument export before trace attribution Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

mudler/vllm.cpp#3051 · 2 comments · Opened Sep 8, 2026

mudler/vllm.cpp

Get new issues in your inbox