Owner

LMCache

9 indexed repositories · View on GitHub

LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python · 11866 stars
LMCache-Ascend
LMCache-Ascend is a plugin for running LMCache on the Ascend NPU.

Python · 89 stars
lmcache-vllm
The driver for LMCache core to run in vLLM

Python · 69 stars
LMBenchmark
Systematic and comprehensive benchmarks for LLM systems.

Python · 61 stars
demo

Python · 33 stars
lmcache_frontend
the frontend of lmcache

Python · 18 stars
LMBench
Modular Serving Engine x Workload Generator Benchmarking Tool

Python · 11 stars
lmcache-tests

Python · 10 stars
torchac_cuda

Cuda · 5 stars

Beginner friendly Everything

Open All

MP mode (LMCacheMPConnector) ignores save_decode_cache and stores decode KV, causing unbounded L1/L2 writes and premature eviction Open

Difficulty 4/5 3-5 days Newbie friendliness 56/100

LMCache/LMCache#5230 · 1 comment · Opened Sep 18, 2026
[Feature][MP] Negotiate chunk_size from vLLM KV geometry at first registration Open

enhancement mp_mode versioning / compatibility vllm

Difficulty 5/5 Over a week Newbie friendliness 35/100

LMCache/LMCache#5217 · Opened Sep 18, 2026
[good-first-issue] lint: remove stale G004 ignores for clean connector adapters Open

good first issue help wanted

Difficulty 1/5 Under an hour Newbie friendliness 92/100

LMCache/LMCache#5205 · 1 comment · Opened Sep 18, 2026
[good-first-issue] tests: convert v1 storage and shm logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

LMCache/LMCache#5204 · 2 comments · Opened Sep 18, 2026
[good-first-issue] tests: convert disagg channel logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 86/100

LMCache/LMCache#5203 · Opened Sep 18, 2026
[good-first-issue] tests: convert disagg cache-engine logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5202 · 1 comment · Opened Sep 18, 2026
[good-first-issue] connectors: convert SageMaker HyperPod logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 86/100

LMCache/LMCache#5201 · 1 comment · Opened Sep 18, 2026
[good-first-issue] connectors: convert HF3FS adapter logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5200 · 1 comment · Opened Sep 18, 2026
[good-first-issue] connectors: convert helper connector logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5199 · Opened Sep 18, 2026
[good-first-issue] connectors: convert backend connector logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5198 · 1 comment · Opened Sep 18, 2026
[good-first-issue] connectors: convert common connector logging to %-format Open

good first issue help wanted

Difficulty 3/5 1-2 days Newbie friendliness 82/100

LMCache/LMCache#5197 · 1 comment · Opened Sep 18, 2026
[good-first-issue] storage: convert NIXL backend logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5196 · 1 comment · Opened Sep 18, 2026
[good-first-issue] storage: convert PD backend logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 85/100

LMCache/LMCache#5195 · 1 comment · Opened Sep 18, 2026
[good-first-issue] storage: convert package backend logging to %-format Open

good first issue help wanted

LMCache/LMCache#5194 · 3 comments · 1 assignee · Opened Sep 18, 2026
[good-first-issue] health: convert health and lookup logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5193 · 3 comments · Opened Sep 18, 2026
[good-first-issue] compute: convert blend and model logging to %-format Open

good first issue help wanted

Difficulty 3/5 1-2 days Newbie friendliness 82/100

LMCache/LMCache#5192 · 1 comment · Opened Sep 18, 2026
[good-first-issue] compute: convert attention logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 85/100

LMCache/LMCache#5191 · 1 comment · Opened Sep 18, 2026
[good-first-issue] v1: convert config and cache-engine logging to %-format Open

good first issue help wanted

Difficulty 3/5 1-2 days Newbie friendliness 86/100

LMCache/LMCache#5190 · 1 comment · Opened Sep 18, 2026
[good-first-issue] v1: convert cache-controller logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 85/100

LMCache/LMCache#5189 · 1 comment · Opened Sep 18, 2026
[good-first-issue] v1: convert API and server entrypoint logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 86/100

LMCache/LMCache#5188 · 1 comment · Opened Sep 18, 2026
[good-first-issue] logging: convert top-level LMCache utility logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

LMCache/LMCache#5187 · 1 comment · Opened Sep 18, 2026
[good-first-issue] examples: convert rkv_variants notebook logging to %-format Open

good first issue help wanted

Difficulty 3/5 1-2 days Newbie friendliness 82/100

LMCache/LMCache#5186 · Opened Sep 18, 2026
[good-first-issue] examples: convert token_dropping experiment logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 86/100

LMCache/LMCache#5185 · Opened Sep 18, 2026
[good-first-issue] examples: convert token_dropping notebook logging to %-format Open

good first issue help wanted

Difficulty 2/5 Half a day Newbie friendliness 88/100

LMCache/LMCache#5184 · Opened Sep 18, 2026
[good-first-issue] examples: convert disagg_prefill_mp logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5183 · Opened Sep 18, 2026
[good-first-issue] examples: convert disagg_prefill logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5182 · 1 comment · Opened Sep 18, 2026
[good-first-issue] benchmarks: convert storage_backend_io logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 85/100

LMCache/LMCache#5181 · Opened Sep 18, 2026
[good-first-issue] benchmarks: convert rag logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

LMCache/LMCache#5180 · 1 comment · Opened Sep 18, 2026
[good-first-issue] benchmarks: convert multi_round_qa logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5179 · 2 comments · Opened Sep 18, 2026
[good-first-issue] buildkite: convert async_request logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5178 · 1 comment · Opened Sep 18, 2026
[MP] [Bug] Isolated IPC: KV re-registration after a server restart fails with CUDA_ERROR_INVALID_CONTEXT Open

Difficulty 4/5 3-5 days Newbie friendliness 76/100

LMCache/LMCache#5168 · Opened Sep 17, 2026
[Feature] Provide a Kubernetes probe for end-to-end MP server and worker health Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

LMCache/LMCache#5164 · Opened Sep 17, 2026
[Bug] MP server: lookup reports full hit but restored KV context is wrong for long prefixes (breaks between 114 and 128 chunks) Open

bug

LMCache/LMCache#5151 · 6 comments · 1 assignee · Opened Sep 17, 2026
[Bug] flaky test: test_sparse_skip_l2_locks_only_l1 Open

Difficulty 3/5 1-2 days Newbie friendliness 72/100

LMCache/LMCache#5135 · Opened Sep 16, 2026
Security: /run_script admin endpoint is unauthenticated in-process code execution, served by default on 0.0.0.0 Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

LMCache/LMCache#5128 · Opened Sep 15, 2026
[Proposal] Enforce lazy %-format logging (ruff G004) so the f-string logging migration stops regressing Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

LMCache/LMCache#5118 · 5 comments · Opened Sep 15, 2026
[Bug] AddressManager accepts size 0, breaks free list / ZeroDivisionError Open

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5115 · 2 comments · Opened Sep 14, 2026
logging: convert f-string log calls in azure_adapter.py and audit_adapter.py to %-format Open

Difficulty 1/5 Under an hour Newbie friendliness 92/100

LMCache/LMCache#5112 · 1 comment · Opened Sep 14, 2026
logging: convert f-string log calls in eic_adapter.py and s3_adapter.py to %-format Open

Difficulty 1/5 Under an hour Newbie friendliness 94/100

LMCache/LMCache#5110 · 1 comment · Opened Sep 14, 2026
logging: convert f-string log calls in 3 small modules to %-format Open

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5106 · 1 comment · Opened Sep 14, 2026
[Question] MP mode + `--engine-type blend`: is there a client-side (vLLM) counterpart that sends CB_REGISTER_ROPE_V3? Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

LMCache/LMCache#5101 · Opened Sep 14, 2026
LMCache MP 0.5.5 with GLM-5.3-Flash fails on non-contiguous tensor or no IPC lookup key Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

LMCache/LMCache#5097 · Opened Sep 13, 2026
Every cache hit logs "Double unpin occurred somewhere" (pin count driven to -1) Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

LMCache/LMCache#5090 · Opened Sep 13, 2026
[RFC][MP][Coordinator] L1 cache moves Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

LMCache/LMCache#5083 · Opened Sep 12, 2026
[Feature][MP] Commit windowed KV to L2 on turn boundaries Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

LMCache/LMCache#5073 · 3 comments · Opened Sep 11, 2026
from_gpu() skips the stream sync when the destination buffer is CUDA, so PD senders with pd_buffer_device: "cuda" can RDMA a half-written KV chunk Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

LMCache/LMCache#5048 · Opened Sep 9, 2026
[Bug][MP] Failed prefetch cleanup can publish invalid L1 data Open

Difficulty 2/5 1-3 hours Newbie friendliness 86/100

LMCache/LMCache#5032 · Opened Sep 8, 2026
[RFC] Shared Device-DAX KV pooling for LMCache MP servers Open

Difficulty 5/5 Over a week Newbie friendliness 32/100

LMCache/LMCache#5030 · 1 comment · 3 reactions · Opened Sep 8, 2026
[BUG][TURBOQUANT] FP9 key store kernel fails on A100 (SM80) with bfloat16 models — Triton assertion error in `convert_custom_float8` Open

Difficulty 3/5 1-2 days Newbie friendliness 76/100

LMCache/LMCache#5022 · Opened Sep 8, 2026
[RFC] Add Rust raw-block I/O performance and observability metrics Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

LMCache/LMCache#5016 · 6 comments · Opened Sep 8, 2026

Showing the newest 100

This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.

Open advanced filter

LMCache

Showing the newest 100

Get new issues in your inbox