Owner

LMCache

9 indexed repositories · View on GitHub

LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Python · 11866 stars
LMCache-Ascend
LMCache-Ascend is a plugin for running LMCache on the Ascend NPU.

Python · 89 stars
lmcache-vllm
The driver for LMCache core to run in vLLM

Python · 69 stars
LMBenchmark
Systematic and comprehensive benchmarks for LLM systems.

Python · 61 stars
demo

Python · 33 stars
lmcache_frontend
the frontend of lmcache

Python · 18 stars
LMBench
Modular Serving Engine x Workload Generator Benchmarking Tool

Python · 11 stars
lmcache-tests

Python · 10 stars
torchac_cuda

Cuda · 5 stars

Beginner friendly Everything

Open All

[good-first-issue] lint: remove stale G004 ignores for clean connector adapters Open

good first issue help wanted

Difficulty 1/5 Under an hour Newbie friendliness 92/100

LMCache/LMCache#5205 · 1 comment · Opened Sep 18, 2026
[good-first-issue] tests: convert v1 storage and shm logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

LMCache/LMCache#5204 · 2 comments · Opened Sep 18, 2026
[good-first-issue] tests: convert disagg channel logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 86/100

LMCache/LMCache#5203 · Opened Sep 18, 2026
[good-first-issue] tests: convert disagg cache-engine logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5202 · 1 comment · Opened Sep 18, 2026
[good-first-issue] connectors: convert SageMaker HyperPod logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 86/100

LMCache/LMCache#5201 · 1 comment · Opened Sep 18, 2026
[good-first-issue] connectors: convert HF3FS adapter logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5200 · 1 comment · Opened Sep 18, 2026
[good-first-issue] connectors: convert helper connector logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5199 · Opened Sep 18, 2026
[good-first-issue] connectors: convert backend connector logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5198 · 1 comment · Opened Sep 18, 2026
[good-first-issue] storage: convert NIXL backend logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5196 · 1 comment · Opened Sep 18, 2026
[good-first-issue] storage: convert PD backend logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 85/100

LMCache/LMCache#5195 · 1 comment · Opened Sep 18, 2026
[good-first-issue] health: convert health and lookup logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5193 · 3 comments · Opened Sep 18, 2026
[good-first-issue] compute: convert attention logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 85/100

LMCache/LMCache#5191 · 1 comment · Opened Sep 18, 2026
[good-first-issue] v1: convert cache-controller logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 85/100

LMCache/LMCache#5189 · 1 comment · Opened Sep 18, 2026
[good-first-issue] v1: convert API and server entrypoint logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 86/100

LMCache/LMCache#5188 · 1 comment · Opened Sep 18, 2026
[good-first-issue] logging: convert top-level LMCache utility logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

LMCache/LMCache#5187 · 1 comment · Opened Sep 18, 2026
[good-first-issue] examples: convert token_dropping experiment logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 86/100

LMCache/LMCache#5185 · Opened Sep 18, 2026
[good-first-issue] examples: convert token_dropping notebook logging to %-format Open

good first issue help wanted

Difficulty 2/5 Half a day Newbie friendliness 88/100

LMCache/LMCache#5184 · Opened Sep 18, 2026
[good-first-issue] examples: convert disagg_prefill_mp logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5183 · Opened Sep 18, 2026
[good-first-issue] examples: convert disagg_prefill logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5182 · 1 comment · Opened Sep 18, 2026
[good-first-issue] benchmarks: convert storage_backend_io logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 85/100

LMCache/LMCache#5181 · Opened Sep 18, 2026
[good-first-issue] benchmarks: convert rag logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

LMCache/LMCache#5180 · 1 comment · Opened Sep 18, 2026
[good-first-issue] benchmarks: convert multi_round_qa logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5179 · 2 comments · Opened Sep 18, 2026
[good-first-issue] buildkite: convert async_request logging to %-format Open

good first issue help wanted

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5178 · 1 comment · Opened Sep 18, 2026
[Bug] AddressManager accepts size 0, breaks free list / ZeroDivisionError Open

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5115 · 2 comments · Opened Sep 14, 2026
logging: convert f-string log calls in azure_adapter.py and audit_adapter.py to %-format Open

Difficulty 1/5 Under an hour Newbie friendliness 92/100

LMCache/LMCache#5112 · 1 comment · Opened Sep 14, 2026
logging: convert f-string log calls in eic_adapter.py and s3_adapter.py to %-format Open

Difficulty 1/5 Under an hour Newbie friendliness 94/100

LMCache/LMCache#5110 · 1 comment · Opened Sep 14, 2026
logging: convert f-string log calls in 3 small modules to %-format Open

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#5106 · 1 comment · Opened Sep 14, 2026
[Bug][MP] Failed prefetch cleanup can publish invalid L1 data Open

Difficulty 2/5 1-3 hours Newbie friendliness 86/100

LMCache/LMCache#5032 · Opened Sep 8, 2026
[good-first-issue] serde: convert f-string log calls in cachegen_basics.py to %-format Open

Difficulty 1/5 Under an hour Newbie friendliness 92/100

LMCache/LMCache#4937 · 2 comments · Opened Sep 4, 2026
[Bug] store_layer raises StopIteration in the vLLM worker when the store is skipped (freeze mode or unhealthy engine) Open

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#4927 · Opened Sep 3, 2026
[Bug][vLLM] LMCACHE_FORCE_SKIP_SAVE=false still disables cache writes Open

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

LMCache/LMCache#4862 · 1 comment · Opened Sep 1, 2026
[LMCache MP Mode] vLLM connector starts heartbeat lazily, causing LMCache to reap idle workers before first use Open

Difficulty 2/5 1-3 hours Newbie friendliness 78/100

LMCache/LMCache#4795 · 1 comment · Opened Aug 28, 2026
[good-first-issue] logging: use lazy formatting in NIXL transfer polling Open

Difficulty 1/5 1-3 hours Newbie friendliness 94/100

LMCache/LMCache#4737 · 5 comments · Opened Aug 26, 2026
[Bug][MP Observability] extra_stats throughput tests are flaky: synthetic timestamps are always past the pending-prune deadline Open

Difficulty 2/5 1-3 hours Newbie friendliness 74/100

LMCache/LMCache#4566 · 1 comment · Opened Aug 14, 2026
[Bug] LocalDiskBackend leaks disk-space accounting on every external remove, eventually dropping all disk puts silently Open

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

LMCache/LMCache#4546 · Opened Aug 13, 2026
[Bug] SegmentTokenDatabase._fast_split_by_subtensor falls through its early-exit guard (missing `return`) Open

Difficulty 1/5 Under an hour Newbie friendliness 88/100

LMCache/LMCache#4544 · Opened Aug 13, 2026
[good-first-issue] storage: convert f-string log calls in mooncakestore_connector.py to %-format Open

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#4506 · Opened Aug 12, 2026
Editorial project board for blog posts Open

Difficulty 2/5 Half a day Newbie friendliness 72/100

LMCache/LMCache#4436 · Opened Aug 5, 2026
[Docs] share_kv_cache centralized quickstart never produces a cache hit (sub-chunk prompt) Open

Difficulty 1/5 Under an hour Newbie friendliness 88/100

LMCache/LMCache#4109 · 2 comments · Opened Jul 14, 2026
[BUG] Crash in PD backend init due to NIXL change in LMCache v0.4.5 Open

Difficulty 2/5 1-3 hours Newbie friendliness 75/100

LMCache/LMCache-Ascend#264 · Opened Jul 13, 2026
TRT-LLM connector: _TRTLLM_KERNEL_BATCH_SIZE (32) exceeds c_ops kernel's 4-object cap → store fails for prompts >4 chunks Open

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

LMCache/LMCache#3889 · 2 comments · Opened Jun 26, 2026
request abortion bring down vllm service Open

stale

Difficulty 2/5 1-3 hours Newbie friendliness 75/100

LMCache/LMCache#3688 · 3 comments · 1 reaction · Opened Jun 15, 2026
能把文档写好一点吗？非得读代码才知道怎么用。 Open

Difficulty 2/5 1-3 hours Newbie friendliness 64/100

LMCache/LMCache-Ascend#210 · 2 reactions · Opened Apr 20, 2026
[Bug in compaction] Undefined variable in scheduler_adapter Open

Difficulty 2/5 1-3 hours Newbie friendliness 76/100

LMCache/lmcache-vllm#43 · Opened Dec 6, 2024
Add pandas installation Open

Difficulty 1/5 Under an hour Newbie friendliness 85/100

LMCache/lmcache-tests#4 · Opened Sep 17, 2024

LMCache

Get new issues in your inbox