kvcache-ai/Mooncake

View on GitHub

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Stars: 6.6k
Forks: 1.2k
Open beginner issues: 0
Indexed issues: 275
Avg merge: 3d 5h
Merged PRs (30d): 312

Dominant language: C++
License: Apache-2.0
Last GitHub push: Sep 17, 2026
Latest indexed: Sep 17, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue help wanted

Open All

275 open issues indexed

[RoadMap][Call For Contributions] Mooncake Store V3 Roadmap Open

Roadmap

kvcache-ai/Mooncake#1035 · 12 comments · 30 reactions · 0 assignees · Indexed Sep 17, 2026
[RoadMap] Mooncake Transfer Engine NEXT Open

Roadmap

kvcache-ai/Mooncake#1058 · 17 comments · 12 reactions · 0 assignees · Indexed Sep 17, 2026
[Usage]: sglang使用mooncake时开启root_fs_dir, sglang内存飙升 Open

kvcache-ai/Mooncake#1195 · 34 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
[RFC]: Hot Standby Mode for Master Service Metadata High Availability Open

good first issue

kvcache-ai/Mooncake#1200 · 4 comments · 3 reactions · 0 assignees · Indexed Sep 17, 2026
[Feature Requests] Known Issue Lists Open

stale

kvcache-ai/Mooncake#1276 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
[RFC]: Kv Events API Standardization Open

stale

kvcache-ai/Mooncake#1527 · 20 comments · 4 reactions · 2 assignees · Indexed Sep 17, 2026
[RFC]: Mooncake Data Plane Model Distribution, Phase 1 Open

kvcache-ai/Mooncake#1767 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[RFC]: End-to-End Transfer Tracing for Mooncake Open

kvcache-ai/Mooncake#1850 · 1 comment · 3 reactions · 0 assignees · Indexed Sep 17, 2026
[Bug]: HA模式切换新leader后元数据丢失 Open

kvcache-ai/Mooncake#1871 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
[RoadMap][Call For Contribution] Mooncake Project Overall Roadmap Open

kvcache-ai/Mooncake#1883 · 14 comments · 9 reactions · 0 assignees · Indexed Sep 17, 2026
[RFC]: Mooncake Store NVMe KV Backend Open

kvcache-ai/Mooncake#1957 · 3 comments · 1 reaction · 0 assignees · Indexed Sep 17, 2026
[RFC]: Radix Tree Index — Prefix-Aware KV Cache Management and Cascading Eviction Open

kvcache-ai/Mooncake#1998 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
[Bug]: Massive performance degradation when a replica fails in multi-node SGLang HiCache with Mooncake backend Open

bug

kvcache-ai/Mooncake#2039 · 19 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[Feature Request]: Support multiple pairs of NPUs for point-to-point transfer in transfer_engine_ascend_direct_perf.cpp Open

kvcache-ai/Mooncake#2096 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[RFC]: Agent-Aware KV Cache Support in Mooncake (Phase 1) Open

kvcache-ai/Mooncake#2098 · 3 comments · 3 reactions · 0 assignees · Indexed Sep 17, 2026
[RFC]: Hierarchical Arch for Intra/Inter Data Center Deployment Open

enhancement Roadmap Store

kvcache-ai/Mooncake#2117 · 8 comments · 4 reactions · 1 assignee · Indexed Sep 17, 2026
[RFC]: TENT Local Transfer Admission Queue Open

kvcache-ai/Mooncake#2132 · 6 comments · 1 reaction · 1 assignee · Indexed Sep 17, 2026
[Usage]: Mooncake HA: Primary-side OpLog writing not wired — by design or pending work? Open

stale

kvcache-ai/Mooncake#2188 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
[Call For Contributions] Mooncake Conductor Roadmap Open

kvcache-ai/Mooncake#2189 · 9 comments · 3 reactions · 2 assignees · Indexed Sep 17, 2026
[Bug]: 使用内置mooncake client方式（ModeA）卸载大量请求的KV到DRAM和SSD后，VLLM PD实例重启，重启后重新压测之前的请求，无法在DRAM和SSD中命中，导致Prefix Cache命中率降低ttft增加 Open

bug

kvcache-ai/Mooncake#2254 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
[RFC] Unified KVCache and Model Weight Management in Mooncake Store Open

kvcache-ai/Mooncake#2282 · 4 comments · 3 reactions · 0 assignees · Indexed Sep 17, 2026
[RFC]: Refactor and Improve DistributedStorageBackend (and 3FS Adapter) Open

kvcache-ai/Mooncake#2426 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[Performance]: segment utilization imbalance with heterogeneous segment sizes Open

kvcache-ai/Mooncake#2430 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[Bug]: Execute mooncake+hixl, final destruction phase core Open

bug stale

kvcache-ai/Mooncake#2440 · 4 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[Feature Request]: 集成绿算技术 GP 系列 NVMe-oF 存储后端，打造极致性能的 Mooncake 大模型推理集群 Open

stale

kvcache-ai/Mooncake#2444 · 10 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[Feature Request]: Optimize SSD remote read with RDMA direct push Open

stale

kvcache-ai/Mooncake#2451 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[RFC]: Coordinator-Based Control Plane for Mooncake PG Open

kvcache-ai/Mooncake#2454 · 1 comment · 1 reaction · 1 assignee · Indexed Sep 17, 2026
[Bug] RDMA transport fails cross-subnet: missing route resolution for gateway MAC Open

kvcache-ai/Mooncake#2468 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[RFC]: Zero-Copy Read/Write: Eliminate Redundant Data Copies Open

stale

kvcache-ai/Mooncake#2479 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[Bug]: DummyClient::register_buffer fails for buffers outside pre-mapped shared memory segments Open

bug stale

kvcache-ai/Mooncake#2501 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[RFC]: L2→L1 proactive promotion via bounded master-side scan V2 Open

kvcache-ai/Mooncake#2509 · 12 comments · 1 reaction · 1 assignee · Indexed Sep 17, 2026
[Feature Request]: Topology- and load-aware remote replica selection in SelectBestReplica Open

kvcache-ai/Mooncake#2516 · 8 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[Performance]: BatchEvict full-metadata scan dominates eviction-cycle time at 1M objects (and holds snapshot_mutex_ for that duration) Open

kvcache-ai/Mooncake#2560 · 9 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[RFC]: Traffic class hint API for TransferEngine — bridging upper-layer semantics (KV / EP / CTRL) to lower-layer SL/TC Open

kvcache-ai/Mooncake#2568 · 6 comments · 2 reactions · 0 assignees · Indexed Sep 17, 2026
[Installation]: Wheels compiled with MACA flags cannot be installed on identically configured machines Open

kvcache-ai/Mooncake#2574 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[RFC]: Mooncake Store Hardware Abstraction Open

RFC

kvcache-ai/Mooncake#2581 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 17, 2026
[Installation]: Build release wheels in the PyTorch manylinux image instead of ubuntu-22.04 Open

kvcache-ai/Mooncake#2586 · 4 comments · 1 reaction · 0 assignees · Indexed Sep 17, 2026
[Bug]: KV Cache Memory Registration and Transfer Fails with RDMA Transport in SGLang PD Split Mode When MACA Compile Option Is Enabled Open

bug

kvcache-ai/Mooncake#2589 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 17, 2026
[RFC]: Comprehensive MoE / EP Kernel Benchmark Under Incast Traffic Open

kvcache-ai/Mooncake#2607 · 7 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
[RFC]: RL Disaggregation via Rollout / Update Separation and Shared Mooncake Data Plane Open

kvcache-ai/Mooncake#2608 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 17, 2026
[RFC]: (AI-Friendly Knowledge Base): Organize Mooncake’s knowledge into a format that is easy for AI systems to read and consume Open

kvcache-ai/Mooncake#2609 · 7 comments · 2 reactions · 1 assignee · Indexed Sep 17, 2026
CI: build-flags job appears to hit runner disk/network instability across recent PRs Open

kvcache-ai/Mooncake#2611 · 2 comments · 1 reaction · 0 assignees · Indexed Sep 17, 2026
[Bug]: SEGMENT_NOT_FOUND, whether to bind the pin thread to an idle core Open

bug

kvcache-ai/Mooncake#2621 · 5 comments · 1 reaction · 2 assignees · Indexed Sep 17, 2026
[Usage]: NoF write/read requires strict block-size alignment but neither allocators nor value_size guarantee it — is this by design? Open

kvcache-ai/Mooncake#2631 · 4 comments · 1 reaction · 0 assignees · Indexed Sep 17, 2026
[Bug]: When Mooncake Store is running with offload enabled, offloading works correctly but a large number of offloading tasks expire after 600s, producing "Offloading task expired" warnings. Open

bug

kvcache-ai/Mooncake#2632 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
[Bug]: Snapshot restore loses segment protocol and allocator replica_type Open

bug

kvcache-ai/Mooncake#2636 · 3 comments · 1 reaction · 2 assignees · Indexed Sep 17, 2026
[RFC]: Deprecate and remove the test-only `initAll` / `init_all` initialization API Open

RFC

kvcache-ai/Mooncake#2639 · 8 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
[RoadMap] External Known Issues and PRs related to Mooncake Open

kvcache-ai/Mooncake#2647 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
[TE] Refactor: unify libfabric-based transports (EFA / CXI) shared infrastructure Open

kvcache-ai/Mooncake#2657 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
[RFC]: Add TPU Transport Support via PJRT Open

RFC

kvcache-ai/Mooncake#2662 · 7 comments · 2 reactions · 1 assignee · Indexed Sep 17, 2026

kvcache-ai/Mooncake

Get new issues in your inbox