kvcache-ai / kvcache-ai/Mooncake

[Feature Requests] Known Issue Lists

Open
#1,276 1 comment 0 reactions 0 assignees View on GitHub
stale
Dominant language
C++
Stars
6.6k
Forks
1.2k
Avg merge
3d 5h
Merged PRs (30d)
312

Description

🚀 Welcome to the Mooncake community! Mooncake is an open-source project driven by collaboration, and your contributions—whether code, ideas, or feedback—will help shape its future.

## Production Feedback

Here, we maintain this issue list to record and track feedback from production-level users.

- [x] #1322
- [ ] Release Period & Release Notes
- [ ] Troubleshooting Doc
- [x] writeBody panic issue #1267

---

## CI & Infrastructure Tracking
This section tracks CI test failures, flaky tests, and infrastructure issues across Mooncake's CI pipeline. We focus on failures in the `main` branch and PR CI that are NOT caused by the PR itself.

### Quick Links
- [CI Workflow: ci.yml](https://github.com/kvcache-ai/Mooncake/blob/main/.github/workflows/ci.yml)
- [Integration Test (T-one)](https://github.com/kvcache-ai/Mooncake/blob/main/.github/workflows/integration-test.yml)
- [CI CUDA 13](https://github.com/kvcache-ai/Mooncake/blob/main/.github/workflows/ci_cu13.yml)
- [CI Ascend](https://github.com/kvcache-ai/Mooncake/blob/main/.github/workflows/ci_ascend.yml)

### Ongoing Issues

| Date | Test | Job | Error | Category | Status | Assignee | Link |
|------|------|-----|-------|----------|--------|----------|------|
| 2026-04-16 | `ub_transport_test` | build (3.10) | Test hung; no progress for 4h+ before job canceled | timeout | Enabled | - | [Failure](https://github.com/kvcache-ai/Mooncake/actions/runs/24490137429/job/71573411150?pr=1677) |
| 2026-04-03 | `TestMooncakeStress.test_stress_consistency_fixed` | test-wheel (3.12) | Data mismatch on key `stress_fixed_t5_14` | flaky | Enabled | - | [Failure](https://github.com/kvcache-ai/Mooncake/actions/runs/23883620269/job/69643888109?pr=1800) |

### Recently Fixed
| Date | Test | Fix | Related |
|------|------|-----|---------|
| 2026-04-16 | `HealthCheckTest.ReturnsTwoWhenMasterDown` / `HealthCheckTest.HttpReturns503WhenMasterDown` | Replace fixed 3s sleep with polling (`WaitForHealthCode`, 100ms × 10s) | #1868 |

### Infrastructure
| Issue | Status | Assignee | Related |
|-------|--------|----------|---------|
| - | - | - | - |

### Reporting a new failure
Comment with:
1. **Date** of failure
2. **Test name** (e.g., `health_check_test.HealthCheckTest.ReturnsTwoWhenMasterDown`)
3. **Job name** (e.g., `build (3.10)`)
4. **Error summary** (one line)
5. **Category**: `flaky` / `bug` / `environment` / `timeout` / `infrastructure`
6. **Link** to the failed CI run

### When a failure is fixed
Move the entry from "Ongoing Issues" to "Recently Fixed" with a link to the fix PR.

---

**Any feedback and contributions are appreciated.**

Contributor guide

Open the contributing guide

Research direction

Start with issue #1276 and inspect the linked .github/workflows/ci.yml, integration-test.yml, ci_cu13.yml, and ci_ascend.yml. Verify a failure against its linked run, then update Ongoing Issues or Recently Fixed using the stated fields and a fix PR link where applicable. The issue does not identify a particular failure to address.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions
Domain
ci-cd, documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.