kvcache-ai / kvcache-ai/Mooncake

[Feature Request]: Is there any plan to release official pre-built Docker images for Ascend NPU (910b/950)?

Open
#4,187 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
6.6k
Forks
1.2k
Avg merge
3d 5h
Merged PRs (30d)
312

Description

### Describe your feature request

## Question
I would like to ask whether the Mooncake team has a plan to release official pre-built Docker images for Ascend NPU (910b / 950).

### Background
Mooncake already supports compiling with `-DUSE_ASCEND_DIRECT=ON` to enable AscendDirectTransport.
Currently, the repository only provides Dockerfile for CUDA.
For Ascend users, we need to manually build the image from source every time. It is challenging to keep CANN version, driver and all dependencies aligned.

thanks a lot

### Before submitting a new issue...

- [ ] Make sure you already searched for relevant issues and read the [documentation](https://kvcache-ai.github.io/Mooncake/)

Contributor guide

Open the contributing guide

Research direction

Review the existing CUDA Dockerfile and the build path using -DUSE_ASCEND_DIRECT=ON for AscendDirectTransport. Determine how images for Ascend NPU 910b and 950 would align CANN, driver, and other dependencies, then define the supported image variants and verify that they build and provide the documented Ascend functionality.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, docker
Domain
devops, release
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.