kvcache-ai / kvcache-ai/Mooncake
[Feature Request]: Is there any plan to release official pre-built Docker images for Ascend NPU (910b/950)?
- Dominant language
- C++
- Stars
- 6.6k
- Forks
- 1.2k
- Avg merge
- 3d 5h
- Merged PRs (30d)
- 312
Description
### Describe your feature request
## Question
I would like to ask whether the Mooncake team has a plan to release official pre-built Docker images for Ascend NPU (910b / 950).
### Background
Mooncake already supports compiling with `-DUSE_ASCEND_DIRECT=ON` to enable AscendDirectTransport.
Currently, the repository only provides Dockerfile for CUDA.
For Ascend users, we need to manually build the image from source every time. It is challenging to keep CANN version, driver and all dependencies aligned.
thanks a lot
### Before submitting a new issue...
- [ ] Make sure you already searched for relevant issues and read the [documentation](https://kvcache-ai.github.io/Mooncake/)
Contributor guide
Research direction
Review the existing CUDA Dockerfile and the build path using -DUSE_ASCEND_DIRECT=ON for AscendDirectTransport. Determine how images for Ascend NPU 910b and 950 would align CANN, driver, and other dependencies, then define the supported image variants and verify that they build and provide the documented Ascend functionality.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, docker
- Domain
- devops, release
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 38/100