kvcache-ai / kvcache-ai/Mooncake

[Usage]: AscendDirectTransport fails with “ctx js NULL” on CANN 9.1.0 and Mooncake 0.3.12

Open
#3,451 2 comments 0 reactions 1 assignee Claimed by @ascend-direct-dev View on GitHub
Dominant language
C++
Stars
6.6k
Forks
1.2k
Avg merge
3d 5h
Merged PRs (30d)
312

Description

### Describe your usage question

Environment
•Hardware: Ascend 910B4
•HDK: 25.5.1
•CANN Docker Image: cann:9.1.0-910b-openeuler24.03-py3.12-devel
•Mooncake Version: 0.3.12.post1 (installed via pip install mooncake-transfer-engine-npu)

Questions
It seems the mooncake_store process did not properly initialize the ACL device context(aclrtSetDevice/aclrtCreateContext) or select the correct device before allocating the local segment under CANN 9.1.0.
Could you please confirm if this version combination is officially supported, or if there is any workaround/fix required? Thanks!

### Before submitting a new issue...

- [x] Make sure you already searched for relevant issues and read the [documentation](https://kvcache-ai.github.io/Mooncake/)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.