deepseek-ai / deepseek-ai/DeepEP

Does DeepEP support sm86?(4A6000 without NVL)

Open
#481 9 comments 0 reactions 0 assignees View on GitHub
Dominant language
Cuda
Stars
10.1k
Forks
1.4k
Avg merge
4d 1h
Merged PRs (30d)
2

Description

Hello DeepEP Team,

**System Environment**
GPU: 4x NVIDIA A6000 (Ampere Architecture, Compute Capability sm_86)

Interconnect: GPUs are connected via PCIe (no NVLink).

**Problem Description**
export TORCH_CUDA_ARCH_LIST="8.6"
export DISABLE_SM90_FEATURES="1"
export NVSHMEM_DIR=$(...)
export CPLUS_INCLUDE_PATH=$CONDA_PREFIX/include
export LDFLAGS="-L/usr/local/cuda/lib64/stubs"

python setup.py install

** Error **
```
adding license file 'LICENSE'
writing manifest file 'deep_ep.egg-info/SOURCES.txt'
Copying deep_ep.egg-info to /home/zyhuang/miniconda3/envs/deepep_env/lib/python3.10/site-packages/deep_ep-1.2.1+9249c25-py3.10.egg-info
running install_scripts
(deepep_env) ada6000-02% python
Python 3.10.19 | packaged by conda-forge | (main, Oct 22 2025, 22:29:10) [GCC 14.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import deep_ep
Traceback (most recent call last):
File "", line 1, in
File "/home/zyhuang/temp_can/distributed/DeepEP/deep_ep/__init__.py", line 3, in
from .utils import EventOverlap
File "/home/zyhuang/temp_can/distributed/DeepEP/deep_ep/utils.py", line 7, in
from deep_ep_cpp import EventHandle
ImportError: /home/zyhuang/miniconda3/envs/deepep_env/lib/python3.10/site-packages/deep_ep_cpp.cpython-310-x86_64-linux-gnu.so: undefined symbol: _ZN7deep_ep12internode_ll17query_mask_bufferEPiiS1_P11CUstream_st
```

====> I can install, but can not import

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.