deepspeedai / deepspeedai/DeepSpeed

Installation instructions for ROCm absent

Open
#7,570 5 comments 0 reactions 1 assignee View on GitHub

@loadams is already working on this.

Since Sep 19, 2025.

rocm
Dominant language
Python
Stars
43.1k
Forks
5k
Avg merge
4d 15h
Merged PRs (30d)
112

Description

The installation instructions state that installing deepspeed is as simple as pip install deepspeed. However, this will install the nvidia version of pytorch.

If I install the ROCm pytorch with;

pip3 install torch torchvision --index-url https://download.pytorch.org/whl/rocm6.4

and then do

pip install deepseek

The command ds_report fails with the following error message;

[2025-09-19 13:31:26,997] [INFO] [real_accelerator.py:260:get_accelerator] Setting ds_accelerator to cuda (auto detect)
Traceback (most recent call last):
  File "/home/user/git/openfold/.venv/bin/ds_report", line 3, in <module>
    from deepspeed.env_report import cli_main
  File "/home/user/git/openfold/.venv/lib/python3.12/site-packages/deepspeed/__init__.py", line 25, in <module>
    from . import ops
  File "/home/user/git/openfold/.venv/lib/python3.12/site-packages/deepspeed/ops/__init__.py", line 15, in <module>
    from ..git_version_info import compatible_ops as __compatible_ops__
  File "/home/user/git/openfold/.venv/lib/python3.12/site-packages/deepspeed/git_version_info.py", line 29, in <module>
    op_compatible = builder.is_compatible()
                    ^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/git/openfold/.venv/lib/python3.12/site-packages/deepspeed/ops/op_builder/fp_quantizer.py", line 35, in is_compatible
    sys_cuda_major, _ = installed_cuda_version()
                        ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/user/git/openfold/.venv/lib/python3.12/site-packages/deepspeed/ops/op_builder/builder.py", line 51, in installed_cuda_version
    raise MissingCUDAException("CUDA_HOME does not exist, unable to compile CUDA op(s)")
deepspeed.ops.op_builder.builder.MissingCUDAException: CUDA_HOME does not exist, unable to compile CUDA op(s)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.