deepspeedai / deepspeedai/DeepSpeed
Which version of rocm does Deepspeed support?
@loadams is already working on this.
Since Oct 16, 2025.
- Dominant language
- Python
- Stars
- 43.1k
- Forks
- 5k
- Avg merge
- 4d 15h
- Merged PRs (30d)
- 112
Description
I don't know if my analysis is correct
I encountered this issue during compilation
https://github.com/deepspeedai/DeepSpeed/issues/7565#issuecomment-3305379549
When I checked the source code, I found that
deepspeed/ops/csrc/deepspeed4science/evoformer_attn/gemm_kernel_utils.h:234
CUTLASS_DEVICE int32_t warp_uniform(int32_t value)
{
return (int32_t)__shfl_sync(0xffffffff, (unsigned)value, 0);
}
/opt/rocm-6.4.1/include/hip/amd_detail/amd_warp_sync_functions.h:230
template <typename MaskT, typename T>
__device__ inline
T __shfl_sync(MaskT mask, T var, int srcLane,
int width = warpSize) {
static_assert(
__hip_internal::is_integral<MaskT>::value && sizeof(MaskT) == 8,
"The mask must be a 64-bit integer. "
"Implicitly promoting a smaller integer is almost always an error.");
__hip_adjust_mask_for_wave32(mask);
__hip_check_mask(mask);
return __shfl(var, srcLane, width);
}
That is to say, in this version, it seems that rocm compilation is bound to encounter errors because the type sizeof (MaskT)==8 is always incorrect
But it seems that no one has reported this, so I'm not quite sure now
Could it be that the linker encountered an error during compilation? Found the abnormal header file?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.