deepspeedai / deepspeedai/DeepSpeed

[REQUEST] How can one specify the CPU architecture to target.

Open
#5,451 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Python
Stars
43.1k
Forks
5k
Avg merge
4d 15h
Merged PRs (30d)
112

Description

Is your feature request related to a problem? Please describe.
I work on a supercomputer where there is login and compute nodes. This architecture is typical in the HPC world.
Login nodes are where you land with ssh and often where you compile, prepare your environment and launch compute task (via SLURM).
There is no guarantee that the login node offers the same GPUs (if any) and CPUs than the one you'll find on the compute node.

How can one specify the CPU architecture with which we want to build the CPU ops.
There already is PYTORCH_ROCM_ARCH for the GPUs, Id say we need something for CPU too instead of the march=native.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files or tests are identified. Start by locating the CPU-op build configuration and the existing PYTORCH_ROCM_ARCH handling, then compare how march=native is selected. Done means providing a documented CPU-architecture selection mechanism that works when login and compute nodes differ.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
build-system, hpc
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.