deepspeedai / deepspeedai/DeepSpeed
[REQUEST] How can one specify the CPU architecture to target.
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 43.1k
- Forks
- 5k
- Avg merge
- 4d 15h
- Merged PRs (30d)
- 112
Description
Is your feature request related to a problem? Please describe.
I work on a supercomputer where there is login and compute nodes. This architecture is typical in the HPC world.
Login nodes are where you land with ssh and often where you compile, prepare your environment and launch compute task (via SLURM).
There is no guarantee that the login node offers the same GPUs (if any) and CPUs than the one you'll find on the compute node.
How can one specify the CPU architecture with which we want to build the CPU ops.
There already is PYTORCH_ROCM_ARCH for the GPUs, Id say we need something for CPU too instead of the march=native.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files or tests are identified. Start by locating the CPU-op build configuration and the existing PYTORCH_ROCM_ARCH handling, then compare how march=native is selected. Done means providing a documented CPU-architecture selection mechanism that works when login and compute nodes differ.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- build-system, hpc
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100