deepspeedai/DeepSpeed

View on GitHub

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Stars: 43.1k
Forks: 5k
Open beginner issues: 5
Indexed issues: 1.2k
Avg merge: 4d 15h
Merged PRs (30d): 112

Dominant language: Python
License: Apache-2.0
Last GitHub push: Sep 19, 2026
Latest indexed: Sep 20, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

11 beginner-friendly issues open

init_inference rejects dtype=torch.int8 on every accelerator Open

Difficulty 2/5 1-3 hours Newbie friendliness 78/100

deepspeedai/DeepSpeed#8577 · Opened Sep 18, 2026
[BUG] AutoTP checkpoint load raises AttributeError on a model containing nn.InstanceNorm1d Open

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

deepspeedai/DeepSpeed#8514 · Opened Sep 14, 2026
[BUG] Python checkpoint writers fail to reload full ZeRO-3 state with default torch.load Open

Difficulty 2/5 1-3 hours Newbie friendliness 78/100

deepspeedai/DeepSpeed#8500 · Opened Sep 13, 2026
[BUG] set_norm_for_param_grad_in_gpu's grad_accum fallback is dead in both accumulation modes Open

Difficulty 2/5 1-3 hours Newbie friendliness 76/100

deepspeedai/DeepSpeed#8371 · Opened Aug 31, 2026
Consider adding a changelog to track version history Open

Difficulty 1/5 1-3 hours Newbie friendliness 68/100

deepspeedai/DeepSpeed#8101 · 1 comment · Opened Jun 30, 2026
Trouble running tests: Failed to find precompiled modules Open

Difficulty 2/5 1-3 hours Newbie friendliness 74/100

deepspeedai/DeepSpeed#7909 · 1 comment · 1 reaction · Opened Mar 17, 2026
[BUG] FlopsProfiler upsample flops compute bug Open

bug training

Difficulty 2/5 1-3 hours Newbie friendliness 68/100

deepspeedai/DeepSpeed#5537 · 1 comment · Opened May 15, 2024
[BUG] Mis-typed free_blocks Open

bug inference

Difficulty 2/5 1-3 hours Newbie friendliness 62/100

deepspeedai/DeepSpeed#5407 · Opened Apr 12, 2024
Compression training: when quantizer_kernel is enabled, the check target of "rounding" param should be "nearest" instead of "nearest_neighbor" Open

Difficulty 1/5 Under an hour Newbie friendliness 88/100

deepspeedai/DeepSpeed#4013 · 1 comment · Opened Jul 21, 2023
[BUG] incorrectly loading layer_keys in deepspeed_checkpoint.py Open

bug compression

Difficulty 2/5 1-3 hours Newbie friendliness 82/100

deepspeedai/DeepSpeed#3305 · 1 comment · Opened Apr 19, 2023
max_grad_norm is ignored in FP16 training Open

Difficulty 2/5 1-3 hours Newbie friendliness 72/100

deepspeedai/DeepSpeed#102 · 5 comments · 1 reaction · Opened Feb 24, 2020

deepspeedai/DeepSpeed

Get new issues in your inbox