deepspeedai / deepspeedai/DeepSpeed

[BUG] Try to use zero++ in hf model training

Open
#3,827 2 comments 0 reactions 1 assignee View on GitHub

@samadejacobs is already working on this.

Since Jun 27, 2023.

bug training
Dominant language
Python
Stars
43.1k
Forks
5k
Avg merge
4d 15h
Merged PRs (30d)
112

Description

deepspeed version == v0.9.5: Patch release
ValidationError: 3 validation errors for DeepSpeedZeroConfig
zero_hpz_partition_size
extra fields not permitted (type=value_error.extra)
zero_quantized_gradients
extra fields not permitted (type=value_error.extra)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.