deepspeedai / deepspeedai/DeepSpeedExamples

Decay for deepspeed norm & bias params?

Open
#68 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
6.8k
Forks
1.1k
Avg merge
2d 16h
Merged PRs (30d)
1

Description

When segregating the parameters for the optimizer the norm & bias parameters are not included: https://github.com/microsoft/DeepSpeedExamples/blob/35b4582486fe096a5c669b6ca35a3d5c6a1ec56b/bing_bert/deepspeed_train.py#L370

Is this handled elsewhere or was decay intentionally applied to all the deepspeed transformer layer parameters?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at deepspeed_train.py around line 370 and trace how optimizer parameters are segregated. Check whether norm and bias parameters are handled elsewhere in the example, then establish the intended decay behavior and update the example accordingly if the omission is unintended.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.