Eclectic-Sheep / Eclectic-Sheep/sheeprl

Add optional orthogonal initialization to models

Open
#14 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
439
Forks
66
PR merge metrics
No merged PRs in 30d

Description

`per_layer_ortho_init_weights` function is developed but never used. We should add the option to activate it when a neural network is created.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the existing `per_layer_ortho_init_weights` function and the neural-network creation paths. Trace how model creation options are configured, then verify that the new option activates orthogonal initialization when requested and remains optional otherwise.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.