CodingTrain / CodingTrain/Toy-Neural-Network-JS

Bias variable names are a little confusing

Open
#128 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
437
Forks
242
PR merge metrics
No merged PRs in 30d

Description

The bias nodes exist only in pre-output layers, but for example, the weight connected the the hidden bias neuron is called `bias_o`. This confused me a lot, so I think it is easier to understand `bias_o` as `bias_h` and `bias_h` as `bias_i`. This way I think it's easier to read the code that updates the biases, since the gradient from the output layer, for example, is mapped to the bias in the *previous* layer, as the process of backpropagation might suggest by its name.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.