CodingTrain / CodingTrain/Toy-Neural-Network-JS
Bias variable names are a little confusing
Open
- Dominant language
- JavaScript
- Stars
- 437
- Forks
- 242
- PR merge metrics
- No merged PRs in 30d
Description
The bias nodes exist only in pre-output layers, but for example, the weight connected the the hidden bias neuron is called `bias_o`. This confused me a lot, so I think it is easier to understand `bias_o` as `bias_h` and `bias_h` as `bias_i`. This way I think it's easier to read the code that updates the biases, since the gradient from the output layer, for example, is mapped to the bias in the *previous* layer, as the process of backpropagation might suggest by its name.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.