Question for deepqlearn.js
Open
- Dominant language
- JavaScript
- Stars
- 11.2k
- Forks
- 2.1k
- PR merge metrics
- No merged PRs in 30d
Description
The following is my understanding about the backward function in deepqlearn.js.
If it is in learning process, after one forward path, it begins to do backward propagation. It does SGD with a batch size of N. Those N samples are randomly selecting from replay memory. The code seems to show that the weight matrix of the network is updated N times by calling the backward function once. But in my opinion, the SGD should only update the weight matrix once by averaging all weight updates of a batch size of N.
Please correct me if I have misunderstood sometime.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.