Adjust at the end

Hi,

I don't know if it was already said, but it is still not fixed in the code.
When you are training your model, you calculate the weights_deltas between hidden layer and output layer.
But you are updating your weights too early, you are using the new weights to calculate deltas for previous weights (for back-propagation).
You have to keep deltas in memory then update at the end after the rest.

That's why your model takes a lot of time to be trained for the XOR problem. It shouldn't be that long. By memory you have took 50000 iterations. That is too big for a problem like this.

Keep going ^^.

P.S.: Sorry if my english is not perfect, it is not my main natural language.

Start by locating the training and back-propagation code in the repository and reproduce the XOR case described in the issue. Check that weight deltas remain available until the full back-propagation step completes, then verify that XOR training converges without requiring 50000 iterations.

Written by the indexing model from the issue text.