carpedm20 / carpedm20/NAF-tensorflow

There is no optimization of prediction network in run2 function

Open
#10 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
192
Forks
60
PR merge metrics
No merged PRs in 30d

Description

As the title, in run2 function, should the optimization be add ahead of updating of target network?

Contributor guide

No contributing guide indexed for this repository

Research direction

Locate the run2 function and trace how prediction-network optimization and target-network updates are ordered. Compare the current flow with the intended training procedure for this TensorFlow reinforcement-learning implementation. Done means the ordering question is resolved in the implementation and verified through the project's available validation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.