carpedm20 / carpedm20/deep-rl-tensorflow

Trained model (checkpoint file) not found?

Open
#30 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.6k
Forks
394
PR merge metrics
No merged PRs in 30d

Description

No matter I am doing training or testing, there is a warning like
` [!] Load FAILED: checkpoints/Breakout-v0/env_name=Breakout-v0/agent_type=DQN/batch_size=32/beta=0.01/data_format=NHWC/decay=0.99/discount_r=0.99/double_q=False/ep_end=0.01/ep_start=1.0/gamma=0.99/history_length=4/learning_rate=0.00025/learning_rate_decay=0.96/learning_rate_decay_step=50000/learning_rate_minimum=0.00025/max_delta=None/max_grad_norm=None/max_r=1/min_delta=None/min_r=-1/momentum=0.0/n_action_repeat=1/network_header_type=nips/network_output_type=normal/observation_dims=80,80/random_start=True/t_ep_end=1000000/t_learn_start=50000/t_target_q_update_freq=10000/t_test=10000/t_train_freq=4/t_train_max=500000/use_cumulated_reward=False/`

Actually there is indeed an output file generated in the path of above warning under a new folder named 'logs'. But that is a weird file named `'events.out.tfevents.1508026080.vpn-campus-152-3-71-166.ssl.vpn.school_name.edu'`. It does not look like the checkpoint, but a file about network.

Thus I am wondering how the check point file stored after training and how to load them when testing? Any suggestion will be greatly appreciated, thanks !

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing how training and testing handle checkpoints under checkpoints/Breakout-v0/... and compare that with the logs/events.out.tfevents... file mentioned in the report. Run a short training session, then testing, and verify that a checkpoint is created at the expected path and loaded without the warning.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.