google-deepmind / google-deepmind/deepmind-research

[RL Unplugged] Is the data stored chronologically? Or how to retrive sequential data?

Open
#187 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
15.2k
Forks
2.9k
PR merge metrics
No merged PRs in 30d

Description

Hi,

Thanks for your nice work. I want to train an RNN agent with sequential data and I tested it with dm_control_suite. The paper mentioned that: "For sequence data, we also provide future states, actions, and rewards, which allows for training recurrent models for tasks requiring memory." But I can only get data with format (s,a,r,s', a') even I set `sarsa=False` when calling `dataset()` function as what you did in the `dm_control_suite_crr.py`, which also uses an RNN agent. Also, I printed out the data you fed into the CRRLearner, it's also in sarsa format with shape [batch_size, 2, state_size]. And I tried the data loader without calling `shuffle()`, the retrieved data is still shuffled.

So I want to know: 1. is the data stored chronologically? 2. can we get sequential data to train an RNN agent?

Thanks a lot!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.