google-deepmind / google-deepmind/deepmind-research
[RL Unplugged] Is the data stored chronologically? Or how to retrive sequential data?
- Dominant language
- Jupyter Notebook
- Stars
- 15.2k
- Forks
- 2.9k
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
Thanks for your nice work. I want to train an RNN agent with sequential data and I tested it with dm_control_suite. The paper mentioned that: "For sequence data, we also provide future states, actions, and rewards, which allows for training recurrent models for tasks requiring memory." But I can only get data with format (s,a,r,s', a') even I set `sarsa=False` when calling `dataset()` function as what you did in the `dm_control_suite_crr.py`, which also uses an RNN agent. Also, I printed out the data you fed into the CRRLearner, it's also in sarsa format with shape [batch_size, 2, state_size]. And I tried the data loader without calling `shuffle()`, the retrieved data is still shuffled.
So I want to know: 1. is the data stored chronologically? 2. can we get sequential data to train an RNN agent?
Thanks a lot!
Contributor guide
Assessment
This issue has not been assessed yet.