google-deepmind / google-deepmind/deepmind-research

[RL Unplugged] How to recover the sequential data

Open
#110 3 comments 1 reaction 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
15.2k
Forks
2.9k
PR merge metrics
No merged PRs in 30d

Description

Hi, I am interested in testing my algorithm on `dm_control` dataset as benchmark and I am trapped in data loading part.

Since `dm_control` is a set of sequential control tasks and I have seen in `dm_control_suite_crr.ipynb` the CRR algorithm is using LSTM, I assume the dataset must have structure to store the time order of the data. But, when I try the demos in the repository, the dataset seem to be shuffled and I only get tuples like (s, a, r, s', a').

I am not familiar with `tf.data.Dataset`, so could anyone hint me out about how to recover the sequential structure of the data? Or, the sequential structure is not stored by the dataset at all? Thanks in advance!

Contributor guide

Open the contributing guide

Research direction

Start with dm_control_suite_crr.ipynb and the repository demos; inspect how tf.data.Dataset is built and whether shuffling occurs. Determine whether sequential ordering is preserved or discarded, then document how users can recover it or state that it is unavailable.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook, tensorflow
Domain
data, machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.