Document the TensorDict structure of the return of the _step() function for a multi agent environment
Open
@YeonwooSung is already working on this.
Since Sep 5, 2026.
enhancement
- Dominant language
- Python
- Stars
- 3.6k
- Forks
- 484
- Avg merge
- 1d 1h
- Merged PRs (30d)
- 207
Description
Motivation
It is not very clear what should be the structure of TensorDict of the return of the _step() function for a multi agent environment.
If there are two agents A and B and they are in separate groups, what would be the structure of the TensorDict that is returned by the _step() function?
Solution
Update the documentation and provide an example of a multi agent environment that is written natively in torchrl and it is not translated from other frameworks like petting zoo
Checklist
- I have checked that there is no similar issue in the repo (required)
@matteobettini
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.