facebookresearch / facebookresearch/Pearl

Will n-D observation states be supported?

Open
#39 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Jupyter Notebook
Stars
3k
Forks
207
PR merge metrics
No merged PRs in 30d

Description

From the util function (and testing with `ALE/Bowling-v5`), it appears that only 1-D (vector) observation shapes are supported. Allowing for n-D shapes can be interesting as it can open up experiments things like text-embeddings, while maintaining the given structure.

Is there a plan to add this in?

Contributor guide

Open the contributing guide

Research direction

Start by locating the util function referenced in the report and reproduce the observation-shape behavior with ALE/Bowling-v5. Determine how n-D observation states should preserve their given structure, then confirm that the intended text-embedding experiments are supported.

Written by the indexing model from the issue text.

Assessment

Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.