Kaixhin / Kaixhin/Atari

Implement Pop-Art

Open
#6 0 comments 0 reactions 0 assignees View on GitHub
enhancement help wanted
Dominant language
Lua
Stars
263
Forks
72
PR merge metrics
No merged PRs in 30d

Description

[Learning functions across many orders of magnitudes](http://arxiv.org/abs/1602.07714) introduces Preserving Outputs Precisely, while Adaptively Rescaling Targets (Pop-Art). In summary it normalises outputs across orders of magnitudes and gets rid of the clipping (i.e. counting) rewards heuristic for Atari games. The normalisation is also better for non-stationary problems, i.e., any decent real world problem.

The below is a picture of extra notes from the authors, next to their poster at NIPS 2016:
![img_20161207_190428](https://cloud.githubusercontent.com/assets/991891/21581880/ee1290b2-d03a-11e6-842b-a613c3eb8935.jpg)

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start with the linked Pop-Art paper and the authors' poster notes, then inspect the Atari repository to locate the learning implementation. Done means Pop-Art output normalisation and adaptive rescaling are implemented without relying on reward clipping.

Written by the indexing model from the issue text.

Assessment

Tech stack
lua
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.