Farama-Foundation / Farama-Foundation/MicroRTS-Py

Faster Convergence

Open
#51 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
292
Forks
65
PR merge metrics
No merged PRs in 30d

Description

Training an agent now still takes a long time. The particular [experiment](https://wandb.ai/costa-huang/gym-microrts/runs/2v658xqx) in #36 took 4d 9h 11m 14s to finish.

Looking at the reward chart, it appears the agent could achieve 70% of the final performance in just 50M steps (or about 10 hours into training)

![image](https://user-images.githubusercontent.com/5555347/151291819-8cd5111b-b003-4c07-bd20-cbbd5bd0cad3.png)

We should try to optimize based on the 10 hours time computational budget.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.