Farama-Foundation / Farama-Foundation/MicroRTS-Py

Reproduce Gridnet's SOTA agent with Trueskill Evaluation

Open
#36 7 comments 0 reactions 1 assignee Claimed by @vwxyzjn View on GitHub
Dominant language
Python
Stars
292
Forks
65
PR merge metrics
No merged PRs in 30d

Description

Now that we are trying to get the self-play agent working, it's important to set baselines that we want to achieve and excel. Our best past experiment is [this](https://wandb.ai/vwxyzjn/gym-microrts-paper/runs/asrpz468) (which I just now realized Chris had run with `--num-bot-envs 48`), which can achieve a Trueskill of `35.55` ([source](https://wandb.ai/vwxyzjn/cleanrl/runs/2x90jbfo)).

![image](https://user-images.githubusercontent.com/5555347/149858379-a6d8f203-43c8-425c-8f24-1db4c25c3c7c.png)

I am going to try reproduce with `python ppo_gridnet.py --num-bot-envs 24 --num-selfplay-envs 0 --total-timesteps 100000000 --num-models 300`, see if we can get the same level of performance, so

```
python ppo_gridnet.py \
--num-bot-envs 24 --num-selfplay-envs 0 \
--total-timesteps 100000000 --num-models 300 \
--capture-video --prod-mode
```

After this, I am going to check if I can reproduce the same results with the new vecenv implementation in #34

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.