instadeepai / instadeepai/Mava

Sable paper figure question

Open
#1,202 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
935
Forks
123
Avg merge
6d 8h
Merged PRs (30d)
9

Description

Hi there! I was wondering how you guys generated this figure in the Sable paper?

Image

I'd like to generate a similar "aggregated evaluator win rate" plot for SMAX where it's essentially just an average win rate across all of the SMAX tasks (instead of just a single task). Did you guys use Marl-eval to generate your aggregated plots? I can't seem to find a similar option and I'd like to be as similar as possible (hence why I haven't just put my own function together yet).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.