google / google/uncertainty-baselines

Set up leaderplot plots with links to actual runs

Open
#66 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.6k
Forks
224
Avg merge
15h 36m
Merged PRs (30d)
2

Description

> @dustinvtran
> @dusenberrymw has a setup for plotting several metrics, compared across methods, and each method of which is averaged over multiple seeds. The plotting data is obtained directly from the experiments.
>
> This improves our existing leaderboard (a table) by 1. automatically averaging over multiple seeds instead of manually; and 2. programmatically going from experiment runs -> results for visualization purposes.
>
> It would be great to set this up for all datasets. Later, we should also look into how to enable this publically once Tensorboard.dev supports making available all the different experiment runs we'd like.

https://github.com/google/edward2/issues/279

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.