google / google/uncertainty-baselines

Add robustness CIFAR test sets

Open
#60 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.6k
Forks
224
Avg merge
15h 36m
Merged PRs (30d)
2

Description

> @dustinvtran
> For cifar 10.1, add nll / accuracy / ce. For cifar c, add mean nll, mce, and mean ce. similarly cifar p.
>
> It looks like adding extra validation sets with the `model.fit
API is fairly involved (https://stackoverflow.com/questions/47731935/using-multiple-validation-sets-with-keras). We're planning to move to custom training loops anyways, so I'll get started on that first.
>
> This issue should be moved to Robustness Metrics' issue tracker once open-sourced.

https://github.com/google/edward2/issues/96

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.