google / google/uncertainty-baselines

Refactor `ensemble.py` implementations using SavedModel

Open
#71 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.6k
Forks
224
Avg merge
15h 36m
Merged PRs (30d)
2

Description

> @jereliu
> Currently the ensemble.py implementations in edward2/baselines compiles model graph by loading model hyper-parameters from flags, and then load model weights from checkpoints. This creates challenges for both model reproducibility (if there's a mismatch between the default and the actual model hyperparameters) and for code reuse.
>
> A better approach is to use SavedModel, so the ensemble script doesn't have to depend at all on re-defining the TF model code, and we can create a general-purpose ensemble script that aggregates black-box model predictions.

https://github.com/google/edward2/issues/366

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.