google / google/uncertainty-baselines
Refactor `ensemble.py` implementations using SavedModel
Open
- Dominant language
- Python
- Stars
- 1.6k
- Forks
- 224
- Avg merge
- 15h 36m
- Merged PRs (30d)
- 2
Description
> @jereliu
> Currently the ensemble.py implementations in edward2/baselines compiles model graph by loading model hyper-parameters from flags, and then load model weights from checkpoints. This creates challenges for both model reproducibility (if there's a mismatch between the default and the actual model hyperparameters) and for code reuse.
>
> A better approach is to use SavedModel, so the ensemble script doesn't have to depend at all on re-defining the TF model code, and we can create a general-purpose ensemble script that aggregates black-box model predictions.
https://github.com/google/edward2/issues/366
Contributor guide
Assessment
This issue has not been assessed yet.