enable efficient minibatch sampling for biases
Open
- Dominant language
- Jupyter Notebook
- Stars
- 712
- Forks
- 77
- Avg merge
- 9h 39m
- Merged PRs (30d)
- 1
Description
With weight matrices, it's difficult to sample a new set of weights for each example in a batch due to a lack of vectorization. This is easy and cheap to do for the bias term. We should do that. In practice, being Bayesian about the biases doesn't really help, but enabling the efficient option when we are is a good practice.
Contributor guide
Assessment
This issue has not been assessed yet.