[QUESTION] KL divergence formula for the regularizer layer needs explication
Open
- Dominant language
- Jupyter Notebook
- Stars
- 30k
- Forks
- 13.1k
- PR merge metrics
- No merged PRs in 30d
Description
Hi @ageron ,
cell n°44 @ https://github.com/ageron/handson-ml2/blob/master/17_autoencoders_and_gans.ipynb,
you build a KLDivergence Layer,
but the formula you use is little difficult to understand at least for me,
Why
```
kl_divergence(self.target, mean_activities) +
kl_divergence(1. - self.target, 1. - mean_activities)
```
?
and not simply
`kl_divergence(self.target, mean_activities)`
?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.