carpedm20 / carpedm20/variational-text-tensorflow
About the nasm implementation.
Open
- Dominant language
- Python
- Stars
- 535
- Forks
- 76
- PR merge metrics
- No merged PRs in 30d
Description
Is the implementation correct?
The computation of KL Divergence in your code is
```
# Kullback Leibler divergence
self.e_loss = -0.5 * tf.reduce_sum(1 + self.log_sigma_sq - tf.square(self.mu) - tf.exp(self.log_sigma_sq))
```
However, this is the KL Divergence of a gaussian and a standard gaussion. According to the paper, the KL Divergence is about two non-standard gaussian.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.