carpedm20 / carpedm20/variational-text-tensorflow

About the nasm implementation.

Open
#4 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
535
Forks
76
PR merge metrics
No merged PRs in 30d

Description

Is the implementation correct?

The computation of KL Divergence in your code is

```
# Kullback Leibler divergence
self.e_loss = -0.5 * tf.reduce_sum(1 + self.log_sigma_sq - tf.square(self.mu) - tf.exp(self.log_sigma_sq))
```
However, this is the KL Divergence of a gaussian and a standard gaussion. According to the paper, the KL Divergence is about two non-standard gaussian.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.