karpathy / karpathy/pytorch-normalizing-flows

Different performance when using SlowMAF and MAF

Open
#6 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
919
Forks
102
PR merge metrics
No merged PRs in 30d

Description

Hi there,
I have been using your Normalizing Flows codes for variational inference. When I use the two different flows: SlowMAF and MAF, the quality of these two results are very different (Slow version is much better than the Masked version). I guess it may be caused by the inproper use of MADE, which I set
`self.net = MADE(in_dim, [hidden_dim, hidden_dim, hidden_dim], out_dim, num_masks=1, natural_ordering=True)`
with simply 1 masks using the original order. All the other hyperparameters are stayed unchanged. But I observed the computational efficiency is much improved.

So can you tell me what details did I miss for the result?

Much appreciated,
Xuebin.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.