karpathy / karpathy/pytorch-normalizing-flows

loss is negative

Open
#7 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
919
Forks
102
PR merge metrics
No merged PRs in 30d

Description

I just run a demo program, in which I would love to perform on these data:
![image](https://user-images.githubusercontent.com/61141271/82682320-134cb400-9c1d-11ea-82c2-231d03d5d683.png)
Actually, blue points are real data(x) while red points are z. The prior is N(mean of x, 0.01). Notice that I randomly set variance. Maybe 0.01 is larger than variance of x. Maybe smaller. I apply the default flows model in your ipynb. But loss varied from 800000->-30000->, and it is still decreasing. My question is how come negative loss would happen?
Plu, when I perform MAF/IAF,,,, loss would also be negative

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.