stan-dev / stan-dev/docs

Improve docs for variational inference

Open
#112 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
TeX
Stars
43
Forks
133
Avg merge
11h 32m
Merged PRs (30d)
4

Description

Summary:

I would like to use the ADVI implemented in Stan but can't find helpful docs.

Description:

My model needs to fit a distribution based on KL divergence. This is possible with variational inference and as far as I understand, Stan has support for VI with it's ADVI functionality.

However, the user guide and reference manual contain only very superficial information on how VI is implemented internally. They don't provide instructions on how to use it.

It would be very helpful for me to see a working toy example. Let's say I have a Poisson distribution with gamma=10, and would like to represent it with a Gaussian which minimizes KL divergence.

Additional Information:

I've asked an equivalent question on SO: https://stackoverflow.com/questions/59276428/stan-how-to-use-variational-inference-to-fit-a-distribution

Current Version:

v2.21.0

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the Stan user guide and reference manual sections covering ADVI, then compare them with the linked Stack Overflow question. Add a working toy example using a Poisson distribution with gamma=10 and a Gaussian approximation minimizing KL divergence, with instructions sufficient for users to run it.

Written by the indexing model from the issue text.

Assessment

Tech stack
tex
Domain
documentation
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.