stan-dev / stan-dev/stan

Warn when step size falls below a given threshold in adaptation?

Open
#2,261 2 comments 0 reactions 1 assignee View on GitHub

@betanalpha is already working on this.

Since Apr 3, 2017.

feature
Dominant language
C++
Stars
2.8k
Forks
388
Avg merge
2d 17h
Merged PRs (30d)
15

Description

Description:

Currently adaption makes no attempt to warn the user when the step size falls to extremely small values. Technically such small values are okay and indicate an intermediate state where the sampler is trying to adapt to a posterior with a poorly-posed covariance. Because those models are not ideal, however, it may be useful to warn the user. Additionally, inaccurate gradients also force the adaptation to extremely small step sizes.

A somewhat-informative warning can be displayed to users, but when should it be displayed?

  • Anytime that the step size adaptation falls below a threshold? This has the advantage of warning the user quickly, but also will dump a ton of output.
  • Anytime the step size adaptation transitions from above the threshold to below? This reduces the output but also doesn't display any warnings when adaptation terminates.
  • At the end of each adaptation window? This doesn't warn the user early but it does remind them towards to the end of adaptation.
Current Version:

v2.14.0

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.