exoplanet-dev / exoplanet-dev/exoplanet
PyMC v5 Sampling Performance Issues
- Dominant language
- Python
- Stars
- 239
- Forks
- 57
- PR merge metrics
- No merged PRs in 30d
Description
Sampling performance when using PyMC v5 compared to PyMC3 seems to be significantly degraded, both in sampling speed and accuracy. Running the [transit.ipynb tutorial](https://gallery.exoplanet.codes/tutorials/transit/) in separate conda environments with each version shows this.
PyMC3 Results:
Sampler:
Arviz Summary:
Corner plot:
Compare to the PyMC5 Results:
Sampler:
Arviz Summary:
Corner plot:
I have no idea why this might be the case, and it'd be nice to be able to use current versions of PyMC for various applications.
Contributor guide
Research direction
Start by running the transit.ipynb tutorial in separate conda environments with PyMC3 and PyMC v5, as described in the issue, and compare sampling speed, accuracy, ArviZ summaries, and corner plots. Done means identifying the source of the regression or narrowing it to a reproducible component with evidence from the tutorial comparison.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data, performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100