Fix performance test to work on multiple architectures
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 2.8k
- Forks
- 388
- Avg merge
- 2d 17h
- Merged PRs (30d)
- 15
Description
The Stan performance test (in src/test/performance) only works on gelman-group-mac, the Mac Pro in the office. Among other things, this means Stan and Math jobs all block waiting on that node to become available to do the performance test. That node is also one of 2 that performs distribution tests, which take 7.5 hours, so the queue can get pretty backed up. Fixing the test to be more robust helps us run it more efficiently and lets people develop against it more effectively.
Current Version:
v2.17.0
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by inspecting the performance-test files under src/test/performance and identify assumptions that restrict execution to gelman-group-mac. Compare how Stan and Math jobs select nodes and run distribution tests. Done means the performance test runs robustly on multiple architectures without waiting on that single node.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- ci-cd, performance, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100