astropy / astropy/astropy-benchmarks
Seek hardware to run nightly benchmark outside of STScI
- Dominant language
- Python
- Stars
- 9
- Forks
- 35
- Avg merge
- 2d 3h
- Merged PRs (30d)
- 1
Description
We currently do not have a reliable nightly benchmarking infrastructure. STScI hosting is currently broken. And even when it runs, it is on a VM beyond our control.
As discussed in Astropy Coordination Meeting 2025, possible options we could pursue:
* From US-RSE Slack (thanks to Kelle Cruz): https://blog.omsf.io/introducing-omsf-self-hosted-runners/
* Oregon State University (thanks to James Tocknell): https://osuosl.org/services/hosting/details/
* Ethan Holz (OMSF): The OSU Open Source Lab is very cool! Also a great resource. I will note that the tool we produced requires you to bring your own cloud. More than happy to help bridge the knowledge gap if that is of interest to you!
* Ask NumFOCUS again?
Close #130
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reviewing why the current STScI nightly benchmarking hosting is unreliable, then compare the OMSF self-hosted runner, Oregon State University hosting, and NumFOCUS options linked in the issue. Done means selecting and documenting a reliable hosting path for nightly benchmarks outside STScI.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- infrastructure, performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100