NatLabRockies / NatLabRockies/H2Integrate
Reduce GH actions testing costs
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 26
- Forks
- 44
- Avg merge
- 3d 22h
- Merged PRs (30d)
- 16
Description
We got an unofficial request through the grapevine to scale back the amount of GH actions tests we're running.
This is probably because we have a swath of tests across different Python versions that run for every PR and commit pushed to the PRs.
We could reduce the minutes used by having the full testing suite only run on non-draft PRs or those marked "ready for review," per @RHammond2's suggestion.
Me thinking this through, we could also have just a subset of the tests run (e.g. just unit tests for one version of Python) for PRs not marked ready, or something like that.
Another obvious but more time-consuming way to reduce our testing computational cost is to reduce the scope and depth of the tests we run.
We could examine the cases that are run, cut out the unnecessary ones or simplify them, and see where that gets us.
Definitely worth more thought.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the GitHub Actions workflows and the Python-version test matrix that run for each pull request and commit. Compare the current behavior for draft and ready-for-review pull requests, and assess the proposed options for reducing test scope or depth. Done means an agreed workflow or test strategy that lowers computational cost without dropping required coverage.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- github-actions, python
- Domain
- ci-cd, devops, testing-qa
- Issue type
- Refactor
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100