NatLabRockies / NatLabRockies/H2Integrate

Reduce GH actions testing costs

Open
#742 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
26
Forks
44
Avg merge
3d 22h
Merged PRs (30d)
16

Description

We got an unofficial request through the grapevine to scale back the amount of GH actions tests we're running.
This is probably because we have a swath of tests across different Python versions that run for every PR and commit pushed to the PRs.

We could reduce the minutes used by having the full testing suite only run on non-draft PRs or those marked "ready for review," per @RHammond2's suggestion.
Me thinking this through, we could also have just a subset of the tests run (e.g. just unit tests for one version of Python) for PRs not marked ready, or something like that.

Another obvious but more time-consuming way to reduce our testing computational cost is to reduce the scope and depth of the tests we run.
We could examine the cases that are run, cut out the unnecessary ones or simplify them, and see where that gets us.

Definitely worth more thought.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the GitHub Actions workflows and the Python-version test matrix that run for each pull request and commit. Compare the current behavior for draft and ready-for-review pull requests, and assess the proposed options for reducing test scope or depth. Done means an agreed workflow or test strategy that lowers computational cost without dropping required coverage.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions, python
Domain
ci-cd, devops, testing-qa
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.