OpenMDAO / OpenMDAO/Aviary

Add regression testing capability

Open
#359 1 comment 0 reactions 3 assignees View on GitHub

@ehariton is already working on this.

Since Feb 11, 2026.

validation
Dominant language
Python
Stars
287
Forks
140
Avg merge
6d 14h
Merged PRs (30d)
18

Description

Desired capability or behavior.

via @robfalck
As we're reworking phases, we can check performance against the nominal GASP results but that data isn't very detailed.
We should also save more detailed results from each run (the test_phase scripts (currently run_phase scripts) should nominally test against this regression data using the assert_timeseries_near_equal function in dymos.

To do this, we should save all timeseries data off using the numpy.savetxt function in order to keep it as ascii (which is better for git than the binary database files).
The regression testing scripts should optionally overwrite current regression data when the team decides it is appropriate to do so.

Is your feature request related to a problem? Please describe.

No response

Associated Bug Report

No response

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.