Add KGO checker to nightly tests
- Dominant language
- Python
- Stars
- 8
- Forks
- 7
- Avg merge
- 1d 15h
- Merged PRs (30d)
- 23
Description
Migrated Jira Issue CDDSO-13
Jira creation date 21/04/2022 15:23
-------
Once #1435 is completed, the nightly tests will be placing files in the MASS archive. To check that the tests are running successfully, we should check that all the expected files (and only the expected files) are present in the test location in MASS after the nightly tests run. The task should probably be in the test launcher suite, running after a delay of a few hours, use some sort of suite hook to check when the processing suites for each package is finished, and then checking the MASS archive for the expected files. We could also check other aspects such as:* execution time for tasks* memory usage by taskscheck what files are left on disk, to ensure things have been cleaned up correctly* check logs for critical errors (perhaps run the cdds_sim_review script)
-------
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the test launcher suite and the processing suites for each package, then determine how the nightly run exposes the test location in the MASS archive. Done means a post-run check confirms that all and only the expected files are present; the issue also lists possible checks for execution time, memory, disk cleanup, and critical log errors.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100