MetOffice / MetOffice/CDDS

Add KGO checker to nightly tests

Open
#563 0 comments 0 reactions 0 assignees View on GitHub
migrated
Dominant language
Python
Stars
8
Forks
7
Avg merge
1d 15h
Merged PRs (30d)
23

Description

Migrated Jira Issue CDDSO-13
Jira creation date 21/04/2022 15:23
-------
Once #1435 is completed, the nightly tests will be placing files in the MASS archive. To check that the tests are running successfully, we should check that all the expected files (and only the expected files) are present in the test location in MASS after the nightly tests run. The task should probably be in the test launcher suite, running after a delay of a few hours, use some sort of suite hook to check when the processing suites for each package is finished, and then checking the MASS archive for the expected files. We could also check other aspects such as:* execution time for tasks* memory usage by taskscheck what files are left on disk, to ensure things have been cleaned up correctly* check logs for critical errors (perhaps run the cdds_sim_review script)
-------

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the test launcher suite and the processing suites for each package, then determine how the nightly run exposes the test location in the MASS archive. Done means a post-run check confirms that all and only the expected files are present; the issue also lists possible checks for execution time, memory, disk cleanup, and critical log errors.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.