MetOffice / MetOffice/CDDS

JASMIN v4.0.3 test failures

Open
#1,102 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
8
Forks
7
Avg merge
1d 15h
Merged PRs (30d)
23

Description

The following tests failed during the v4.0.3 install on JASMIN:
```
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_common/test_mappings_viewer/test_command_line.py::TestCommandLineHTMLGeneration::test_html_file_created - FileNotFoundError: [Errno 2] No such file or directory: '/$cdds_etc/STASHmaster/vn13.0/ctldata/STASHmaster/STASHmaster-me...
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_common/test_request/test_request.py::TestReadRequest::test_read_minimal_request - AssertionError: {'skip_extract': True, 'skip_extract_valida[468 chars]: ''} != {'cylc_args': [], 'model_params_dir': '', '[470 char...
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_common/test_request/test_request.py::TestWriteRequest::test_write_request - AssertionError: Lists differ: ['[me[2660 chars]ct = True', 'skip_extract_validation = False',[450 chars]t ='] != ['[me[2660 chars]c...
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_common/test_request/test_write_request/test_functional.py::TestWriteRequestForCMIP6::test_functional - AssertionError: 1 != 0
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_common/test_request/test_write_request/test_functional.py::TestWriteRequestForGCModelDev::test_functional - AssertionError: 1 != 0
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_extract/test_common.py::TestCommon::test_stash_fields_validation_unreadable - FileNotFoundError: [Errno 2] No such file or directory: 'ppfp'
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_extract/test_validate.py::TestValidate::test_calculate_file_frequency - AttributeError: The "variable_list_file" does not exist.
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_extract/test_validate.py::TestValidate::test_check_consistent_stash - AttributeError: The "variable_list_file" does not exist.
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_extract/test_validate.py::TestValidate::test_check_consistent_stash_gregorian - AttributeError: The "variable_list_file" does not exist.
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_extract/test_validate.py::TestValidate::test_check_consistent_stash_success_on_warning - AttributeError: The "variable_list_file" does not exist.
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_extract/test_validate.py::TestValidate::test_check_expected_stash - AttributeError: The "variable_list_file" does not exist.
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_extract/test_validate.py::TestValidate::test_configure_mapping_for_each_variable - AttributeError: The "variable_list_file" does not exist.
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_extract/test_validate.py::TestValidate::test_process_pp_streamtype - AttributeError: The "variable_list_file" does not exist.
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_validate/test_request_validations.py::TestValidations::test_cmip6_parent_validations - AssertionError: False is not true
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_validate/test_request_validations.py::TestValidations::test_cmip6_validations - AssertionError: False is not true
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_validate/test_request_validations.py::TestValidations::test_cordex_validations - AssertionError: False is not true
FAILED ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_validate/test_request_validations.py::TestValidations::test_invalid_stream_validations - AssertionError: Lists differ: ['The "variable_list_file" does not exist.'] != ['Stream unknown is not in the model parame[35 chars]...
ERROR ../conda_environments/cdds-4.0.3/lib/python3.12/site-packages/cdds/tests/test_deprecated/test_transfer/test_moo_cmd.py::TestLsFileSizes::test_moo_ls_file_size - FileNotFoundError: [Errno 2] No such file or directory: 'moo'
```

We also need to update the testing data on JASMIN for:
- TestCmip7_thetao_tavg_ol_hxy_sea::test_cmip7_mon_thetao
- TestCmip7_zostoga_tavg_u_hm_sea::test_cmip7_mon_zostoga
- TestCordexMonUv::test_cordex_mon_uv

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the v4.0.3 test run on JASMIN and begin with the named modules under cdds/tests/test_common, cdds/tests/test_extract, cdds/tests/test_validate, and cdds/tests/test_deprecated/test_transfer. Check the environment and test data behind the missing STASHmaster, variable-list, ppfp, and moo resources, then update the three listed JASMIN testing cases. Done means the reported failures are resolved and those tests pass.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
infrastructure, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.