project-chip / project-chip/matter-test-scripts
Nightly Jobs Failing with false positive status
@jtrejoespinoza-grid is already working on this.
Since Jun 9, 2026.
- Dominant language
- Python
- Stars
- 19
- Forks
- 7
- Avg merge
- 3d 17h
- Merged PRs (30d)
- 3
Description
Test running with run_python_tests fails when the test take more than 3 minutes to execute.
Description:
Currently Nightly jobs are failing, they are reported as complete but inspecting the logs will confirm the test is failing.
Example: https://github.com/project-chip/connectedhomeip/actions/runs/27077859958/job/79919136814
The issue is a TERMINATION_TIMEOUT_S introduced in the following PR: https://github.com/project-chip/connectedhomeip/pull/72241 to avoid test to hang and terminate them but at the same time is terminating test that take more time than TERMINATION_TIMEOUT_S, as is the case for SU Tests.
Another issue that is observed is when running locally the Test keeps running while the run_python_test terminates, this seem to be happen because incorrect signal status is sent from the subprocess.
Steps to reproduce:
Run the test TC_SU_2_5 or TC_SU_2_7 or any test that takes more than 3 minutes to run and the test will fail.
python3 scripts/tests/run_python_test.py --load-from-env /tmp/test_env.yaml --script src/python_testing/TC_SU_2_5.py
Posible Solutions:
- Add the custom
--timeoutof the test from the CI args when present to avoid the subprocess.wait() to use the default TERMINATION_TIMEOUT_S atrun_python_test.py
Pending:
Investigate why at timeout is not sending the correct terminate signal.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.