project-chip / project-chip/matter-test-scripts

Nightly Jobs Failing with false positive status

Open
#787 0 comments 0 reactions 1 assignee View on GitHub

@jtrejoespinoza-grid is already working on this.

Since Jun 9, 2026.

Dominant language
Python
Stars
19
Forks
7
Avg merge
3d 17h
Merged PRs (30d)
3

Description

Test running with run_python_tests fails when the test take more than 3 minutes to execute.

Description:

Currently Nightly jobs are failing, they are reported as complete but inspecting the logs will confirm the test is failing.
Example: https://github.com/project-chip/connectedhomeip/actions/runs/27077859958/job/79919136814

The issue is a TERMINATION_TIMEOUT_S introduced in the following PR: https://github.com/project-chip/connectedhomeip/pull/72241 to avoid test to hang and terminate them but at the same time is terminating test that take more time than TERMINATION_TIMEOUT_S, as is the case for SU Tests.

Another issue that is observed is when running locally the Test keeps running while the run_python_test terminates, this seem to be happen because incorrect signal status is sent from the subprocess.

Steps to reproduce:

Run the test TC_SU_2_5 or TC_SU_2_7 or any test that takes more than 3 minutes to run and the test will fail.

python3 scripts/tests/run_python_test.py --load-from-env /tmp/test_env.yaml --script src/python_testing/TC_SU_2_5.py

Posible Solutions:

  • Add the custom --timeout of the test from the CI args when present to avoid the subprocess.wait() to use the default TERMINATION_TIMEOUT_S at run_python_test.py

Pending:

Investigate why at timeout is not sending the correct terminate signal.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.