project-chip / project-chip/certification-tool
[Bug] Concrete Test errors not visible in Matter 1.6.1 tests
Nobody has claimed this yet.
- Dominant language
- Shell
- Stars
- 83
- Forks
- 47
- Avg merge
- 1d 15h
- Merged PRs (30d)
- 17
Description
Describe the bug
When tests run in the Matter 1.6.1 test harness as requested by the slack channel no test results are in log. Only if you run the tests in the docker container directly you see details.
Interesting is that all test cases where this happens also log this
******************************************************************
*
* Test test_TC_IDM_10_2 failed for the following reason:
* Details=Problems with conformance, Extras=None
*
* File "/usr/local/lib/python3.12/dist-packages/matter/testing/basic_composition.py", line 246, in fail_current_test
* asserts.fail(msg)
*
* Test step:
* UNKNOWN - no test steps provided in test script
*
* Endpoint: None
*
*******************************************************************
Steps to reproduce the behavior
just run IDM 10.2 on TH with and device that has Groupcast and AUX feature on ACL enabled
Expected behavior
test passes
Log files
Logfile from the TH test_run_tryTC_IDM_10_2_2026-07-21T18-39-02.log
Logfile when run in Docker as per Verification Specs document:
PICS file
No response
Screenshots
No response
Environment
- TH 1.6.1 as by slack channel
Additional Information
No response
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.