project-chip / project-chip/certification-tool

[Bug] Concrete Test errors not visible in Matter 1.6.1 tests

Open
#1,055 24 comments 0 reactions 1 assignee View on GitHub

Nobody has claimed this yet.

Bug Found in 1.6.1_MVE Needs Triage
Dominant language
Shell
Stars
83
Forks
47
Avg merge
1d 15h
Merged PRs (30d)
17

Description

Describe the bug

When tests run in the Matter 1.6.1 test harness as requested by the slack channel no test results are in log. Only if you run the tests in the docker container directly you see details.

Interesting is that all test cases where this happens also log this

******************************************************************
*
* Test test_TC_IDM_10_2 failed for the following reason:
* Details=Problems with conformance, Extras=None
*
* File "/usr/local/lib/python3.12/dist-packages/matter/testing/basic_composition.py", line 246, in fail_current_test
* asserts.fail(msg)
*
* Test step:
*     UNKNOWN - no test steps provided in test script
*
* Endpoint: None
*
*******************************************************************
Steps to reproduce the behavior

just run IDM 10.2 on TH with and device that has Groupcast and AUX feature on ACL enabled

Expected behavior

test passes

Log files

Logfile from the TH test_run_tryTC_IDM_10_2_2026-07-21T18-39-02.log

Logfile when run in Docker as per Verification Specs document:

IDM-10.2-error.log

PICS file

No response

Screenshots

No response

Environment
  • TH 1.6.1 as by slack channel
Additional Information

No response

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.