project-chip / project-chip/matter-test-scripts

[DRLK] User Database, Holiday Schedule, Weekday Schedule tests required and fail even when not supported

Open
#449 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
19
Forks
7
Avg merge
3d 17h
Merged PRs (30d)
3

Description

Summary Title:

User Database, Holiday Schedule, Weekday Schedule test cases are required and fail even when a door lock doesn't support them and doesn't declare support in the PICS file.

Description:

A simple door lock that does not implement the user database feature, the holiday and weekday access schedule is still required to pass the [TC-DRLK-2.5] (Set Week Day Schedule), [TC-DRLK-2.6] (Set Holiday Schedule), [TC-DRLK-2.7] (Set Year Schedule), [TC-DRLK-2.8] (User Database) and [TC-DRLK-2.9] (Set Credential) test cases. Both the PICS Tool (v 2.1.19) and the the Test Harness will select these test cases as required. These test cases will fail with an error specifying that the commands are not implemented.

Steps to reproduce:

  1. Create a minimal Door Lock Cluster PICS file (attached).
  2. Validate the PICS file in PICS tool.
  3. PICS tool will show the require set of test cases at the top (PDF attached).
  4. Test Plans specify the condition for these Test cases is simply [DRLK.S] (which is not correct).
  5. Test Harness and test cases will ultimately fail.

Logs:

Full test log is attached, relevant log line:

WARNING    | 2024-11-06 12:01:31.359578 | Test Failure: The test expects no error but the "UNSUPPORTED_COMMAND" error occured.

Additional Info:

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by comparing the attached Door lock Test Plan.xml.zip with the PICS Tool v2.1.19.pdf and the TC-DRLK-2.5 test report and log. Reproduce the minimal Door Lock Cluster PICS case and trace why [DRLK.S] selects TC-DRLK-2.5 through TC-DRLK-2.9. Done means unsupported features are not required and the affected tests no longer fail with UNSUPPORTED_COMMAND.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.