project-chip / project-chip/matter-test-scripts
[DRLK] User Database, Holiday Schedule, Weekday Schedule tests required and fail even when not supported
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 19
- Forks
- 7
- Avg merge
- 3d 17h
- Merged PRs (30d)
- 3
Description
Summary Title:
User Database, Holiday Schedule, Weekday Schedule test cases are required and fail even when a door lock doesn't support them and doesn't declare support in the PICS file.
Description:
A simple door lock that does not implement the user database feature, the holiday and weekday access schedule is still required to pass the [TC-DRLK-2.5] (Set Week Day Schedule), [TC-DRLK-2.6] (Set Holiday Schedule), [TC-DRLK-2.7] (Set Year Schedule), [TC-DRLK-2.8] (User Database) and [TC-DRLK-2.9] (Set Credential) test cases. Both the PICS Tool (v 2.1.19) and the the Test Harness will select these test cases as required. These test cases will fail with an error specifying that the commands are not implemented.
Steps to reproduce:
- Create a minimal Door Lock Cluster PICS file (attached).
- Validate the PICS file in PICS tool.
- PICS tool will show the require set of test cases at the top (PDF attached).
- Test Plans specify the condition for these Test cases is simply [DRLK.S] (which is not correct).
- Test Harness and test cases will ultimately fail.
Logs:
Full test log is attached, relevant log line:
WARNING | 2024-11-06 12:01:31.359578 | Test Failure: The test expects no error but the "UNSUPPORTED_COMMAND" error occured.
Additional Info:
- PICS version: 2.1.19
- Spec Version: 1.2
- Door lock Test Plan.xml.zip
- PICS Tool v2.1.19.pdf
- Test Report TC-DRLK-2_5.pdf
- TC-DRLK-2_5_2024_11_06_13_00_42.log
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by comparing the attached Door lock Test Plan.xml.zip with the PICS Tool v2.1.19.pdf and the TC-DRLK-2.5 test report and log. Reproduce the minimal Door Lock Cluster PICS case and trace why [DRLK.S] selects TC-DRLK-2.5 through TC-DRLK-2.9. Done means unsupported features are not required and the affected tests no longer fail with UNSUPPORTED_COMMAND.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100