project-chip / project-chip/matter-test-scripts
[Test Script] TC-GRPKEY-2.2: Test case fails because the expected EXHAUSTED error is not detected by Test Harness
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 19
- Forks
- 7
- Avg merge
- 3d 17h
- Merged PRs (30d)
- 3
Description
Description:
During manual execution of the affected test scenario using chip-tool, the procedure results in an EXHAUSTED error. This EXHAUSTED error is the expected outcome for this test scenario.
However, when the same scenario is executed using the CSA Test Harness, the Test Harness does not detect/recognize the EXHAUSTED error.
As a result, the Test Harness evaluates the test step incorrectly and the test case fails, even though the DUT behavior matches the expected behavior and the expected EXHAUSTED error is observed during manual execution.
I noticed that the same issue was reported earlier in this https://github.com/project-chip/matter-test-scripts/issues/275
but the solution given in that also did not work for me.
Logs:
The chip-tool execution shows the expected EXHAUSTED error.
Test Harness execution:
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by comparing the TC-GRPKEY-2.2 chip-tool log with the CSA Test Harness log and review the earlier issue #275. Trace where the test case evaluates the EXHAUSTED result and reproduce the failure. Done means the harness recognizes the expected EXHAUSTED error and the test case passes.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing-qa
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 48/100