Add a support to report failures which happen session/test setup/tierdown
Open
Nobody has claimed this yet.
- Dominant language
- No language data
- Stars
- 93
- Forks
- 4
- PR merge metrics
- No merged PRs in 30d
Description
Some frameworks support
- shared test/testsuite setup and some tests are not going to be processed or run. Framework might not even give us the names of the skipped tests
- shared test/testsuite tierdown which might also fail and cause original test framwork to fail
In both cases, there is no straight forward place in ctrf report to put such things in except of smuggling the results behind the dummy test failed test case. Can the schema be extended for Results object to support something like 'testFrameworkChecks' which is similar TestObject?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the Results object and TestObject definitions in the CTRF schema. Review how setup and teardown failures are currently represented, including the dummy failed test case. Done means reaching agreement on a schema extension for testFrameworkChecks that represents these framework-level failures without fabricated test cases.
Written by the indexing model from the issue text.
Assessment
- Domain
- testing-qa
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100