allure-framework / allure-framework/allure-csharp

Allure.NUnit: Report exceptions from OneTimeSetUp methods of class fixtures

Open
#479 6 comments 2 reactions 0 assignees View on GitHub
Dominant language
C#
Stars
125
Forks
76
Avg merge
1d 2h
Merged PRs (30d)
18

Description

#### I'm submitting a ...
- [ ] bug report
- [x] feature request
- [ ] support request => Please do not submit support request here, see note at the top of this template.

#### What is the current behavior?
If a [OneTimeSetUp] method fails, all test results of the class fixture aren't included in the report. The error, therefore, remains unreported.

#### What is the expected behavior?
If possible, skipped test results should be created. That might be tricky as, at first glance, NUnit doesn't provide the list of scheduled tests (it provides the list of all tests in the class instead; the user might have selected only a subset of them).

An alternative approach would be reporting the error in a surrogate test result. We already do something similar in Allure SpecFlow and Allure Reqnroll.

#### What is the motivation / use case for changing the behavior?
Include the information about the error that occurred during the run. That information might be important to the user.

Contributor guide

Open the contributing guide

Research direction

Start by examining Allure.NUnit's handling of OneTimeSetUp failures and compare it with the analogous reporting in Allure SpecFlow and Allure Reqnroll. Done means the setup error is included in the Allure report, either through skipped test results or a surrogate test result.

Written by the indexing model from the issue text.

Assessment

Tech stack
csharp
Domain
testing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.