jenkinsci / jenkinsci/junit-plugin
[JENKINS-14089] JUnit report - Quarantine intermittent tests
- Dominant language
- Java
- Stars
- 87
- Forks
- 351
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 2
Description
I see other CI systems with a Quarantine feature for their JUnit testing.
How about Jenkins keeps pace?
Quarantine is a reporting feature. The idea of the feature is that intermittent or misbehaving tests can be quarantined. This means that they wouldn't be reported in the totals of passing/failing tests and would not affect the pass/fail status of the Jenkins job. The tests can later be removed from quarantine when they are consistently passing or otherwise behaving well.
The quarantine feature wouldn't change whether a test executes, but rather how it is reported.
---
Originally reported by johnstosh, imported from: JUnit report - Quarantine intermittent tests
Raw content of original issue
I see other CI systems with a Quarantine feature for their JUnit testing.
How about Jenkins keeps pace?Quarantine is a reporting feature. The idea of the feature is that intermittent or misbehaving tests can be quarantined. This means that they wouldn't be reported in the totals of passing/failing tests and would not affect the pass/fail status of the Jenkins job. The tests can later be removed from quarantine when they are consistently passing or otherwise behaving well.
The quarantine feature wouldn't change whether a test executes, but rather how it is reported.
Contributor guide
Assessment
This issue has not been assessed yet.