jenkinsci / jenkinsci/matrix-project-plugin
[JENKINS-51392] JUnit Health report amplification factor ignored in matrix projects
- Dominant language
- Java
- Stars
- 17
- Forks
- 85
- Avg merge
- 4h 27m
- Merged PRs (30d)
- 5
Description
When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the Health report amplification factor configured in the job.
A factor of 0 also does not disabled test health reporting as advertised.
Steps to reproduce
- Create a new Multi-Configuration Project.
- Add an arbitrary (e.g userdefined) axis with one or more values.
- Add a build step that creates a JUnit result file:
```
This test failed.
```
- Add Publish JUnit post-build action.
- Set Health report amplification factor to any value other than 1.0.
- Run the project.
- Observe the weather report.
---
Originally reported by yoerg, imported from: JUnit Health report amplification factor ignored in matrix projects
kohsuke
Raw content of original issue
When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the Health report amplification factor configured in the job.
A factor of 0 also does not disabled test health reporting as advertised.
Steps to reproduce
- Create a new Multi-Configuration Project.
- Add an arbitrary (e.g userdefined) axis with one or more values.
- Add a build step that creates a JUnit result file:
<?xml version="1.0" encoding="utf-8"?>
<testsuites>
<testsuite errors="0" failures="1" name="" skipped="0" tests="2">
<testcase classname="test" name="success" />
<testcase classname="test" name="failure">
<failure>This test failed.</failure>
</testcase>
</testsuite>
</testsuites>
- Add Publish JUnit post-build action.
- Set Health report amplification factor to any value other than 1.0.
- Run the project.
- Observe the weather report.
environment
```
Jenkins ver. 2.107.3
Matrix Project Plugin 1.13
JUnit Plugin 1.24
```
Contributor guide
Research direction
Reproduce the matrix project with the supplied JUnit XML and a non-1.0 amplification factor, using the listed Jenkins, Matrix Project Plugin, and JUnit versions as a baseline. Trace the matrix project's JUnit publishing and weather-report path; done means the weather report reflects the configured factor and factor 0 disables test health reporting.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- backend, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100