jenkinsci / jenkinsci/matrix-project-plugin

[JENKINS-51392] JUnit Health report amplification factor ignored in matrix projects

Open
#702 0 comments 0 reactions 0 assignees View on GitHub
component:matrix-project-plugin imported-jira-issue priority:minor resolution:unresolved
Dominant language
Java
Stars
17
Forks
85
Avg merge
4h 27m
Merged PRs (30d)
5

Description

When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the Health report amplification factor configured in the job.

A factor of 0 also does not disabled test health reporting as advertised.


Steps to reproduce



  1. Create a new Multi-Configuration Project.

  2. Add an arbitrary (e.g userdefined) axis with one or more values.

  3. Add a build step that creates a JUnit result file:

    ```




    This test failed.

    ```


  4. Add Publish JUnit post-build action.

  5. Set Health report amplification factor to any value other than 1.0.

  6. Run the project.

  7. Observe the weather report.

---
Originally reported by yoerg, imported from: JUnit Health report amplification factor ignored in matrix projects


  • assignee: kohsuke
  • status: Open
  • priority: Minor
  • component(s): matrix-project-plugin
  • resolution: Unresolved
  • votes: 1
  • watchers: 3
  • imported: 2025-12-06

Raw content of original issue

When using a matrix project, the weather report always uses a factor of 1.0 for test results, regardless of the Health report amplification factor configured in the job.

A factor of 0 also does not disabled test health reporting as advertised.


Steps to reproduce



  1. Create a new Multi-Configuration Project.

  2. Add an arbitrary (e.g userdefined) axis with one or more values.

  3. Add a build step that creates a JUnit result file:

    <?xml version="1.0" encoding="utf-8"?>
    
    <testsuites>
    <testsuite errors="0" failures="1" name="" skipped="0" tests="2">
    <testcase classname="test" name="success" />
    <testcase classname="test" name="failure">
    <failure>This test failed.</failure>
    </testcase>
    </testsuite>
    </testsuites>


  4. Add Publish JUnit post-build action.

  5. Set Health report amplification factor to any value other than 1.0.

  6. Run the project.

  7. Observe the weather report.


environment

```
Jenkins ver. 2.107.3

Matrix Project Plugin 1.13

JUnit Plugin 1.24
```

Contributor guide

Open the contributing guide

Research direction

Reproduce the matrix project with the supplied JUnit XML and a non-1.0 amplification factor, using the listed Jenkins, Matrix Project Plugin, and JUnit versions as a baseline. Trace the matrix project's JUnit publishing and weather-report path; done means the weather report reflects the configured factor and factor 0 disables test health reporting.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.