allure-framework / allure-framework/allure2

Wrong calculation of failed tests in Jira Allure plugin because of retries

Open
#1,933 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
HTML
Stars
5.5k
Forks
782
Avg merge
2d 33m
Merged PRs (30d)
16

Description

**Describe the bug**
When we have retries while test execution number of failed tests that shown in Jira Allure plugin is wrong showing all retries as failed scenarios although in Allure report we don't see any failed scenarios

**To Reproduce**

Preconditions:
- Jira Allure plugin are connection with Jenkins
- have tests with retries
Steps to reproduce the behavior:
1. Execute set of tests in Jenkins
2. Check Allure plugin in Jira ticket

**Expected behavior**
Number of failures in Allure Jira plugin and Allure reports mismatched
Retries are shown as failures

**Screenshots**
![MicrosoftTeams-image](https://user-images.githubusercontent.com/19637130/222119045-e42ca7c2-82c1-4c06-8968-9f46f647aeda.png)

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the Jira Allure plugin behavior through Jenkins with tests that use retries, then compare its failed-test count with the Allure report. Done means retries are not counted as failed scenarios and the plugin and report show matching failure totals.

Written by the indexing model from the issue text.

Assessment

Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.