allure-framework / allure-framework/allure3

Incorrect Success rate Calculation deducting Skipped Scenario

Closed
#281 0 comments 0 reactions 0 assignees View on GitHub
theme:awesome
Dominant language
HTML
Stars
401
Forks
58
Avg merge
2d 20h
Merged PRs (30d)
34

Description

**Describe the bug**
Incorrect Success rate Calculation deducting Skipped Scenario

it seems allure calculates the success rate = (SucceededScenario / (TotalScenario -SkippedScenario))

**To Reproduce**
Run for example 8 tests and put 6 of them as skipped and the results should be 100% on success rate but I got 20%

**Expected behavior**
success rate = (SucceededScenario / TotalScenario)
it it doesn't fit everybody an option should be considered to take into account SkippedScenario in the calculation or not.

**Screenshots**

![Image](https://github.com/user-attachments/assets/ee874dfd-bbd4-4ef8-8d72-aa06689e87a8)

**Desktop (please complete the following information):**
chrome and the latest version

**Additional context**
In my opinion should be an option if you want to count or not the skipped tests

Contributor guide

Open the contributing guide

Research direction

No source files or tests are named. Reproduce the report with 8 tests, including 6 skipped scenarios, then locate the success-rate calculation and compare it with the stated expected formula. Done means the displayed rate follows the chosen skipped-scenario behavior, including any supported option.

Written by the indexing model from the issue text.

Assessment

Domain
analytics, testing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.