allure-framework / allure-framework/allure2

Flaky test statictics for prioritization

Open
#1,034 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
HTML
Stars
5.5k
Forks
782
Avg merge
2d 33m
Merged PRs (30d)
16

Description

**Is your feature request related to a problem? Please describe.**
Our project is developed by 30+ people. We use trunk-based development with feature branching. Before merging branch into master gitlab CI executing automatic tests.
Some tests are flaky and we want to prioritize it to plan work and solve problem.

**Describe the solution you'd like**
Every test report is copied to allure folder and allure shows statistics with cases order by flaky frequency.

**Describe alternatives you've considered**
Maybe, a service for gitlab CI, which parse every job.

**Additional context**
Filter by branch name may be also useful to distinguish error tests from dev work.

Contributor guide

Open the contributing guide

Research direction

The issue names Allure reports, the Allure folder, and GitLab CI jobs, but no files, tests, or entry points. Start by reviewing how existing Allure statistics are generated and how CI test reports are collected. Done should include flaky-frequency ordering and, if in scope, branch-name filtering.

Written by the indexing model from the issue text.

Assessment

Tech stack
gitlab
Domain
ci-cd, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.