adoptium / adoptium/aqa-tests

Handle tests that do not need to rerun

Open
#4,379 5 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
HTML
Stars
155
Forks
346
Avg merge
2d 9h
Merged PRs (30d)
36

Description

We enabled the rerun feature in the test pipeline (see https://github.com/adoptium/aqa-tests/issues/3431 and runtimes/backlog/issues/1022). We noticed that for some tests, we may not want to rerun at all. For example, the tests that we know have a network issue, but still want to keep in the build. One solution is to have a NotRerun tag in playlist for these tests. Then TKG can generate the list of NotRerun tests. The pipeline can then remove these tests from the rerun list.

@renfeiw do you have any suggestions on this?

Contributor guide

Open the contributing guide

Research direction

Read the rerun feature context in issues 3431 and 1022, then trace how playlists are processed by TKG and how the test pipeline builds its rerun list. Verify that a proposed NotRerun tag would keep those tests in the build while excluding them from reruns.

Written by the indexing model from the issue text.

Assessment

Domain
ci-cd, testing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.