adoptium / adoptium/aqa-tests

Auto exclude openjdk specific testcases by issue_comment

Open
#2,366 1 comment 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
HTML
Stars
155
Forks
346
Avg merge
2d 9h
Merged PRs (30d)
36

Description

There is an increasing requirement to auto exclude openjdk specific test (.java) by issue_comment, which can be done in a similar way to `auto exclude testCaseName( target)`. The point is excluding per testcase, which has a smaller size of the granularity than testCaseName.

One scenario example would be:

1. Issue opened for specific tests https://github.com/AdoptOpenJDK/openjdk-tests/issues/2360 ( could be more than one problematic testcase in one issue)
2. Investigation and comments show the testcase can be excluded
3. Comment according to some pattern which provides affected jdk_version, impl, platform
4. Comment trigger workflow checkout the openjdk-tests repo and update the right problemlist*.txt file(files) and create the exclude PR
5. update workflow status to the issue so people interested in this could be notified the PR update.

We can do like this not sure if it's helpful or if it's necessary to enable this feature. FYI @lumpfish @andrew-m-leonard @adamfarley

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the existing `auto exclude testCaseName(target)` behavior and how `issue_comment` workflows are handled. The proposed work would need to identify the affected JDK version, implementation, and platform, update the appropriate `problemlist*.txt` file or files, create an exclusion PR, and report its status on the issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions, java
Domain
ci-cd, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.