adoptium / adoptium/aqa-tests

[external tests]: Converge the testcases require different test suites based on different impl or jdk version

Open
#3,529 0 comments 1 reaction 0 assignees View on GitHub
type:external
Dominant language
HTML
Stars
155
Forks
346
Avg merge
2d 9h
Merged PRs (30d)
36

Description

Recent update of external test export impl and jdk_version as environment variables when generating the docker files. Also external tests have been updated to support test suites options as the docker CMD. Based on that there is no need to duplicate the test case in playlist.xml if different impl or jdk version works with different test suites.

For example project elasticsearch have three test cases elasticsearch_test_openj9_jdk8, elasticsearch_test_openj9_latest, elasticsearch_test_hotspot. The only difference between those test cases are the exclude-task based on impl and jdk_version. We can actually converge those three cases to just one by setting the exclude-task in test.sh. Similar to quakus_quickstarts/test.sh.

This issue is to find all similar cases in all external projects and update corresponding test.sh and playlist.xml.

Contributor guide

Open the contributing guide

Research direction

Review the external projects' playlist.xml and test.sh files, using elasticsearch and quakus_quickstarts/test.sh as the named examples. Find test cases duplicated only for impl or jdk_version, then verify that each project can select the appropriate test suite through test.sh. Done means the duplicate playlist entries are consolidated without losing the version-specific exclusions.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, shell
Domain
build-system, testing
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.