adoptium / adoptium/aqa-test-tools

TRSS Shows "UNSTABLE" Instead of "FAILED" for Fully Failed Test Jobs

Open
#1,061 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
33
Forks
97
Avg merge
7h 9m
Merged PRs (30d)
5

Description

During the recent release testing, observed that some test jobs which fully failed were reported as UNSTABLE (yellow) in TRSS instead of FAILED (red). This could be a bit misleading, as it gives the impression that the job ran tests with tests that didnt pass, rather than failed job.

🔍 Affected Job:
[Test_openjdk11_j9_extended.functional_ppc64le_linux_fips140_3_openjceplusfips #41](https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk11_j9_extended.functional_ppc64le_linux_fips140_3_openjceplusfips/41/)
🔗 TRSS Result Summary:
https://trssrtp1.fyre.ibm.com/resultSummary?parentId=6855a584150950132c63aec4

![Image](https://github.com/user-attachments/assets/7edacfda-ef02-4d98-8202-8622848ca9aa)

🔍 Affected Job:
[Test_openjdk21_j9_extended.perf_ppc64le_linux #112](https://hyc-runtimes-jenkins.swg-devops.com/job/Test_openjdk21_j9_extended.perf_ppc64le_linux/112/consoleFull)

🔗 TRSS Result Summary:
https://trssrtp1.fyre.ibm.com/resultSummary?parentId=68619dd8376286111a6a8eaa

![Image](https://github.com/user-attachments/assets/0e36d3e2-ebad-4b76-a62e-1af428924953)

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the two linked Jenkins jobs and their TRSS result summaries to compare the reported job outcomes. Trace where fully failed jobs are classified as UNSTABLE rather than FAILED. Done means both reported examples, and equivalent fully failed jobs, are shown as FAILED.

Written by the indexing model from the issue text.

Assessment

Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.