adoptium / adoptium/aqa-test-tools

allTestsInfo may be incorrect

Open
#860 7 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
33
Forks
97
Avg merge
7h 9m
Merged PRs (30d)
5

Description

@smlambert noticed that recent release run shows **allTestsInfo** may be incorrect for some builds.

Example : jdk22 release mac extended.openjdk job, which should have around 16+39+38 tests. But trss only shows 3 ( Pre and Post tests are not taken as tests).

Screenshot 2024-03-27 at 4 27 31 PM

https://trss.adoptium.net/allTestsInfo?buildId=65fb17d643ff67006ef89f92&limit=5&hasChildren=true

It happened to all jobs with rerun. Only tests of rerun will show. Expected behaviour is tests should combine original run and rerun.

Screenshot 2024-03-27 at 4 44 15 PM

This might be related with recent update in TKG https://github.com/adoptium/TKG/issues/510.

Contributor guide

Open the contributing guide

Research direction

Start with the allTestsInfo endpoint shown in the issue and compare its results for a build with a rerun against the original and rerun jobs. Review the related TKG issue #510 for context. Done means allTestsInfo combines the original and rerun tests, including pre- and post-tests, instead of showing only the rerun tests.

Written by the indexing model from the issue text.

Assessment

Domain
backend, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.