adoptium / adoptium/aqa-tests

jdk_util_2 FAILED in Test_openjdk8_hs_sanity.openjdk_arm_linux

Open
#5,098 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
HTML
Stars
155
Forks
346
Avg merge
2d 9h
Merged PRs (30d)
36

Description

These testcase failures have been reported during release triage, but a proper issue has not been raised, as they appear to eventually pass on rerun on some machines. [Deep history](https://trss.adoptium.net/deepHistory?testId=65d92f9c43ff67006e8dc0be) shows these only passing on test-sxa-armv7l-ubuntu2004-odroid-2 which makes them problematic for release periods:
```
not ok 2 - jdk_util_2
---
output:
|
Failed test cases:
TEST: java/util/stream/boottest/java/util/stream/FlagOpTest.java
TEST: java/util/stream/boottest/java/util/stream/IntNodeTest.java
TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/FilterOpTest.java
TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/IntSliceOpTest.java
TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/IntUniqOpTest.java
TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/InfiniteStreamWithLimitOpTest.java
TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/RangeTest.java
TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/SequentialOpTest.java
TEST: java/util/stream/test/org/openjdk/tests/java/util/stream/StreamBuilderTest.java
Test results: passed: 655; failed:
```

The general way that the *OpTests fail is with 'Maps do not have the same size' AssertionError, example:
```
14:57:05 java.lang.AssertionError: 1 failure(s) for test data: RefTestData[DelegatingStream(ArrayList):0..1000]
14:57:05 1: java.lang.Error: PAR_STREAM_FOR_EACH_CLEAR_SIZED: java.lang.AssertionError: Maps do not have the same size:998 != 1000
14:57:05
```

**Test Info**
Test Name: jdk_util_2
Test Duration: 8 min 53 sec
Machine: test-docker-ubuntu2004-armv7l-4
TRSS link for the test output: https://trss.adoptium.net/output/test?id=65d92ea543ff67006e8dbe5e

**Build Info**
Build Name: Test_openjdk8_hs_sanity.openjdk_arm_linux
Jenkins Build start time: Feb 23 2024, 02:07 pm
Jenkins Build URL: https://ci.adoptium.net/job/Test_openjdk8_hs_sanity.openjdk_arm_linux/648/
TRSS link for the build: https://trss.adoptium.net/allTestsInfo?buildId=65d92dac43ff67006e8dbd79

**Java Version**
openjdk version "1.8.0_412-beta"
OpenJDK Runtime Environment (Temurin)(build 1.8.0_412-beta-202402231854-b04)
OpenJDK Client VM (Temurin)(build 25.412-b04, mixed mode)

**This test has been failed 23 times since Apr 26 2023, 01:52 pm**
**Java Version when the issue first seen**
openjdk version "1.8.0_372"
OpenJDK Runtime Environment (Temurin)(build 1.8.0_372-b07)
OpenJDK Client VM (Temurin)(build 25.372-b07, mixed mode)
Jenkins Build URL: https://ci.adoptium.net/job/Test_openjdk8_hs_sanity.openjdk_arm_linux/509/

The test failed on machine test-docker-ubuntu2004-armv7l-4 1 times
The test failed on machine test-docker-ubuntu2004-armv7l-1 9 times
The test failed on machine test-docker-ubuntu2004-armv7l-2 4 times
The test failed on machine test-docker-ubuntu2204-armv7l-2 1 times
The test failed on machine test-docker-ubuntu2004-armv7l-3 3 times
The test failed on machine test-docker-ubuntu2204-armv7l-1 5 times

[Rerun in Grinder](https://ci.adoptium.net/job/Grinder/parambuild/?SDK_RESOURCE=upstream&TARGET=jdk_util_2&BASE_DOCKER_REGISTRY_CREDENTIAL_ID=&TEST_FLAG=&UPSTREAM_TEST_JOB_NAME=&DOCKER_REQUIRED=false&ACTIVE_NODE_TIMEOUT=5&VENDOR_TEST_DIRS=&EXTRA_DOCKER_ARGS=&TKG_OWNER_BRANCH=adoptium%3Amaster&OPENJ9_SYSTEMTEST_OWNER_BRANCH=eclipse%3Amaster&PLATFORM=arm_linux&GENERATE_JOBS=true&KEEP_REPORTDIR=true&PERSONAL_BUILD=false&DOCKER_REGISTRY_DIR=&RERUN_ITERATIONS=0&ADOPTOPENJDK_REPO=https%3A%2F%2Fgithub.com%2Fadoptium%2Faqa-tests.git&SETUP_JCK_RUN=false&DOCKER_REGISTRY_URL_CREDENTIAL_ID=&LABEL=&EXTRA_OPTIONS=&CUSTOMIZED_SDK_URL=&BUILD_IDENTIFIER=&JENKINS_KEY=&ADOPTOPENJDK_BRANCH=master&LIGHT_WEIGHT_CHECKOUT=false&USE_JRE=false&ARTIFACTORY_SERVER=&KEEP_WORKSPACE=false&USER_CREDENTIALS_ID=&JDK_VERSION=8&DOCKER_REGISTRY_URL=&ITERATIONS=1&VENDOR_TEST_REPOS=&JDK_REPO=https%3A%2F%2Fgithub.com%2Fadoptium%2Faarch32-jdk8u&JCK_GIT_BRANCH=master&OPENJ9_BRANCH=master&OPENJ9_SHA=&JCK_GIT_REPO=&VENDOR_TEST_BRANCHES=&UPSTREAM_JOB_NAME=build-scripts%2Fjobs%2Fjdk8u%2Fjdk8u-linux-arm-temurin&OPENJ9_REPO=https%3A%2F%2Fgithub.com%2Feclipse-openj9%2Fopenj9.git&CLOUD_PROVIDER=&CUSTOM_TARGET=&VENDOR_TEST_SHAS=&JDK_BRANCH=&LABEL_ADDITION=&ARTIFACTORY_REPO=&ARTIFACTORY_ROOT_DIR=&UPSTREAM_TEST_JOB_NUMBER=&DOCKERIMAGE_TAG=&JDK_IMPL=hotspot&TEST_TIME=&SSH_AGENT_CREDENTIAL=&AUTO_DETECT=true&SLACK_CHANNEL=&DYNAMIC_COMPILE=false&RELATED_NODES=&ADOPTOPENJDK_SYSTEMTEST_OWNER_BRANCH=adoptium%3Amaster&APPLICATION_OPTIONS=&CUSTOMIZED_SDK_URL_CREDENTIAL_ID=eclipse_temurin_bot_email_and_token&ARCHIVE_TEST_RESULTS=false&NUM_MACHINES=&OPENJDK_SHA=&TRSS_URL=&USE_TESTENV_PROPERTIES=false&BUILD_LIST=openjdk&ADDITIONAL_ARTIFACTS_REQUIRED=&UPSTREAM_JOB_NUMBER=449&STF_OWNER_BRANCH=adoptium%3Amaster&TIME_LIMIT=10&JVM_OPTIONS=&PARALLEL=None)

Contributor guide

Open the contributing guide

Research direction

Start with the TRSS output and deep-history links for jdk_util_2, then rerun it using the provided Grinder configuration on the affected ARM Linux machines. Review the listed stream tests, including FlagOpTest, IntNodeTest, FilterOpTest, IntSliceOpTest, IntUniqOpTest, InfiniteStreamWithLimitOpTest, RangeTest, SequentialOpTest, and StreamBuilderTest. Done means reproducing the intermittent failures, identifying their cause, and demonstrating stable passing results.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.