adoptium / adoptium/aqa-tests

jcstress_StampedLockPairwiseTests_0 FAILED in Test_openjdk17_hs_dev.system_x86-64_linux, cancel due to nested timeout

Open
#4,222 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
HTML
Stars
155
Forks
346
Avg merge
2d 9h
Merged PRs (30d)
36

Description

Many tests are being terminated mid-run, appears to be those running on test-docker machines
As an example, this jcstress test is terminated mid-run on certain platforms (seen in TRSS ["all platforms" view](https://trss.adoptium.net/testPerPlatform?testId=63b207a4ed0b30773b2ff454)):

Screen Shot 2023-01-02 at 7 47 06 PM

**Test Info**
Test Name: jcstress_StampedLockPairwiseTests_0
Test Duration: 28 min 49 sec
Machine: test-docker-fedora35-x64-2
TRSS link for the test output: https://trss.adoptium.net/output/test?id=63b207a4ed0b30773b2ff454

**Build Info**
Build Name: Test_openjdk17_hs_dev.system_x86-64_linux
Jenkins Build start time: Jan 01 2023, 07:12 am
Jenkins Build URL: https://ci.adoptopenjdk.net/job/Test_openjdk17_hs_dev.system_x86-64_linux/7/
TRSS link for the build: https://trss.adoptium.net/allTestsInfo?buildId=63b20664ed0b30773b2fe52c

**Java Version**
openjdk version "17.0.6" 2023-01-17
OpenJDK Runtime Environment Temurin-17.0.6+9 (build 17.0.6+9)
OpenJDK 64-Bit Server VM Temurin-17.0.6+9 (build 17.0.6+9, mixed mode, sharing)

**This test has been failed 4 times since Dec 11 2022, 07:14 am**
**Java Version when the issue first seen**
openjdk version "17.0.6" 2023-01-17
OpenJDK Runtime Environment Temurin-17.0.6+6 (build 17.0.6+6)
OpenJDK 64-Bit Server VM Temurin-17.0.6+6 (build 17.0.6+6, mixed mode, sharing)
Jenkins Build URL: https://ci.adoptopenjdk.net/job/Test_openjdk17_hs_dev.system_x86-64_linux/3/

The test failed on machine test-docker-fedora35-x64-2 1 times
The test failed on machine test-docker-centos8-x64-1 1 times
The test failed on machine test-docker-ubi8-x64-1 1 times
The test failed on machine test-docker-fedora37-x64-1 1 times

[Rerun in Grinder](https://ci.adoptopenjdk.net/job/Grinder/parambuild/?SDK_RESOURCE=upstream&TARGET=jcstress_StampedLockPairwiseTests_0&TEST_FLAG=&UPSTREAM_TEST_JOB_NAME=&DOCKER_REQUIRED=false&ACTIVE_NODE_TIMEOUT=0&VENDOR_TEST_DIRS=&EXTRA_DOCKER_ARGS=&TKG_OWNER_BRANCH=adoptium%3Amaster&OPENJ9_SYSTEMTEST_OWNER_BRANCH=eclipse%3Amaster&PLATFORM=x86-64_linux&GENERATE_JOBS=false&KEEP_REPORTDIR=false&PERSONAL_BUILD=false&DOCKER_REGISTRY_DIR=&ADOPTOPENJDK_REPO=https%3A%2F%2Fgithub.com%2Fadoptium%2Faqa-tests.git&RERUN_ITERATIONS=0&DOCKER_REGISTRY_URL_CREDENTIAL_ID=&LABEL=&EXTRA_OPTIONS=&CUSTOMIZED_SDK_URL=&BUILD_IDENTIFIER=&ADOPTOPENJDK_BRANCH=master&LIGHT_WEIGHT_CHECKOUT=false&USE_JRE=false&ARTIFACTORY_SERVER=&KEEP_WORKSPACE=false&USER_CREDENTIALS_ID=&JDK_VERSION=17&DOCKER_REGISTRY_URL=&ITERATIONS=1&VENDOR_TEST_REPOS=&JDK_REPO=https%3A%2F%2Fgithub.com%2Fadoptium%2Fjdk17u&JCK_GIT_BRANCH=master&OPENJ9_BRANCH=master&OPENJ9_SHA=&JCK_GIT_REPO=&VENDOR_TEST_BRANCHES=&UPSTREAM_JOB_NAME=build-scripts%2Fjobs%2Fjdk17u%2Fjdk17u-linux-x64-temurin&OPENJ9_REPO=https%3A%2F%2Fgithub.com%2Feclipse-openj9%2Fopenj9.git&CLOUD_PROVIDER=&CUSTOM_TARGET=&VENDOR_TEST_SHAS=&JDK_BRANCH=dev&LABEL_ADDITION=&ARTIFACTORY_REPO=&ARTIFACTORY_ROOT_DIR=&UPSTREAM_TEST_JOB_NUMBER=&DOCKERIMAGE_TAG=&JDK_IMPL=hotspot&TEST_TIME=&SSH_AGENT_CREDENTIAL=&AUTO_DETECT=true&SLACK_CHANNEL=&DYNAMIC_COMPILE=false&ADOPTOPENJDK_SYSTEMTEST_OWNER_BRANCH=adoptium%3Amaster&APPLICATION_OPTIONS=&CUSTOMIZED_SDK_URL_CREDENTIAL_ID=eclipse_temurin_bot_email_and_token&ARCHIVE_TEST_RESULTS=false&NUM_MACHINES=&OPENJDK_SHA=&TRSS_URL=&USE_TESTENV_PROPERTIES=false&BUILD_LIST=system&UPSTREAM_JOB_NUMBER=202&STF_OWNER_BRANCH=adoptium%3Amaster&TIME_LIMIT=10&JVM_OPTIONS=&PARALLEL=None)

```
[2023-01-02T02:54:43.839Z] Cancelling nested steps due to timeout
[2023-01-02T02:54:43.863Z] Sending interrupt signal to process
[2023-01-02T02:54:45.433Z] Terminated
[2023-01-02T02:54:45.433Z] make[4]: *** [autoGen.mk:479: jcstress_StampedLockPairwiseTests_0] Error 143
[2023-01-02T02:54:45.433Z] make[4]: Leaving directory '/home/jenkins/workspace/Test_openjdk17_hs_dev.system_x86-64_alpine-linux/aqa-tests/system/jcstress'
[2023-01-02T02:54:45.433Z] make[3]: *** [/home/jenkins/workspace/Test_openjdk17_hs_dev.system_x86-64_alpine-linux/aqa-tests/TKG/../TKG/settings.mk:356: dev.system-jcstress] Error 2
[2023-01-02T02:54:45.433Z] make[3]: Leaving directory '/home/jenkins/workspace/Test_openjdk17_hs_dev.system_x86-64_alpine-linux/aqa-tests/system'
[2023-01-02T02:54:45.433Z] make[2]: *** [/home/jenkins/workspace/Test_openjdk17_hs_dev.system_x86-64_alpine-linux/aqa-tests/TKG/../TKG/settings.mk:356: dev.system-system] Error 2
[2023-01-02T02:54:45.433Z] make[2]: Leaving directory '/home/jenkins/workspace/Test_openjdk17_hs_dev.system_x86-64_alpine-linux/aqa-tests'
[2023-01-02T02:54:45.433Z] make[1]: *** [settings.mk:356: dev.system-..] Error 2
[2023-01-02T02:54:45.433Z] make[1]: Leaving directory '/home/jenkins/workspace/Test_openjdk17_hs_dev.system_x86-64_alpine-linux/aqa-tests/TKG'
[2023-01-02T02:54:45.433Z] make: *** [makefile:50: _dev.system] Error 2
[2023-01-02T02:54:45.500Z] script returned exit code 2
```

This test passes on certain machines as per ["Deep history" view](https://trss.adoptium.net/deepHistory?testId=63b207a4ed0b30773b2ff454):
Screen Shot 2023-01-02 at 7 55 38 PM

Possibly related:
https://github.com/adoptium/aqa-tests/pull/4210

Contributor guide

Open the contributing guide

Research direction

Start with the jcstress test under system/jcstress and the timeout-related build rules referenced in autoGen.mk, TKG/settings.mk, and makefile. Review the Grinder rerun and TRSS results for jcstress_StampedLockPairwiseTests_0 across the listed Docker machines. Done means the test is no longer terminated by nested timeout on affected platforms and the system test run completes successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, java
Domain
ci-cd, infrastructure, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.