CI Reliability 2024-06-12
Open
Nobody has claimed this yet.
- Dominant language
- Shell
- Stars
- 57
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Description
Failures in node-test-pull-request/59630 to node-test-pull-request/59726 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)
| UTC Time | RUNNING | SUCCESS | UNSTABLE | ABORTED | FAILURE | Green Rate |
|---|---|---|---|---|---|---|
| 2024-06-12 00:08 | 0 | 4 | 38 | 3 | 55 | 4.12% |
Jenkins Failure
| Reason | Build timed out (after 60 minutes). Marking the build as failed. |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/53300/, https://github.com/nodejs/node/pull/53015/, https://github.com/nodejs/node/pull/53389/) |
| Appeared | test-ibm-ubi81_container-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59636/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59712/ |
Example
Build timed out (after 60 minutes). Marking the build as failed.
CCTest Failure
| Reason | Value of: (!expectation.read_expected) |
|---|---|
| Type | CC_TEST_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/53332/, https://github.com/nodejs/node/pull/53366/, https://github.com/nodejs/node/pull/53364/, https://github.com/nodejs/node/pull/53370/) |
| Appeared | test-equinix-rhel8_container-arm64-2, test-equinix-rhel8_container-arm64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59652/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59709/ |
Example
Value of: (!expectation.read_expected)
Actual: true
Expected: false
[ FAILED ] InspectorSocketTest.HostIPv6NonRoutable (5000 ms)
| Reason | C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected) |
|---|---|
| Type | CC_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/53255/, https://github.com/nodejs/node/pull/53348/, https://github.com/nodejs/node/pull/53239/) |
| Appeared | test-rackspace-win2019_vs2019-x64-3, test-azure_msft-win11_vs2022-x64-4, test-rackspace-win2019_vs2019-x64-4, test-azure_msft-win10_vs2019-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59630/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59707/ |
Example
C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected)
Actual: true
Expected: false
[ FAILED ] InspectorSocketTest.HostIPv6NonRoutable (5001 ms)
Build Failure
| Reason | ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/53300/, https://github.com/nodejs/node/pull/52966/, https://github.com/nodejs/node/pull/53360/, https://github.com/nodejs/node/pull/53239/) |
| Appeared | test-equinix-debian11_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-1, test-equinix-debian11_container-armv7l-2, test-osuosl-ubuntu2004_container-armv7l-1, test-mnx-smartos21-x64-2, test-mnx-smartos23-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59636/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59708/ |
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
[PostBuildScript] - [INFO] Executing post build scripts.
[node-test-binary-armv7l] $ /bin/bash -ex /tmp/jenkins12768703676936592769.sh
+ '[' -d .git ']'
+ git clean -fdx
Removing out/
JSTest Failure
| Reason | parallel/test-net-write-fully-async-buffer |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 6 (https://github.com/nodejs/node/pull/53336/, https://github.com/nodejs/node/pull/53355/, https://github.com/nodejs/node/pull/53370/, https://github.com/nodejs/node/pull/53389/, https://github.com/nodejs/node/pull/53239/, https://github.com/nodejs/node/pull/53412/) |
| Appeared | test-equinix-rhel8_container-arm64-1, test-equinix-ubuntu2004_container-arm64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59658/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59725/ |
Example
not ok 4023 parallel/test-net-write-fully-async-buffer
---
duration_ms: 360113.42500
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | sequential/test-http-server-request-timeouts-mixed |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 6 (https://github.com/nodejs/node/pull/53226/, https://github.com/nodejs/node/pull/53331/, https://github.com/nodejs/node/pull/53352/, https://github.com/nodejs/node/pull/53366/, https://github.com/nodejs/node/pull/53015/, https://github.com/nodejs/node/pull/53239/) |
| Appeared | test-orka-macos11-x64-2, test-orka-macos11-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59649/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59706/ |
Example
not ok 4114 sequential/test-http-server-request-timeouts-mixed
---
duration_ms: 3319.65100
severity: fail
exitcode: 1
stack: |-
node:assert:408
throw err;
^
AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
assert(request2.completed)
at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5)
at listOnTimeout (node:internal/timers:581:17)
at process.processTimers (node:internal/timers:519:7) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: false,
expected: true,
operator: '=='
}
Node.js v23.0.0-pre
...
Example
not ok 4016 benchmark/test-benchmark-crypto
---
duration_ms: 3540.87800
severity: fail
exitcode: 1
stack: |-
node:assert:126
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
1 !== 0
at main (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/benchmark/crypto/timingSafeEqual.js:21:10)
at /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/benchmark/common.js:54:9
at process.processTicksAndRejections (node:internal/process/task_queues:77:11) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 1,
expected: 0,
operator: 'strictEqual'
}
Node.js v23.0.0-pre
node:assert:126
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
1 !== 0
at ChildProcess.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-...
| Reason | parallel/test-performance-function |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 5 (https://github.com/nodejs/node/pull/53228/, https://github.com/nodejs/node/pull/53300/, https://github.com/nodejs/node/pull/53337/, https://github.com/nodejs/node/pull/53336/, https://github.com/nodejs/node/pull/52435/) |
| Appeared | undefined, test-ibm-ubi81_container-x64-1, test-ibm-ubuntu2204_sharedlibs_container-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59631/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59719/ |
Example
not ok 2446 parallel/test-performance-function
---
duration_ms: 333.54800
severity: fail
exitcode: 1
stack: |-
node:internal/event_target:1090
process.nextTick(() => { throw err; });
^
RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0
at RecordableHistogram.record (node:internal/histogram:291:5)
at processComplete (node:internal/perf/timerify:40:15)
at timerified m (node:internal/perf/timerify:87:5)
at /home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-performance-function.js:103:5 {
code: 'ERR_OUT_OF_RANGE'
}
Node.js v23.0.0-pre
...
Example
not ok 4081 wpt/test-compression
---
duration_ms: 1440113.84100
severity: fail
exitcode: -15
stack: |-
timeout
[SKIPPED] compression-bad-chunks.tentative.any.js: Execution "hangs", ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write
[SKIPPED] decompression-bad-chunks.tentative.any.js: Execution "hangs", ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write
[SKIPPED] decompression-buffersource.tentative.any.js: ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write
[SKIPPED] idlharness-shadowrealm.window.js: ShadowRealm support is not enabled
[SKIPPED] third_party/pako/pako_inflate.min.js: This is not a test file.
[PASS] "a" should cause the constructor to throw
[PASS] "a" should cause the constructor to throw
[PASS] no input should cause the constructor to throw
[PASS] no input should cause the constructor to throw
[PASS] non-string inpu...
| Reason | async-hooks/test-writewrap |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/53255/, https://github.com/nodejs/node/pull/53355/, https://github.com/nodejs/node/pull/53366/) |
| Appeared | test-digitalocean-ubuntu2204_sharedlibs_container-x64-4, test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59630/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59693/ |
Example
not ok 3801 async-hooks/test-writewrap
---
duration_ms: 120035.49900
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-buffer-tostring-rangeerror |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/53255/, https://github.com/nodejs/node/pull/53226/, https://github.com/nodejs/node/pull/53337/) |
| Appeared | test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-digitalocean-ubuntu2204_sharedlibs_container-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59630/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59655/ |
Example
not ok 1474 parallel/test-buffer-tostring-rangeerror
---
duration_ms: 120056.71600
severity: fail
exitcode: -15
stack: |-
timeout
(node:1474366) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
(Use `node --trace-deprecation ...` to show where the warning was created)
...
| Reason | node-api/test_threadsafe_function/test |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/52966/, https://github.com/nodejs/node/pull/53379/) |
| Appeared | test-equinix-ubuntu2004_container-armv7l-1, test-equinix-debian11_container-armv7l-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59672/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59715/ |
Example
not ok 3968 node-api/test_threadsafe_function/test
---
duration_ms: 360098.44500
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-performance-eventlooputil |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/53364/, https://github.com/nodejs/node/pull/53332/) |
| Appeared | undefined, test-ibm-rhel8-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59690/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59697/ |
Example
not ok 2447 parallel/test-performance-eventlooputil
---
duration_ms: 332.14600
severity: fail
exitcode: 1
stack: |-
node:internal/event_target:1090
process.nextTick(() => { throw err; });
^
AssertionError [ERR_ASSERTION]: 49.31923294067383 >= 49.31923294067383
at Timeout.r (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-performance-eventlooputil.js:52:10)
at Timeout.r [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/common/index.js:466:15)
at listOnTimeout (node:internal/timers:581:17)
at process.processTimers (node:internal/timers:519:7) {
generatedMessage: false,
code: 'ERR_ASSERTION',
actual: false,
expected: true,
operator: '=='
}
Node.js v23.0.0-pre
...
| Reason | parallel/test-pipe-file-to-http |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/53292/, https://github.com/nodejs/node/pull/53373/) |
| Appeared | test-equinix-ubuntu2004_container-armv7l-1, test-equinix-debian11_container-armv7l-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59634/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59682/ |
Example
not ok 3836 parallel/test-pipe-file-to-http
---
duration_ms: 360062.61300
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-worker-memory |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/53337/, https://github.com/nodejs/node/pull/53352/) |
| Appeared | test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win11_vs2022-x64-4, test-rackspace-win2022_vs2022-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59656/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59665/ |
Example
not ok 895 parallel/test-worker-memory
---
duration_ms: 1540.45000
severity: crashed
exitcode: 3221225477
stack: |-
run() called with n=15 (numWorkers=4)
run() called with n=15 (numWorkers=4)
run() called with n=15 (numWorkers=4)
run() called with n=15 (numWorkers=4)
run() called with n=14 (numWorkers=4)
run() called with n=14 (numWorkers=4)
run() called with n=14 (numWorkers=4)
run() called with n=14 (numWorkers=4)
run() called with n=13 (numWorkers=4)
run() called with n=13 (numWorkers=4)
run() called with n=13 (numWorkers=4)
run() called with n=12 (numWorkers=4)
run() called with n=12 (numWorkers=4)
run() called with n=13 (numWorkers=4)
run() called with n=11 (numWorkers=4)
run() called with n=12 (numWorkers=4)
run() called with n=11 (numWorkers=4)
run() called with n=12 (numWorkers=4)
run() called with n=10 (numWorkers=4)
run() called with n=11 (numWorkers=4)
run() called with n=10 (numWorkers=4)
run() called...
| Reason | parallel/test-worker-stdio-from-preload-module |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/53332/, https://github.com/nodejs/node/pull/53337/) |
| Appeared | test-rackspace-win2016_vs2015-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59652/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59656/ |
Example
not ok 896 parallel/test-worker-stdio-from-preload-module
---
duration_ms: 231.00900
severity: crashed
exitcode: 3221225477
stack: |-
...
| Reason | sequential/test-single-executable-application-snapshot-and-code-cache |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/53370/, https://github.com/nodejs/node/pull/53416/) |
| Appeared | test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59705/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59722/ |
Example
not ok 4144 sequential/test-single-executable-application-snapshot-and-code-cache
---
duration_ms: 9445.62500
severity: fail
exitcode: 1
stack: |-
Copied /home/iojs/build/workspace/node-test-commit-linux-containered/out/Release/node to /home/iojs/node-tmp/.tmp.4143/sea
Injected /home/iojs/node-tmp/.tmp.4143/sea-prep.blob into /home/iojs/node-tmp/.tmp.4143/sea
[process 2197433]: --- stderr ---
Found SEA blob 0x5561389f0080, size=4431744
Found SEA resource 0x5561389f0080, size=4431744
Read<uint32_t>()(4-byte), count=1: { 21223968 }, read 4 bytes
Read SEA magic 143da20
Read<uint32_t>()(4-byte), count=1: { 6 }, read 4 bytes
Read SEA flags 6
Read<uint64_t>()(8-byte), count=1: { 11 }, read 8 bytes
ReadStringView(), length=11: 0x5561389f0090, read 11 bytes, content: snapshot.js
Read SEA code path 0x5561389f0090, size=11
Read<uint64_t>()(8-byte), count=1: { 4431709 }, read 8 bytes
ReadStringView(), length=4431709: 0x5561389f00a3, read 4431709 bytes
...
Progress
-
Build timed out (after 60 minutes). Marking the build as failed.(3) -
Value of: (!expectation.read_expected)(4) -
C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected)(3) -
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?(4) -
parallel/test-net-write-fully-async-buffer(6) -
sequential/test-http-server-request-timeouts-mixed(6) -
benchmark/test-benchmark-crypto(5) -
parallel/test-performance-function(5) -
wpt/test-compression(4) -
async-hooks/test-writewrap(3) -
parallel/test-buffer-tostring-rangeerror(3) -
node-api/test_threadsafe_function/test(2) -
parallel/test-performance-eventlooputil(2) -
parallel/test-pipe-file-to-http(2) -
parallel/test-worker-memory(2) -
parallel/test-worker-stdio-from-preload-module(2) -
sequential/test-single-executable-application-snapshot-and-code-cache(2)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The report is generated by ncu-ci walk pr --stats=true --markdown; start by reviewing the linked Jenkins logs and the listed failures, including test/cctest/test_inspector_socket.cc and the named JavaScript tests. The issue does not define a specific fix or acceptance criteria, so completion would require identifying the recurring CI causes and confirming the affected jobs pass.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- nodejs, shell
- Domain
- ci-cd, devops, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100