CI Reliability 2024-06-14
Open
Nobody has claimed this yet.
- Dominant language
- Shell
- Stars
- 57
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Description
Failures in node-test-pull-request/59679 to node-test-pull-request/59773 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)
| UTC Time | RUNNING | SUCCESS | UNSTABLE | ABORTED | FAILURE | Green Rate |
|---|---|---|---|---|---|---|
| 2024-06-14 00:08 | 2 | 3 | 34 | 4 | 57 | 3.19% |
Jenkins Failure
| Reason | Build timed out (after 60 minutes). Marking the build as failed. |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/53015/, https://github.com/nodejs/node/pull/53389/, https://github.com/nodejs/node/pull/53063/) |
| Appeared | test-digitalocean-ubi81_container-x64-1, test-ibm-ubi81_container-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59696/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59769/ |
Example
Build timed out (after 60 minutes). Marking the build as failed.
CCTest Failure
| Reason | Value of: (!expectation.read_expected) |
|---|---|
| Type | CC_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/53366/, https://github.com/nodejs/node/pull/53364/, https://github.com/nodejs/node/pull/53370/) |
| Appeared | test-equinix-rhel8_container-arm64-2, test-equinix-rhel8_container-arm64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59689/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59709/ |
Example
Value of: (!expectation.read_expected)
Actual: true
Expected: false
[ FAILED ] InspectorSocketTest.HostIPv6NonRoutable (5000 ms)
Git Failure
Build Failure
Example
fatal: No rebase in progress?
JSTest Failure
Example
not ok 4014 benchmark/test-benchmark-crypto
---
duration_ms: 5025.11400
severity: fail
exitcode: 1
stack: |-
node:assert:126
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
1 !== 0
at main (/home/iojs/build/workspace/node-test-commit-arm-debug/benchmark/crypto/timingSafeEqual.js:21:10)
at /home/iojs/build/workspace/node-test-commit-arm-debug/benchmark/common.js:54:9
at process.processTicksAndRejections (node:internal/process/task_queues:77:11) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 1,
expected: 0,
operator: 'strictEqual'
}
Node.js v23.0.0-pre
node:assert:126
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
1 !== 0
at ChildProcess.<anonymous> (/home/iojs/build/workspace/node-test-commit-arm-debug/test/common/benchmark.js:28:1...
| Reason | parallel/test-net-write-fully-async-buffer |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 5 (https://github.com/nodejs/node/pull/53370/, https://github.com/nodejs/node/pull/53389/, https://github.com/nodejs/node/pull/53239/, https://github.com/nodejs/node/pull/53412/, https://github.com/nodejs/node/pull/52135/) |
| Appeared | test-equinix-rhel8_container-arm64-2, test-equinix-rhel8_container-arm64-1, test-equinix-ubuntu2004_container-arm64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59705/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59742/ |
Example
not ok 4019 parallel/test-net-write-fully-async-buffer
---
duration_ms: 360115.73200
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-pipe-file-to-http |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/53373/, https://github.com/nodejs/node/pull/53429/, https://github.com/nodejs/node/pull/53157/, https://github.com/nodejs/node/pull/51344/) |
| Appeared | test-equinix-ubuntu2004_container-armv7l-1, test-osuosl-ubuntu2004_container-armv7l-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59682/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59773/ |
Example
not ok 3837 parallel/test-pipe-file-to-http
---
duration_ms: 360027.69000
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | sequential/test-http-server-request-timeouts-mixed |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/53366/, https://github.com/nodejs/node/pull/53015/, https://github.com/nodejs/node/pull/53239/, https://github.com/nodejs/node/pull/53442/) |
| Appeared | test-orka-macos11-x64-2, test-orka-macos11-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59689/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59761/ |
Example
not ok 4114 sequential/test-http-server-request-timeouts-mixed
---
duration_ms: 3250.92100
severity: fail
exitcode: 1
stack: |-
node:assert:408
throw err;
^
AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
assert(request2.completed)
at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5)
at listOnTimeout (node:internal/timers:581:17)
at process.processTimers (node:internal/timers:519:7) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: false,
expected: true,
operator: '=='
}
Node.js v23.0.0-pre
...
| Reason | async-hooks/test-writewrap |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/53366/, https://github.com/nodejs/node/pull/53436/) |
| Appeared | test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-digitalocean-ubuntu2204_sharedlibs_container-x64-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59693/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59748/ |
Example
not ok 3791 async-hooks/test-writewrap
---
duration_ms: 120010.79300
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | benchmark/test-benchmark-child-process |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/53439/, https://github.com/nodejs/node/pull/53442/) |
| Appeared | test-osuosl-debian11_container-armv7l-1, test-osuosl-ubuntu2004_container-armv7l-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59755/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59761/ |
Example
not ok 171 benchmark/test-benchmark-child-process
---
duration_ms: 2160099.51100
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-performance-eventlooputil |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/53364/, https://github.com/nodejs/node/pull/53332/) |
| Appeared | undefined, test-ibm-rhel8-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59690/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59697/ |
Example
not ok 2447 parallel/test-performance-eventlooputil
---
duration_ms: 332.14600
severity: fail
exitcode: 1
stack: |-
node:internal/event_target:1090
process.nextTick(() => { throw err; });
^
AssertionError [ERR_ASSERTION]: 49.31923294067383 >= 49.31923294067383
at Timeout.r (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-performance-eventlooputil.js:52:10)
at Timeout.r [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/common/index.js:466:15)
at listOnTimeout (node:internal/timers:581:17)
at process.processTimers (node:internal/timers:519:7) {
generatedMessage: false,
code: 'ERR_ASSERTION',
actual: false,
expected: true,
operator: '=='
}
Node.js v23.0.0-pre
...
| Reason | parallel/test-stream-readable-unpipe-resume |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/53412/, https://github.com/nodejs/node/pull/53239/) |
| Appeared | test-equinix-rhel8_container-arm64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59721/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59743/ |
Example
not ok 3789 parallel/test-stream-readable-unpipe-resume
---
duration_ms: 360039.41700
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | sequential/test-single-executable-application-snapshot-and-code-cache |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/53370/, https://github.com/nodejs/node/pull/53416/) |
| Appeared | test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/59705/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/59722/ |
Example
not ok 4144 sequential/test-single-executable-application-snapshot-and-code-cache
---
duration_ms: 9445.62500
severity: fail
exitcode: 1
stack: |-
Copied /home/iojs/build/workspace/node-test-commit-linux-containered/out/Release/node to /home/iojs/node-tmp/.tmp.4143/sea
Injected /home/iojs/node-tmp/.tmp.4143/sea-prep.blob into /home/iojs/node-tmp/.tmp.4143/sea
[process 2197433]: --- stderr ---
Found SEA blob 0x5561389f0080, size=4431744
Found SEA resource 0x5561389f0080, size=4431744
Read<uint32_t>()(4-byte), count=1: { 21223968 }, read 4 bytes
Read SEA magic 143da20
Read<uint32_t>()(4-byte), count=1: { 6 }, read 4 bytes
Read SEA flags 6
Read<uint64_t>()(8-byte), count=1: { 11 }, read 8 bytes
ReadStringView(), length=11: 0x5561389f0090, read 11 bytes, content: snapshot.js
Read SEA code path 0x5561389f0090, size=11
Read<uint64_t>()(8-byte), count=1: { 4431709 }, read 8 bytes
ReadStringView(), length=4431709: 0x5561389f00a3, read 4431709 bytes
...
Progress
-
Build timed out (after 60 minutes). Marking the build as failed.(3) -
Value of: (!expectation.read_expected)(3) -
fatal: No rebase in progress?(6) -
benchmark/test-benchmark-crypto(7) -
parallel/test-net-write-fully-async-buffer(5) -
parallel/test-pipe-file-to-http(4) -
sequential/test-http-server-request-timeouts-mixed(4) -
async-hooks/test-writewrap(2) -
benchmark/test-benchmark-child-process(2) -
parallel/test-performance-eventlooputil(2) -
parallel/test-stream-readable-unpipe-resume(2) -
sequential/test-single-executable-application-snapshot-and-code-cache(2)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the linked Jenkins console logs and the named failures, including benchmark/test-benchmark-crypto, parallel/test-net-write-fully-async-buffer, and sequential/test-http-server-request-timeouts-mixed. Reproduce the reported failures and trace whether they are test, build, or infrastructure problems; done means the causes are addressed and the affected CI checks pass reliably.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- node.js, shell
- Domain
- ci-cd, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100