CI Reliability 2024-04-21
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 25/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- javascript, node.js, shell
- Domain
- ci-cd, devops, testing-qa
Research direction
Start with the failing test entry points named in the report, such as parallel/test-error-serdes, parallel/test-fs-read-stream-concurrent-reads, and parallel/test-http2-large-write-multiple-requests, then inspect their linked CI console logs. Reproduce the failures with the reported ncu-ci walk pr command; done means identifying and addressing the causes so these repeated CI failures no longer occur across the affected environments.
Written by the indexing model from the issue text.
Description
Failures in node-test-pull-request/58465 to node-test-pull-request/58560 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)
| UTC Time | RUNNING | SUCCESS | UNSTABLE | ABORTED | FAILURE | Green Rate |
|---|---|---|---|---|---|---|
| 2024-04-21 00:08 | 3 | 3 | 19 | 7 | 68 | 3.33% |
JSTest Failure
Example
not ok 1690 parallel/test-error-serdes
---
duration_ms: 120085.92000
severity: fail
exitcode: -15
stack: |-
timeout
...
Example
not ok 1425 parallel/test-fs-read-stream-concurrent-reads
---
duration_ms: 120057.54300
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-http2-large-write-multiple-requests |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 6 (https://github.com/nodejs/node/pull/52431/, https://github.com/nodejs/node/pull/51821/, https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52349/, https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/49709/) |
| Appeared | test-rackspace-win2019_vs2019-x64-4, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-orka-macos11-x64-1, test-ibm-rhel8-x64-2, test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-ibm-rhel8-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/58469/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/58513/ |
Example
not ok 951 parallel/test-http2-large-write-multiple-requests
---
duration_ms: 120377.13200
severity: fail
exitcode: 1
stack: |-
timeout
server sends content 1
server sends content 2
server sends content 3
server sends content 4
server sends content 5
server sends content 6
server sends content 7
server sends content 8
server sends content 9
server sends content 10
server sends content 11
server sends content 12
server sends content 13
server sends content 14
server sends content 15
server sends content 16
server sends content 17
server sends content 18
server sends content 19
server sends content 20
server sends content 21
server sends content 22
server sends content 23
server sends content 24
server sends content 25
server sends content 26
server sends content 27
server sends content 28
server sends content 29
server sends content 30
server sends content 31
server send...
Example
not ok 375 parallel/test-blob-file-backed
---
duration_ms: 430.40100
severity: fail
exitcode: 1
stack: |-
node:internal/blob:291
const error = lazyDOMException('The blob could not be read', 'NotReadableError');
^
DOMException [NotReadableError]: The blob could not be read
at BlobReader.<anonymous> (node:internal/blob:291:25)
Node.js v22.0.0-pre
...
| Reason | pummel/test-crypto-timing-safe-equal-benchmarks |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 5 (https://github.com/nodejs/node/pull/52431/, https://github.com/nodejs/node/pull/52104/, https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52564/, https://github.com/nodejs/node/pull/52493/) |
| Appeared | test-macstadium-macos11.0-arm64-4, test-rackspace-win2022_vs2022-x64-2, test-rackspace-win2019_vs2019-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/58465/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/58517/ |
Example
not ok 3777 pummel/test-crypto-timing-safe-equal-benchmarks
---
duration_ms: 1626.37700
severity: fail
exitcode: 1
stack: |-
node:assert:408
throw err;
^
AssertionError [ERR_ASSERTION]: timingSafeEqual should not leak information from its execution time (t=4.30607891941049)
at Object.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/test/pummel/test-crypto-timing-safe-equal-benchmarks.js:109:1)
at Module._compile (node:internal/modules/cjs/loader:1476:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1555:10)
at Module.load (node:internal/modules/cjs/loader:1288:32)
at Module._load (node:internal/modules/cjs/loader:1104:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:187:14)
at node:internal/main/run_main_module:28:49 {
generatedMessage: false,
code: 'ERR_ASSERTION',
actual: false,
expected: true,
operator: '==...
Example
not ok 4009 benchmark/test-benchmark-crypto
---
duration_ms: 2717.57200
severity: fail
exitcode: 1
stack: |-
node:assert:126
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
1 !== 0
at main (/home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/crypto/timingSafeEqual.js:21:10)
at /home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/common.js:54:9
at process.processTicksAndRejections (node:internal/process/task_queues:77:11) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 1,
expected: 0,
operator: 'strictEqual'
}
Node.js v22.0.0-pre
node:assert:126
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
1 !== 0
at ChildProcess.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux-containered/test/...
| Reason | parallel/test-buffer-tostring-rangeerror |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/51821/, https://github.com/nodejs/node/pull/52573/, https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52564/) |
| Appeared | test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-ibm-rhel8-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-8, test-ibm-ubuntu2204_sharedlibs_container-x64-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/58481/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/58493/ |
Example
not ok 732 parallel/test-buffer-tostring-rangeerror
---
duration_ms: 120042.35700
severity: fail
exitcode: -15
stack: |-
timeout
(node:1454310) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
(Use `node --trace-deprecation ...` to show where the warning was created)
...
| Reason | async-hooks/test-writewrap |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/52104/, https://github.com/nodejs/node/pull/52564/, https://github.com/nodejs/node/pull/52465/) |
| Appeared | test-digitalocean-ubuntu2204_sharedlibs_container-x64-4, test-digitalocean-ubuntu2204_sharedlibs_container-x64-8, test-ibm-ubuntu2204_sharedlibs_container-x64-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/58488/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/58521/ |
Example
not ok 3788 async-hooks/test-writewrap
---
duration_ms: 120029.87400
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-file-write-stream4 |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/51050/, https://github.com/nodejs/node/pull/52592/, https://github.com/nodejs/node/pull/51340/) |
| Appeared | test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/58533/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/58560/ |
Example
not ok 1408 parallel/test-file-write-stream4
---
duration_ms: 120053.95900
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-net-write-fully-async-buffer |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/52465/, https://github.com/nodejs/node/pull/52505/) |
| Appeared | test-equinix-ubuntu2004_container-armv7l-2, test-equinix-ubuntu2004_container-arm64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/58521/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/58530/ |
Example
not ok 3811 parallel/test-net-write-fully-async-buffer
---
duration_ms: 360121.42100
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-stream-readable-unpipe-resume |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/52611/, https://github.com/nodejs/node/pull/51340/) |
| Appeared | test-ibm-ubi81_container-x64-1, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-digitalocean-ubuntu2204_sharedlibs_container-x64-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/58547/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/58560/ |
Example
not ok 3780 parallel/test-stream-readable-unpipe-resume
---
duration_ms: 120070.30700
severity: fail
exitcode: -15
stack: |-
timeout
...
Jenkins Failure
| Reason | Backing channel 'JNLP4-connect connection from ... is disconnected. |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52465/, https://github.com/nodejs/node/pull/52573/) |
| Appeared | test-digitalocean-debian12-x64-1, test-digitalocean-debian11-x64-1, test-rackspace-fedora32-x64-1, test-softlayer-debian12-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/58476/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/58557/ |
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 159.203.105.159/159.203.105.159:56396' is disconnected.
at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at jdk.proxy2/jdk.proxy2.$Proxy164.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1212)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1204)
Build Failure
| Reason | error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 9 (https://github.com/nodejs/node/pull/51821/, https://github.com/nodejs/node/pull/52552/, https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52349/, https://github.com/nodejs/node/pull/52104/, https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/49709/, https://github.com/nodejs/node/pull/52587/, https://github.com/nodejs/node/pull/51340/) |
| Appeared | test-rackspace-win2022_vs2022-x64-2, test-rackspace-win2022_vs2022-x64-4, test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2022_vs2022-x64-1, test-rackspace-win2022_vs2022-x64-3, test-rackspace-win2022_vs2022-x64-6 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/58481/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/58552/ |
Example
error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
object-fromentries-tq-csa.cc
object-groupby-tq-csa.cc
math-tq-csa.cc
object-tq-csa.cc
| Reason | fatal error: Killed signal terminated program cc1plus |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/52573/, https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52465/, https://github.com/nodejs/node/pull/52365/) |
| Appeared | test-digitalocean-rhel8_arm_cross_container-x64-2, test-digitalocean-rhel8_arm_cross_container-x64-1, test-softlayer-debian12-x64-1, test-rackspace-fedora32-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-9 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/58484/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/58527/ |
Example
fatal error: Killed signal terminated program cc1plus
| Reason | ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for ... |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52573/) |
| Appeared | test-digitalocean-debian12-x64-1, test-digitalocean-debian11-x64-1, test-softlayer-debian12-x64-1, test-rackspace-fedora32-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/58497/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/58554/ |
Example
ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for node-test-commit-linux/nodes=debian12-x64 #57337
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
| Reason | fatal: No rebase in progress? |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/52517/, https://github.com/nodejs/node/pull/52349/) |
| Appeared | test-ibm-ubuntu2204_sharedlibs_container-x64-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/58472/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/58495/ |
Example
fatal: No rebase in progress?
CCTest Failure
Progress
-
parallel/test-error-serdes(14) -
parallel/test-fs-read-stream-concurrent-reads(7) -
parallel/test-http2-large-write-multiple-requests(6) -
parallel/test-blob-file-backed(5) -
pummel/test-crypto-timing-safe-equal-benchmarks(5) -
benchmark/test-benchmark-crypto(4) -
parallel/test-buffer-tostring-rangeerror(4) -
async-hooks/test-writewrap(3) -
parallel/test-file-write-stream4(3) -
parallel/test-net-write-fully-async-buffer(2) -
parallel/test-stream-readable-unpipe-resume(2) -
Backing channel 'JNLP4-connect connection from ... is disconnected.(3) -
error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj](9) -
fatal error: Killed signal terminated program cc1plus(4) -
ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for ...(2) -
fatal: No rebase in progress?(2)
- Dominant language
- Shell
- Stars
- 57
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from nodejs/reliability
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1666 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
nodejs/reliability#1665 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
nodejs/reliability#1664 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1663 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1662 ·
All issues in nodejs/reliability
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
community-scripts/ProxmoxVE#17396 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
mattpocock/skills#1099 ·
-
Update Vish to 1.1.5 Openpackage-update
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
oSoWoSo/vOid_Community_repOsitory#144 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
help wanted new command
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
tldr-pages/tldr#24151 ·