CI Reliability 2022-11-10
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 18/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- git, node.js, shell
- Domain
- ci-cd, devops, infrastructure, testing-qa
Research direction
Start by reviewing the linked node-test-pull-request and node-test-commit Jenkins logs, grouped by the listed failure reasons and affected workers. Done means determining actionable causes and restoring reliable CI for the reported failure categories; the issue names no source files or tests to change.
Written by the indexing model from the issue text.
Description
Failures in node-test-pull-request/47720 to node-test-pull-request/47815 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)
| UTC Time | RUNNING | SUCCESS | UNSTABLE | ABORTED | FAILURE | Green Rate |
|---|---|---|---|---|---|---|
| 2022-11-10 00:16 | 4 | 4 | 27 | 1 | 64 | 4.21% |
CCTest Failure
Jenkins Failure
| Reason | Backing channel 'JNLP4-connect connection from ... is disconnected. |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/44947/, https://github.com/nodejs/node/pull/45125/) |
| Appeared | test-digitalocean-freebsd12-x64-2, test-azure_msft-win10_vs2019-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47800/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47804/ |
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 107.170.28.213/107.170.28.213:54101' is disconnected.
at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at jdk.proxy2/jdk.proxy2.$Proxy87.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
| Reason | Build timed out (after 60 minutes). Marking the build as failed. |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/45363/, https://github.com/nodejs/node/pull/45371/) |
| Appeared | test-softlayer-ubi81_container-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47775/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47791/ |
Example
Build timed out (after 60 minutes). Marking the build as failed.
Build Failure
Example
error: ld returned 1 exit status
deps/openssl/openssl-cli.target.mk:289: recipe for target '/home/iojs/build/workspace/node-test-commit-linux/out/Release/openssl-cli' failed
make[2]: *** [/home/iojs/build/workspace/node-test-commit-linux/out/Release/openssl-cli] Error 1
make[2]: *** Waiting for unfinished jobs....
rm fae5cd31e116e929ac9742c7ac8b778409c12442.intermediate
Makefile:134: recipe for target 'node' failed
Example
error: remote GitHub already exists.
> git fetch --prune --no-tags GitHub
> git fetch --prune --no-tags https://github.com/nodejs/build.git +refs/heads/main:refs/remotes/jenkins_tmp
| Reason | fatal: invalid refspec '+refs/heads/:refs/remotes/jenkins_tmp' |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 6 (https://github.com/nodejs/node/pull/45125/, https://github.com/nodejs/node/pull/45379/, https://github.com/nodejs/node/pull/45274/, https://github.com/nodejs/node/pull/45388/, https://github.com/nodejs/node/pull/45387/, https://github.com/nodejs/node/pull/45354/) |
| Appeared | test-rackspace-win2012r2_vs2019-x64-5 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47807/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47815/ |
Example
fatal: invalid refspec '+refs/heads/:refs/remotes/jenkins_tmp'
| Reason | ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/45294/, https://github.com/nodejs/node/pull/45335/) |
| Appeared | test-joyent-smartos20-x64-3, test-equinix-rhel8_container-arm64-1, test-equinix-ubuntu1804_container-arm64-2, test-equinix-ubuntu2004_container-arm64-2, test-equinix-ubuntu2004_container-armv7l-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-3, test-osuosl-aix72-ppc64_be-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47720/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47739/ |
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
| Reason | ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/45294/, https://github.com/nodejs/node/pull/45335/) |
| Appeared | test-digitalocean-freebsd12-x64-2, test-ibm-rhel8-s390x-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47722/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47739/ |
Example
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
| Reason | error C1189: #error: cpu_features.c CPU feature detection in not defined for your platform [C:\workspace\node-compile-windows\node\deps\zlib\zlib.vcxproj] |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/44412/, https://github.com/nodejs/node/pull/45387/) |
| Appeared | test-rackspace-win2012r2_vs2019-x64-3, test-rackspace-win2012r2_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47801/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47813/ |
Example
error C1189: #error: cpu_features.c CPU feature detection in not defined for your platform [C:\workspace\node-compile-windows\node\deps\zlib\zlib.vcxproj]
crc32.c
gtest-printers.cc
trace-buffer.cc
tracing-controller.cc
JSTest Failure
Example
not ok 3423 pummel/test-fs-readfile-tostring-fail
---
duration_ms: 0.77
severity: fail
exitcode: 7
stack: |-
/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/pummel/test-fs-readfile-tostring-fail.js:73
throw err;
^
AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOSPC: no space left on device, write
at Object.callback (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/pummel/test-fs-readfile-tostring-fail.js:31:37)
at callback (node:internal/streams/writable:555:21)
at onwriteError (node:internal/streams/writable:418:3)
at onwrite (node:internal/streams/writable:460:7)
at node:internal/fs/streams:439:14
at FSReqCallback.wrapper [as oncomplete] (node:fs:945:5) {
generatedMessage: false,
code: 'ERR_ASSERTION',
actual: [Error: ENOSPC: no space left on device, write] {
errno: -28,
code: 'ENOSPC',
syscall: 'write'
},
expected:...
Example
not ok 793 parallel/test-fs-readfile
---
duration_ms: 0.88
severity: fail
exitcode: 1
stack: |-
node:internal/fs/utils:347
throw err;
^
Error: ENOSPC: no space left on device, ftruncate
at Object.ftruncateSync (node:fs:1130:3)
at Object.truncateSync (node:fs:1089:14)
at Object.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/parallel/test-fs-readfile.js:61:6)
at Module._compile (node:internal/modules/cjs/loader:1205:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1259:10)
at Module.load (node:internal/modules/cjs/loader:1068:32)
at Module._load (node:internal/modules/cjs/loader:909:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:82:12)
at node:internal/main/run_main_module:23:47 {
errno: -28,
syscall: 'ftruncate',
code: 'ENOSPC'
}
Node.js v20.0.0-pre
...
| Reason | parallel/test-fs-promises-file-handle-readFile |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 8 (https://github.com/nodejs/node/pull/45331/, https://github.com/nodejs/node/pull/45294/, https://github.com/nodejs/node/pull/45363/, https://github.com/nodejs/node/pull/44989/, https://github.com/nodejs/node/pull/45181/, https://github.com/nodejs/node/pull/45125/, https://github.com/nodejs/node/pull/45388/, https://github.com/nodejs/node/pull/45354/) |
| Appeared | test-nearform-macos10.15-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47727/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47815/ |
Example
not ok 744 parallel/test-fs-promises-file-handle-readFile
---
duration_ms: 0.94
severity: fail
exitcode: 1
stack: |-
node:internal/process/promises:289
triggerUncaughtException(err, true /* fromPromise */);
^
[Error: ENOSPC: no space left on device, ftruncate] {
errno: -28,
code: 'ENOSPC',
syscall: 'ftruncate'
}
Node.js v20.0.0-pre
...
Example
not ok 3421 pummel/test-fs-largefile
---
duration_ms: 0.75
severity: fail
exitcode: 1
stack: |-
node:internal/fs/utils:347
throw err;
^
Error: ENOSPC: no space left on device, ftruncate
at Object.ftruncateSync (node:fs:1130:3)
at Object.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/pummel/test-fs-largefile.js:37:4)
at Module._compile (node:internal/modules/cjs/loader:1205:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1259:10)
at Module.load (node:internal/modules/cjs/loader:1068:32)
at Module._load (node:internal/modules/cjs/loader:909:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:82:12)
at node:internal/main/run_main_module:23:47 {
errno: -28,
syscall: 'ftruncate',
code: 'ENOSPC'
}
Node.js v20.0.0-pre
...
Example
not ok 1354 parallel/test-fs-watch-recursive
---
duration_ms: 120.43
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | addons/request-interrupt/test |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/45294/, https://github.com/nodejs/node/pull/45204/, https://github.com/nodejs/node/pull/45326/, https://github.com/nodejs/node/pull/45387/) |
| Appeared | test-joyent-smartos20-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47720/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47813/ |
Example
not ok 3507 addons/request-interrupt/test
---
duration_ms: 300.41
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-inspector-multisession-ws |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/45243/, https://github.com/nodejs/node/pull/45331/, https://github.com/nodejs/node/pull/45353/) |
| Appeared | test-nearform-macos10.15-x64-1, test-nearform-macos10.15-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47725/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47782/ |
Example
not ok 1651 parallel/test-inspector-multisession-ws
---
duration_ms: 15.696
severity: fail
exitcode: 1
stack: |-
[test] Connecting to a child Node process
[test] Testing /json/list
[test] Connecting to a child Node process
[test] Testing /json/list
[err] Debugger listening on ws://127.0.0.1:62019/3c32c0a0-e37d-4dd0-a6da-ada474aee1f2
[err] For help, see: https://nodejs.org/en/docs/inspector
[err]
[err] Debugger attached.
[err]
[err] Debugger attached.
[err]
[test] Breaking in code and verifying events are fired
Timed out waiting for matching notification (Initial pause)
1
...
| Reason | addons/report-fatalerror/test |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/45294/, https://github.com/nodejs/node/pull/45371/) |
| Appeared | test-joyent-smartos20-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47720/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47798/ |
Example
not ok 3478 addons/report-fatalerror/test
---
duration_ms: 300.150
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | node-api/test_fatal/test2 |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/45346/, https://github.com/nodejs/node/pull/45354/) |
| Appeared | test-joyent-smartos20-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47746/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47764/ |
Example
not ok 3617 node-api/test_fatal/test2
---
duration_ms: 300.130
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-crypto-key-objects |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/44947/, https://github.com/nodejs/node/pull/45125/) |
| Appeared | test-ibm-rhel7-s390x-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47800/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47802/ |
Example
not ok 2377 parallel/test-crypto-key-objects
---
duration_ms: 120.105
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-heapsnapshot-near-heap-limit-by-api-in-worker |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/45375/, https://github.com/nodejs/node/pull/45388/) |
| Appeared | test-equinix-ubuntu1804_container-arm64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47799/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47809/ |
Example
not ok 1210 parallel/test-heapsnapshot-near-heap-limit-by-api-in-worker
---
duration_ms: 1.524
severity: fail
exitcode: 1
stack: |-
Invoked NearHeapLimitCallback, processing=false, current_limit=52428800, initial_limit=52428800
max_young_gen_size=50331648, young_gen_size=0, old_gen_size=51295872, total_size=51295872
Estimated available memory=9223372036745670656, estimated overhead=50331648
Start generating Heap.20221109.153556.1839204.1.001.heapsnapshot...
Invoked NearHeapLimitCallback, processing=true, current_limit=52428800, initial_limit=52428800
max_young_gen_size=50331648, young_gen_size=0, old_gen_size=51295872, total_size=51295872
Estimated available memory=9223372036745998336, estimated overhead=50331648
Not generating snapshots in nested callback. new_limit=102760448
1/1 snapshots taken.
Removing the near heap limit callbackWrote snapshot to /home/iojs/node-tmp/.tmp.1171/Heap.20221109.153556.1839204.1.001.heapsnapshot
<--- Last few GCs ...
| Reason | parallel/test-http2-misbehaving-multiplex |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/45353/, https://github.com/nodejs/node/pull/45125/) |
| Appeared | test-osuosl-rhel8-ppc64_le-2, test-osuosl-rhel8-ppc64_le-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/47759/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/47802/ |
Example
not ok 1672 parallel/test-http2-misbehaving-multiplex
---
duration_ms: 0.141
severity: fail
exitcode: 1
stack: |-
node:assert:124
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected "actual" to be strictly unequal to: 5
at Http2Server.<anonymous> (/home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/parallel/test-http2-misbehaving-multiplex.js:45:10)
at Http2Server.<anonymous> (/home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/common/index.js:448:15)
at Http2Server.emit (node:events:519:28)
at ServerHttp2Session.sessionOnStream (node:internal/http2/core:3006:19)
at ServerHttp2Session.emit (node:events:519:28)
at emit (node:internal/http2/core:330:3)
at process.processTicksAndRejections (node:internal/process/task_queues:85:22) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 5,
expected: 5,
operator: 'notStrictEq...
Progress
-
Backing channel 'JNLP4-connect connection from ... is disconnected.(2) -
Build timed out (after 60 minutes). Marking the build as failed.(2) -
error: ld returned 1 exit status(10) -
error: remote GitHub already exists.(9) -
fatal: invalid refspec '+refs/heads/:refs/remotes/jenkins_tmp'(6) -
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?(2) -
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?(2) -
error C1189: #error: cpu_features.c CPU feature detection in not defined for your platform [C:\workspace\node-compile-windows\node\deps\zlib\zlib.vcxproj](2) -
pummel/test-fs-readfile-tostring-fail(11) -
parallel/test-fs-readfile(9) -
parallel/test-fs-promises-file-handle-readFile(8) -
pummel/test-fs-largefile(8) -
parallel/test-fs-watch-recursive(5) -
addons/request-interrupt/test(4) -
parallel/test-inspector-multisession-ws(3) -
addons/report-fatalerror/test(2) -
node-api/test_fatal/test2(2) -
parallel/test-crypto-key-objects(2) -
parallel/test-heapsnapshot-near-heap-limit-by-api-in-worker(2) -
parallel/test-http2-misbehaving-multiplex(2)
- Dominant language
- Shell
- Stars
- 57
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from nodejs/reliability
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1666 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
nodejs/reliability#1665 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
nodejs/reliability#1664 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1663 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1662 ·
All issues in nodejs/reliability
Similar issues
-
out-of-date
Difficulty 1/5 Under an hour Newbie friendliness 82/100
CachyOS/CachyOS-PKGBUILDS#1894 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
community-scripts/ProxmoxVE#17396 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
mattpocock/skills#1099 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100