CI Reliability 2022-09-30
Open
Nobody has claimed this yet.
- Dominant language
- Shell
- Stars
- 57
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Description
Failures in node-test-pull-request/46850 to node-test-pull-request/46948 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)
| UTC Time | RUNNING | SUCCESS | UNSTABLE | ABORTED | FAILURE | Green Rate |
|---|---|---|---|---|---|---|
| 2022-09-30 00:25 | 0 | 12 | 22 | 2 | 64 | 12.24% |
Jenkins Failure
| Reason | Backing channel 'JNLP4-connect connection from ... is disconnected. |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 5 (https://github.com/nodejs/node/pull/44690/, https://github.com/nodejs/node/pull/44766/, https://github.com/nodejs/node/pull/44686/, https://github.com/nodejs/node/pull/44692/, https://github.com/nodejs/node/pull/44689/) |
| Appeared | test-digitalocean-freebsd12-x64-1, test-digitalocean-freebsd12-x64-2, test-nearform-macos10.15-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46884/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46918/ |
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 45.55.90.237/45.55.90.237:20885' is disconnected.
at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at jdk.proxy2/jdk.proxy2.$Proxy92.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
| Reason | Build timed out (after 60 minutes). Marking the build as failed. |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/44797/, https://github.com/nodejs/node/pull/44803/) |
| Appeared | test-rackspace-win2012r2_vs2019-x64-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46863/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46899/ |
Example
Build timed out (after 60 minutes). Marking the build as failed.
Git Failure
| Reason | ERROR: Error fetching remote repo 'jenkins_tmp' |
|---|---|
| Type | GIT_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/44689/, https://github.com/nodejs/node/pull/44731/) |
| Appeared | test-softlayer-rhel8_arm_cross_container-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46851/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46859/ |
Example
ERROR: Error fetching remote repo 'jenkins_tmp'
hudson.plugins.git.GitException: Failed to fetch from binary_tmp@147.75.72.255:binary_tmp.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:1003)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1244)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1308)
at hudson.scm.SCM.checkout(SCM.java:540)
Build Failure
Example
Failed to trigger node-test-commit
| Reason | error: remote GitHub already exists. |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/44767/, https://github.com/nodejs/node/pull/44741/, https://github.com/nodejs/node/pull/44561/, https://github.com/nodejs/node/pull/44746/) |
| Appeared | test-rackspace-win2012r2_vs2017-x64-1, test-rackspace-win2012r2_vs2019-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46886/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46925/ |
Example
error: remote GitHub already exists.
> git fetch --prune --no-tags GitHub
> git fetch --prune --no-tags https://github.com/nodejs/build.git +refs/heads/main:refs/remotes/jenkins_tmp
| Reason | Error: [WinError 5] Access is denied: 'C:\Users\Administrator\clcache\stats.txt.new' -> 'C:\Users\Administrator\clcache\stats.txt' |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/44767/, https://github.com/nodejs/node/pull/44677/, https://github.com/nodejs/node/pull/44692/) |
| Appeared | test-rackspace-win2012r2_vs2019-x64-2, test-rackspace-win2012r2_vs2019-x64-5 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46886/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46910/ |
Example
Error: [WinError 5] Access is denied: 'C:\\Users\\Administrator\\clcache\\stats.txt.new' -> 'C:\\Users\\Administrator\\clcache\\stats.txt'
[1228] Failed to execute script clcache_main
frames-tq.cc
finalization-registry-tq.cc
frame-arguments-tq.cc
C:\Program Files (x86)\Microsoft Visual Studio\2019\Community\MSBuild\Microsoft\VC\v160\Microsoft.CppCommon.targets(523,5): error MSB6006: "clcache_main.exe" exited with code -1. [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_base_without_compiler.vcxproj]
| Reason | ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/44746/, https://github.com/nodejs/node/pull/44731/) |
| Appeared | test-osuosl-aix72-ppc64_be-4, test-equinix-rhel8_container-arm64-1, test-equinix-ubuntu1804_container-arm64-2, test-equinix-ubuntu2004_container-arm64-2, test-equinix-ubuntu2004_container-armv7l-1, test-joyent-smartos20-x64-3, test-equinix-ubuntu1804_sharedlibs_container-arm64-3, test-equinix-ubuntu1804_sharedlibs_container-arm64-2, test-equinix-ubuntu1804_sharedlibs_container-arm64-6 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46932/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46936/ |
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Sending e-mails to: michael_dawson@ca.ibm.com vieuxtech@gmail.com ashley.cripps@ibm.com
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
JSTest Failure
| Reason | pummel/test-fs-largefile |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 6 (https://github.com/nodejs/node/pull/44693/, https://github.com/nodejs/node/pull/44799/, https://github.com/nodejs/node/pull/44697/, https://github.com/nodejs/node/pull/44675/, https://github.com/nodejs/node/pull/44766/, https://github.com/nodejs/node/pull/44767/) |
| Appeared | test-rackspace-win2012r2_vs2019-x64-4, test-nearform-macos10.15-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46869/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46907/ |
Example
not ok 843 pummel/test-fs-largefile
---
duration_ms: 0.943
severity: fail
exitcode: 1
stack: |-
Can't clean tmpdir: C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.844
Files blocking: [ 'large.txt' ]
node:internal/fs/utils:347
throw err;
^
Error: ENOSPC: no space left on device, ftruncate
at Object.ftruncateSync (node:fs:1126:3)
at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\pummel\test-fs-largefile.js:37:4)
at Module._compile (node:internal/modules/cjs/loader:1159:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1213:10)
at Module.load (node:internal/modules/cjs/loader:1037:32)
at Module._load (node:internal/modules/cjs/loader:878:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:86:12)
at node:internal/main/run_main_module:23:47 {
errno: -4055,
syscall: 'ftruncate',
code: 'ENOSPC'...
| Reason | sequential/test-watch-mode-inspect |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 6 (https://github.com/nodejs/node/pull/44693/, https://github.com/nodejs/node/pull/44771/, https://github.com/nodejs/node/pull/44711/, https://github.com/nodejs/node/pull/44798/, https://github.com/nodejs/node/pull/44796/, https://github.com/nodejs/node/pull/44686/) |
| Appeared | test-nearform-macos10.15-x64-1, test-orka-macos10.15-x64-1, test-nearform-macos10.15-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46850/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46938/ |
Example
not ok 3791 sequential/test-watch-mode-inspect
---
duration_ms: 120.147
severity: fail
exitcode: -15
stack: |-
timeout
TAP version 13
(node:61962) ExperimentalWarning: The test runner is an experimental feature. This feature could change at any time
(Use `node --trace-warnings ...` to show where the warning was created)
...
| Reason | parallel/test-worker-heap-snapshot |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 5 (https://github.com/nodejs/node/pull/44796/, https://github.com/nodejs/node/pull/44767/, https://github.com/nodejs/node/pull/44695/, https://github.com/nodejs/node/pull/44809/, https://github.com/nodejs/node/pull/44815/) |
| Appeared | test-rackspace-win2012r2_vs2013-x64-1, test-rackspace-win2012r2_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-6, test-rackspace-win2012r2_vs2017-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46889/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46930/ |
Example
not ok 803 parallel/test-worker-heap-snapshot
---
duration_ms: 1.360
severity: fail
exitcode: 134
stack: |-
FATAL ERROR: HandleScope::HandleScope Entering the V8 API without proper locking in place
...
| Reason | sequential/test-http-regr-gh-2928 |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/44809/, https://github.com/nodejs/node/pull/44796/, https://github.com/nodejs/node/pull/44692/) |
| Appeared | test-digitalocean-freebsd12-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46912/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46939/ |
Example
not ok 3714 sequential/test-http-regr-gh-2928
---
duration_ms: 120.87
severity: fail
exitcode: -15
stack: |-
timeout
.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.
...
| Reason | sequential/test-worker-prof |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/44766/, https://github.com/nodejs/node/pull/44690/, https://github.com/nodejs/node/pull/44686/) |
| Appeared | test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win10_vs2019-x64-3, test-azure_msft-win10_vs2019-x64-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46885/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46943/ |
Example
not ok 898 sequential/test-worker-prof
---
duration_ms: 30.304
severity: fail
exitcode: 1
stack: |-
node:assert:124
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: child exited with signal: {
error: Error: spawnSync C:\workspace\node-test-binary-windows-js-suites\node\Release\node.exe ETIMEDOUT
at Object.spawnSync (node:internal/child_process:1117:20)
at spawnSync (node:child_process:857:24)
at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\sequential\test-worker-prof.js:53:23)
at Module._compile (node:internal/modules/cjs/loader:1159:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1213:10)
at Module.load (node:internal/modules/cjs/loader:1037:32)
at Module._load (node:internal/modules/cjs/loader:878:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:86:12)
at node:internal/main/run_mai...
| Reason | abort/test-addon-uv-handle-leak |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/44766/, https://github.com/nodejs/node/pull/44677/) |
| Appeared | test-joyent-smartos20-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46885/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46898/ |
Example
not ok 3630 abort/test-addon-uv-handle-leak
---
duration_ms: 300.129
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | addons/request-interrupt/test |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/44815/, https://github.com/nodejs/node/pull/44813/) |
| Appeared | test-joyent-smartos20-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46934/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46948/ |
Example
not ok 3460 addons/request-interrupt/test
---
duration_ms: 300.67
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-fs-promises-file-handle-readFile |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/44731/, https://github.com/nodejs/node/pull/44498/) |
| Appeared | test-rackspace-win2012r2_vs2019-x64-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46859/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46860/ |
Example
not ok 251 parallel/test-fs-promises-file-handle-readFile
---
duration_ms: 0.313
severity: fail
exitcode: 1
stack: |-
node:internal/process/promises:288
triggerUncaughtException(err, true /* fromPromise */);
^
[Error: ENOSPC: no space left on device, ftruncate] {
errno: -4055,
code: 'ENOSPC',
syscall: 'ftruncate'
}
Node.js v19.0.0-pre
...
| Reason | parallel/test-tls-hello-parser-failure |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/44741/, https://github.com/nodejs/node/pull/44686/) |
| Appeared | test-rackspace-win2012r2_vs2017-x64-3, test-osuosl-rhel8-ppc64_le-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46887/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46943/ |
Example
not ok 699 parallel/test-tls-hello-parser-failure
---
duration_ms: 0.312
severity: fail
exitcode: 1
stack: |-
node:assert:124
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
false !== true
at Socket.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-tls-hello-parser-failure.js:64:12)
at Socket.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:446:15)
at Socket.emit (node:events:513:28)
at TCP.<anonymous> (node:net:298:12) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: false,
expected: true,
operator: 'strictEqual'
}
Node.js v19.0.0-pre
...
| Reason | report/test-report-fatalerror-oomerror-not-set |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/44809/, https://github.com/nodejs/node/pull/44741/) |
| Appeared | test-joyent-smartos20-x64-4, test-joyent-smartos20-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/46912/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/46931/ |
Example
not ok 147 report/test-report-fatalerror-oomerror-not-set
---
duration_ms: 300.117
severity: fail
exitcode: -15
stack: |-
timeout
...
Progress
-
Backing channel 'JNLP4-connect connection from ... is disconnected.(5) -
Build timed out (after 60 minutes). Marking the build as failed.(2) -
ERROR: Error fetching remote repo 'jenkins_tmp'(2) -
Failed to trigger node-test-commit(8) -
error: remote GitHub already exists.(4) -
Error: [WinError 5] Access is denied: 'C:\\Users\\Administrator\\clcache\\stats.txt.new' -> 'C:\\Users\\Administrator\\clcache\\stats.txt'(3) -
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?(2) -
pummel/test-fs-largefile(6) -
sequential/test-watch-mode-inspect(6) -
parallel/test-worker-heap-snapshot(5) -
sequential/test-http-regr-gh-2928(3) -
sequential/test-worker-prof(3) -
abort/test-addon-uv-handle-leak(2) -
addons/request-interrupt/test(2) -
parallel/test-fs-promises-file-handle-readFile(2) -
parallel/test-tls-hello-parser-failure(2) -
report/test-report-fatalerror-oomerror-not-set(2)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the linked Jenkins job pages and their console-log examples, comparing the recurring failures across affected nodes and pull requests. The issue names no source files or tests to edit; done would require identifying and addressing the reported CI reliability failures across the listed Jenkins, Git, build, and JavaScript test categories.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- git, github, node.js, shell
- Domain
- ci-cd, devops, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100