CI Reliability 2021-12-24
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 15/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- shell
- Domain
- ci-cd, devops, testing-qa
Research direction
Start with the generated ncu-ci walk pr --stats=true --markdown report and review the linked Jenkins builds, including the parallel/test-repl-sigint-nested-eval failure. Done would require identifying actionable causes for the reported CI failure classes and verifying the affected CI jobs no longer fail.
Written by the indexing model from the issue text.
Description
Failures in node-test-pull-request/41540 to node-test-pull-request/41636 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)
| UTC Time | RUNNING | SUCCESS | UNSTABLE | ABORTED | FAILURE | Green Rate |
|---|---|---|---|---|---|---|
| 2021-12-24 00:02 | 1 | 13 | 18 | 9 | 59 | 14.44% |
Jenkins Failure
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 139.178.85.13/139.178.85.13:53506' is disconnected.
at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
at com.sun.proxy.$Proxy82.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1213)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1205)
| Reason | Build timed out (after 60 minutes). Marking the build as failed. |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/41236/, https://github.com/nodejs/node/pull/41246/, https://github.com/nodejs/node/pull/40532/, https://github.com/nodejs/node/pull/41291/) |
| Appeared | test-softlayer-ubi81_container-x64-1, test-digitalocean-ubi81_container-x64-2, test-osuosl-centos7-ppc64_le-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/41542/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/41622/ |
Example
Build timed out (after 60 minutes). Marking the build as failed.
Build Failure
Example
fatal error: ld terminated with signal 9 [Killed]
| Reason | ERROR: Step ?Publish JUnit test result report? failed: no workspace for ... |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/41221/, https://github.com/nodejs/node/pull/41202/, https://github.com/nodejs/node/pull/41253/, https://github.com/nodejs/node/pull/41263/) |
| Appeared | test-equinix-ubuntu1804_container-arm64-2, test-osuosl-aix72-ppc64_be-4, test-osuosl-aix72-ppc64_be-2, test-equinix-ubuntu2004_container-armv7l-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/41558/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/41630/ |
Example
ERROR: Step ?Publish JUnit test result report? failed: no workspace for node-test-commit-arm/nodes=ubuntu1804-arm64 #40052
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
| Reason | Failed to trigger node-test-commit |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/41575/, ) |
| Appeared | test-packetnet-ubuntu1804-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/41588/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/41628/ |
Example
Failed to trigger node-test-commit
undefined
Example
Unknown
JSTest Failure
Example
not ok 2184 parallel/test-repl-sigint-nested-eval
---
duration_ms: 0.539
severity: fail
exitcode: 1
stack: |-
Stacktrace:
ptr1=0x178a08f01d49
ptr2=(nil)
ptr3=(nil)
ptr4=(nil)
failure_message_object=0x7ffff8edb2b0
==== JS stack trace =========================================
0: ExitFrame [pc: 0x55e8894e73f9]
1: StubFrame [pc: 0x55e88957145d]
Security context: 0x32eb29db3be1 <JSGlobalObject>
2: _fatalException [0x32eb29d89159] [node:internal/process/execution:145] [bytecode=0x16c7878a2721 offset=13](this=0x32eb29d82709 <process map = 0x196788d81479>,0x178a08f01d49 <Odd Oddball: termination_exception>,0x178a08f01769 <false>)
3: InternalFrame [pc: 0x55e88947465b]
4: EntryFrame [pc: 0x55e889474383]
5: builtin exit frame: evaluate(this=0x161e859a16c9 <ModuleWrap map = 0x19af5bf8b631>,0x161e859a16c9 <ModuleWrap map = 0x19af5bf8b631>,-1,0x178a08f01769 <false>)
6: getESMFacade [0x3445e35d...
Example
not ok 261 parallel/test-fs-rmdir-recursive
---
duration_ms: 0.834
severity: fail
exitcode: 1
stack: |-
(node:13556) [DEP0147] DeprecationWarning: In future versions of Node.js, fs.rmdir(path, { recursive: true }) will be removed. Use fs.rm(path, { recursive: true }) instead
(Use `node --trace-deprecation ...` to show where the warning was created)
Can't clean tmpdir: C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.259
Files blocking: [ 'rmdir-recursive-0', 'rmdir-recursive-5' ]
node:assert:991
throw newErr;
^
AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOTEMPTY: directory not empty, rmdir 'C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.259\rmdir-recursive-0\d-3-1'
at C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:364:12
at C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:401:15
at node:fs:188:23
at CB (node:internal...
| Reason | sequential/test-performance-eventloopdelay |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 6 (https://github.com/nodejs/node/pull/41185/, https://github.com/nodejs/node/pull/41240/, https://github.com/nodejs/node/pull/41203/, https://github.com/nodejs/node/pull/41279/, https://github.com/nodejs/node/pull/41221/, https://github.com/nodejs/node/pull/41280/) |
| Appeared | test-ibm-rhel7-s390x-4, test-ibm-rhel7-s390x-1, test-ibm-rhel7-s390x-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/41581/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/41634/ |
Example
not ok 3532 sequential/test-performance-eventloopdelay
---
duration_ms: 7.218
severity: fail
exitcode: 1
stack: |-
node:assert:399
throw err;
^
AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
assert(histogram.min > 0)
at Timeout.spinAWhile [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-linuxone/test/sequential/test-performance-eventloopdelay.js:65:7)
at listOnTimeout (node:internal/timers:568:17)
at processTimers (node:internal/timers:510:7) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: false,
expected: true,
operator: '=='
}
Node.js v18.0.0-pre
...
Example
not ok 854 wpt/test-user-timing
---
duration_ms: 9.510
severity: fail
exitcode: 1
stack: |-
---- idlharness.any.js ----
[SKIPPED] idlharness cannot recognize Node.js environment
---- invoke_with_timing_attributes.worker.js ----
[SKIPPED] importScripts not supported
---- performance-measure-invalid.worker.js ----
[SKIPPED] importScripts not supported
---- buffered-flag.any.js ----
[PASS] PerformanceObserver with buffered flag sees previous marks
---- buffered-flag.any.js ----
[PASS] PerformanceObserver with buffered flag sees previous measures
---- case-sensitivity.any.js ----
[PASS] getEntriesByType values are case sensitive
---- clear_all_marks.any.js ----
[PASS] Clearing all marks remove all of them.
---- clear_one_mark.any.js ----
[PASS] Clearing an existent mark doesn't affect other existing marks
---- clear_non_existent_mark.any.js ----
[PASS] Clearing a non-existent mark doesn't affect existing marks
---- entry_type.an...
Example
not ok 257 parallel/test-fs-rm
---
duration_ms: 0.550
severity: fail
exitcode: 1
stack: |-
node:internal/fs/rimraf:202
throw err;
^
Error: ENOTEMPTY: directory not empty, rmdir '\\?\C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.255\rm-4\d-3-1'
at Object.rmdirSync (node:fs:1167:10)
at _rmdirSync (node:internal/fs/rimraf:260:21)
at rimrafSync (node:internal/fs/rimraf:193:7)
at node:internal/fs/rimraf:253:9
at Array.forEach (<anonymous>)
at _rmdirSync (node:internal/fs/rimraf:250:7)
at rimrafSync (node:internal/fs/rimraf:193:7)
at Object.rmSync (node:fs:1216:10)
at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-fs-rm.js:176:6)
at Module._compile (node:internal/modules/cjs/loader:1097:14) {
errno: -4051,
syscall: 'rmdir',
code: 'ENOTEMPTY',
path: '\\\\?\\C:\\workspace\\node-test-binary-windows-js-suites\\nod...
| Reason | parallel/test-trace-events-fs-sync |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/41240/, https://github.com/nodejs/node/pull/41203/, https://github.com/nodejs/node/pull/41276/, https://github.com/nodejs/node/pull/41302/) |
| Appeared | test-azure_msft-win10_vcbt2015-x64-4, test-azure_msft-win10_vs2019-x64-1, test-azure_msft-win10_vcbt2015-x64-2, test-azure_msft-win10_vs2019-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/41594/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/41629/ |
Example
not ok 699 parallel/test-trace-events-fs-sync
---
duration_ms: 3.913
severity: fail
exitcode: 1
stack: |-
Can't clean tmpdir: C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.681
Files blocking: [ 'fs.txt', 'node_trace.1.log' ]
C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-trace-events-fs-sync.js:133
throw new Error(`${tr}:\n${util.inspect(proc)}`);
^
Error: fs.sync.ftruncate:
{
status: 1,
signal: null,
output: [
null,
'',
'node:internal/fs/utils:344\r\n' +
' throw err;\r\n' +
' ^\r\n' +
'\r\n' +
"Error: EPERM: operation not permitted, open 'fs.txt'\r\n" +
' at Object.openSync (node:fs:585:3)\r\n' +
' at Object.writeFileSync (node:fs:2155:35)\r\n' +
' at [eval]:1:4\r\n' +
' at Script.runInThisContext (node:vm:129:12)\r\n' +
' at Object.runInThisContext (node:vm:305...
| Reason | parallel/test-crypto-binary-default |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/40901/, https://github.com/nodejs/node/pull/41240/, https://github.com/nodejs/node/pull/41290/) |
| Appeared | test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-requireio_rvagg-debian10-armv7l_pi2-1, test-requireio_davglass-debian10-arm64_pi3-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/41564/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/41635/ |
Example
not ok 209 parallel/test-crypto-binary-default
---
duration_ms: 240.136
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-crypto-dh-leak |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/41253/, https://github.com/nodejs/node/pull/41218/, https://github.com/nodejs/node/pull/41271/) |
| Appeared | test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-requireio_securogroup-debian10-arm64_pi3-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/41575/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/41620/ |
Example
not ok 218 parallel/test-crypto-dh-leak
---
duration_ms: 240.137
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | sequential/test-net-connect-econnrefused |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/39392/, https://github.com/nodejs/node/pull/41245/, https://github.com/nodejs/node/pull/41185/) |
| Appeared | test-ibm-rhel7-s390x-3, test-softlayer-centos7-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/41550/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/41574/ |
Example
not ok 3520 sequential/test-net-connect-econnrefused
---
duration_ms: 120.6
severity: fail
exitcode: -15
stack: |-
timeout
pending 50 rounds 1
pending 49 rounds 1
pending 48 rounds 1
pending 47 rounds 1
pending 46 rounds 1
pending 45 rounds 1
pending 44 rounds 1
pending 43 rounds 1
pending 42 rounds 1
pending 41 rounds 1
pending 40 rounds 1
pending 39 rounds 1
pending 38 rounds 1
pending 37 rounds 1
pending 36 rounds 1
pending 35 rounds 1
pending 34 rounds 1
pending 33 rounds 1
pending 32 rounds 1
pending 31 rounds 1
pending 30 rounds 1
pending 29 rounds 1
pending 28 rounds 1
pending 27 rounds 1
pending 26 rounds 1
pending 25 rounds 1
pending 24 rounds 1
pending 23 rounds 1
pending 22 rounds 1
pending 21 rounds 1
pending 20 rounds 1
pending 19 rounds 1
pending 18 rounds 1
pending 17 rounds 1
pending 16 rounds 1
pending 15 rounds 1
pending 14 rounds 1...
| Reason | parallel/test-crypto-dh |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/41279/, https://github.com/nodejs/node/pull/41302/) |
| Appeared | test-requireio_mininodes-debian10-armv7l_pi2-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/41613/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/41629/ |
Example
not ok 188 parallel/test-crypto-dh
---
duration_ms: 240.146
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-crypto-dh-odd-key |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/39239/, https://github.com/nodejs/node/pull/41302/) |
| Appeared | test-requireio_mcollina-debian10-armv7l_pi2-1, test-requireio_mininodes-debian10-armv7l_pi2-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/41548/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/41632/ |
Example
not ok 241 parallel/test-crypto-dh-odd-key
---
duration_ms: 240.79
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-crypto-keygen |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/41198/, https://github.com/nodejs/node/pull/41203/) |
| Appeared | test-rackspace-win2012r2_vs2019-x64-5, test-rackspace-win2012r2_vs2015-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/41544/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/41614/ |
Example
not ok 815 parallel/test-crypto-keygen
---
duration_ms: 120.123
severity: fail
exitcode: 1
stack: |-
timeout
...
Progress
-
Backing channel 'JNLP4-connect connection from ... is disconnected.(12) -
Build timed out (after 60 minutes). Marking the build as failed.(4) -
fatal error: ld terminated with signal 9 [Killed](14) -
ERROR: Step ?Publish JUnit test result report? failed: no workspace for ...(4) -
Failed to trigger node-test-commit(2) -
Unknown(16) -
parallel/test-repl-sigint-nested-eval(11) -
parallel/test-fs-rmdir-recursive(7) -
sequential/test-performance-eventloopdelay(6) -
wpt/test-user-timing(6) -
parallel/test-fs-rm(5) -
parallel/test-trace-events-fs-sync(4) -
parallel/test-crypto-binary-default(3) -
parallel/test-crypto-dh-leak(3) -
sequential/test-net-connect-econnrefused(3) -
parallel/test-crypto-dh(2) -
parallel/test-crypto-dh-odd-key(2) -
parallel/test-crypto-keygen(2)
- Dominant language
- Shell
- Stars
- 57
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from nodejs/reliability
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1666 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
nodejs/reliability#1665 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
nodejs/reliability#1664 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1663 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1662 ·
All issues in nodejs/reliability
Similar issues
-
out-of-date
Difficulty 1/5 Under an hour Newbie friendliness 82/100
CachyOS/CachyOS-PKGBUILDS#1894 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
community-scripts/ProxmoxVE#17396 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
mattpocock/skills#1099 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100