CI Reliability 2022-06-04
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 25/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- node.js, shell
- Domain
- ci-cd, devops, testing-qa
Research direction
Start with the linked CI jobs and the listed failing tests, including test/node-api/test_buffer/test_finalizer.js and the parallel test paths. Reproduce the failures across the affected platforms and inspect their CI logs. Done means the reported reliability failures have confirmed resolutions and the relevant CI runs pass consistently.
Written by the indexing model from the issue text.
Description
Failures in node-test-pull-request/44247 to node-test-pull-request/44345 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)
| UTC Time | RUNNING | SUCCESS | UNSTABLE | ABORTED | FAILURE | Green Rate |
|---|---|---|---|---|---|---|
| 2022-06-04 00:14 | 0 | 12 | 11 | 13 | 64 | 13.79% |
JSTest Failure
Example
not ok 3464 node-api/test_buffer/test_finalizer
---
duration_ms: 0.219
severity: fail
exitcode: 1
stack: |-
Mismatched <anonymous> function calls. Expected exactly 1, actual 0.
at Proxy.mustCall (/home/iojs/build/workspace/node-test-commit-aix/nodes/aix72-ppc64/test/common/index.js:396:10)
at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-aix/nodes/aix72-ppc64/test/node-api/test_buffer/test_finalizer.js:9:40)
at Module._compile (node:internal/modules/cjs/loader:1108:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1162:10)
at Module.load (node:internal/modules/cjs/loader:984:32)
at Module._load (node:internal/modules/cjs/loader:830:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12)
at node:internal/main/run_main_module:17:47
Mismatched <anonymous> function calls. Expected exactly 1, actual 0.
at Proxy.mustCall (/home/iojs/build/workspace/node-test-com...
Example
not ok 1175 parallel/test-http-server-request-timeouts-mixed
---
duration_ms: 3.465
severity: fail
exitcode: 1
stack: |-
node:assert:399
throw err;
^
AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
assert(request2.completed)
at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/parallel/test-http-server-request-timeouts-mixed.js:106:5)
at listOnTimeout (node:internal/timers:564:17)
at process.processTimers (node:internal/timers:507:7) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: false,
expected: true,
operator: '=='
}
Node.js v19.0.0-pre
...
Example
not ok 772 parallel/test-worker-http2-stream-terminate
---
duration_ms: 2.977
severity: crashed
exitcode: 3221225477
stack: |-
Error: async hook stack has become corrupted (actual: 5, expected: 2194)
...
| Reason | parallel/test-gc-http-client-timeout |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/43266/, https://github.com/nodejs/node/pull/43159/, https://github.com/nodejs/node/pull/43116/, https://github.com/nodejs/node/pull/43151/) |
| Appeared | test-nearform-macos11.0-arm64-1, test-digitalocean-freebsd12-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44262/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44333/ |
Example
not ok 888 parallel/test-gc-http-client-timeout
---
duration_ms: 0.397
severity: fail
exitcode: 1
stack: |-
done/collected/total: 3/0/413
done/collected/total: 46/0/413
done/collected/total: 136/0/413
node:events:505
throw er; // Unhandled 'error' event
^
Error: connect ECONNRESET ::1:54455
at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1229:16)
Emitted 'error' event on ClientRequest instance at:
at Socket.socketErrorListener (node:_http_client:462:9)
at Socket.emit (node:events:527:28)
at emitErrorNT (node:internal/streams/destroy:151:8)
at emitErrorCloseNT (node:internal/streams/destroy:116:3)
at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
errno: -54,
code: 'ECONNRESET',
syscall: 'connect',
address: '::1',
port: 54455
}
Node.js v19.0.0-pre
...
| Reason | parallel/test-worker-heap-snapshot |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/43199/, https://github.com/nodejs/node/pull/43116/, https://github.com/nodejs/node/pull/43261/, https://github.com/nodejs/node/pull/43270/) |
| Appeared | test-rackspace-win2012r2_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-5, test-rackspace-win2012r2_vs2019-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44257/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44305/ |
Example
not ok 783 parallel/test-worker-heap-snapshot
---
duration_ms: 1.590
severity: fail
exitcode: 134
stack: |-
FATAL ERROR: HandleScope::HandleScope Entering the V8 API without proper locking in place
...
| Reason | parallel/test-http-server-close-all |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/43206/, https://github.com/nodejs/node/pull/43116/, https://github.com/nodejs/node/pull/43164/) |
| Appeared | test-digitalocean-fedora32-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-8, test-digitalocean-ubuntu1804-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44271/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44324/ |
Example
not ok 1315 parallel/test-http-server-close-all
---
duration_ms: 0.173
severity: fail
exitcode: 1
stack: |-
node:assert:123
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
1 !== 2
at Socket.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-http-server-close-all.js:44:14)
at Socket.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux/test/common/index.js:438:15)
at Socket.emit (node:events:527:28)
at addChunk (node:internal/streams/readable:324:12)
at readableAddChunk (node:internal/streams/readable:297:9)
at Readable.push (node:internal/streams/readable:234:10)
at TCP.onStreamRead (node:internal/stream_base_commons:190:23) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 1,
expected: 2,
operator: 'strictEqual'
}
Node.js v19.0.0-pre
...
| Reason | parallel/test-runner-cli |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/43206/, https://github.com/nodejs/node/pull/43217/, https://github.com/nodejs/node/pull/43266/) |
| Appeared | test-nearform-macos10.15-x64-3, test-nearform-macos10.15-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44271/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44307/ |
Example
not ok 2046 parallel/test-runner-cli
---
duration_ms: 0.794
severity: fail
exitcode: 1
stack: |-
node:assert:1026
throw err;
^
AssertionError [ERR_ASSERTION]: The input did not match the regular expression /not ok 1 - this should fail/. Input:
'TAP version 13\n' +
'not ok 1 - /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/fixtures/test-runner/index.js\n' +
' ---\n' +
' duration_ms: 0.074052437\n' +
" failureType: 'subtestsFailed'\n" +
' exitCode: 1\n' +
" stdout: ''\n" +
' stderr: |-\n' +
' /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/fixtures/test-runner/index.js:2\n' +
" throw new Error('thrown from index.js');\n" +
' ^\n' +
' \n' +
' Error: thrown from index.js\n' +
' at Object.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/fixtures/test-runner/index.js:2:7)\n' +
' ...
| Reason | abort/test-process-abort-exitcode |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/43256/, https://github.com/nodejs/node/pull/43206/) |
| Appeared | test-joyent-smartos20-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44247/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44297/ |
Example
not ok 3522 abort/test-process-abort-exitcode
---
duration_ms: 120.150
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | abort/test-signal-handler |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/43256/, https://github.com/nodejs/node/pull/43217/) |
| Appeared | test-joyent-smartos20-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44247/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44335/ |
Example
not ok 3523 abort/test-signal-handler
---
duration_ms: 120.152
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | node-api/test_fatal/test2 |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/43272/, https://github.com/nodejs/node/pull/43217/) |
| Appeared | test-joyent-smartos20-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44292/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44295/ |
Example
not ok 3461 node-api/test_fatal/test2
---
duration_ms: 120.185
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | node-api/test_fatal/test_threads |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/43272/, https://github.com/nodejs/node/pull/43217/) |
| Appeared | test-joyent-smartos20-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44292/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44295/ |
Example
not ok 3465 node-api/test_fatal/test_threads
---
duration_ms: 120.249
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-https-server-close-idle |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/43217/, https://github.com/nodejs/node/pull/43216/) |
| Appeared | test-nearform-macos10.15-x64-3, test-orka-macos11-x64-2, test-macstadium-macos11.0-arm64-3, test-rackspace-win2012r2_vs2019-x64-5, test-ibm-rhel8-s390x-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44260/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44284/ |
Example
not ok 1507 parallel/test-https-server-close-idle
---
duration_ms: 0.185
severity: fail
exitcode: 1
stack: |-
node:assert:123
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
0 !== 1
at TLSSocket.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/parallel/test-https-server-close-idle.js:43:12)
at TLSSocket.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/common/index.js:438:15)
at TLSSocket.emit (node:events:539:35)
at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1215:10) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 0,
expected: 1,
operator: 'strictEqual'
}
Node.js v19.0.0-pre
...
| Reason | parallel/test-net-connect-memleak |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/43199/, https://github.com/nodejs/node/pull/43216/) |
| Appeared | test-rackspace-win2012r2_vs2019-x64-5 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44257/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44284/ |
Example
not ok 473 parallel/test-net-connect-memleak
---
duration_ms: 0.260
severity: fail
exitcode: 1
stack: |-
Mismatched noop function calls. Expected exactly 1, actual 0.
at Proxy.mustCall (C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:396:10)
at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-net-connect-memleak.js:33:40)
at Module._compile (node:internal/modules/cjs/loader:1105:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1159:10)
at Module.load (node:internal/modules/cjs/loader:981:32)
at Module._load (node:internal/modules/cjs/loader:827:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12)
at node:internal/main/run_main_module:17:47
...
Example
not ok 1787 parallel/test-perf-hooks-histogram
---
duration_ms: 0.477
severity: fail
exitcode: 1
stack: |-
node:internal/event_target:911
process.nextTick(() => { throw err; });
^
AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
ok(data.count > 0)
at MessagePort.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/parallel/test-perf-hooks-histogram.js:87:5)
at MessagePort.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/common/index.js:438:15)
at MessagePort.eventHandler (node:internal/event_target:921:12)
at [nodejs.internal.kHybridDispatch] (node:internal/event_target:641:20)
at exports.emitMessage (node:internal/per_context/messageport:23:28) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: false,
expected: true,
operator: '=='
}
Node.js v19.0.0-pre
.....
| Reason | parallel/test-trace-events-fs-sync |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/42788/, https://github.com/nodejs/node/pull/43116/) |
| Appeared | test-azure_msft-win10_vs2019-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44253/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44336/ |
Example
not ok 704 parallel/test-trace-events-fs-sync
---
duration_ms: 2.43
severity: fail
exitcode: 1
stack: |-
C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-trace-events-fs-sync.js:133
throw new Error(`${tr}:\n${util.inspect(proc)}`);
^
Error: fs.sync.fstat:
{
status: 1,
signal: null,
output: [
null,
'',
'node:internal/fs/utils:345\r\n' +
' throw err;\r\n' +
' ^\r\n' +
'\r\n' +
"Error: EPERM: operation not permitted, open 'fs.txt'\r\n" +
' at Object.openSync (node:fs:592:3)\r\n' +
' at Object.writeFileSync (node:fs:2214:35)\r\n' +
' at [eval]:1:4\r\n' +
' at Script.runInThisContext (node:vm:129:12)\r\n' +
' at Object.runInThisContext (node:vm:305:38)\r\n' +
' at node:internal/process/execution:76:19\r\n' +
' at [eval]-wrapper:6:22\r\n' +
' at evalScript (node...
| Reason | sequential/test-net-connect-local-error |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/43206/, https://github.com/nodejs/node/pull/43217/) |
| Appeared | test-digitalocean-freebsd12-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44319/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44335/ |
Example
not ok 3648 sequential/test-net-connect-local-error
---
duration_ms: 0.153
severity: fail
exitcode: 1
stack: |-
node:assert:123
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
+ actual - expected
+ undefined
- 12347
at onError (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/sequential/test-net-connect-local-error.js:28:10)
at Socket.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/sequential/test-net-connect-local-error.js:38:49)
at Socket.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/common/index.js:438:15)
at Socket.emit (node:events:534:28)
at emitErrorNT (node:internal/streams/destroy:151:8)
at emitErrorCloseNT (node:internal/streams/destroy:116:3)
at process.processTicksAndRejections (node:internal/process/task_queues:8...
Jenkins Failure
| Reason | Build timed out (after 60 minutes). Marking the build as failed. |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/43256/, https://github.com/nodejs/node/pull/42714/, https://github.com/nodejs/node/pull/43164/) |
| Appeared | test-softlayer-ubi81_container-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44274/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44324/ |
Example
Build timed out (after 60 minutes). Marking the build as failed.
| Reason | Backing channel 'JNLP4-connect connection from ... is disconnected. |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/43272/, https://github.com/nodejs/node/pull/43206/) |
| Appeared | test-ibm-rhel8-s390x-4, test-equinix-ubuntu2004_container-armv7l-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44292/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44297/ |
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 148.100.84.239/148.100.84.239:35120' is disconnected.
at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
at com.sun.proxy.$Proxy79.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1213)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1205)
Build Failure
| Reason | ERROR: Step ?Publish JUnit test result report? failed: no workspace for ... |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/43254/, https://github.com/nodejs/node/pull/43256/, https://github.com/nodejs/node/pull/43225/) |
| Appeared | test-equinix-ubuntu2004_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44265/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44326/ |
Example
ERROR: Step ?Publish JUnit test result report? failed: no workspace for node-test-commit-arm/nodes=ubuntu2004-armv7l #42069
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
| Reason | fatal error: ld terminated with signal 9 [Killed] |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/43256/, https://github.com/nodejs/node/pull/43270/, https://github.com/nodejs/node/pull/43293/) |
| Appeared | test-digitalocean-ubuntu1804_sharedlibs_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-8 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/44279/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/44329/ |
Example
fatal error: ld terminated with signal 9 [Killed]
undefined
Example
Unknown
Progress
-
node-api/test_buffer/test_finalizer(15) -
parallel/test-http-server-request-timeouts-mixed(10) -
parallel/test-worker-http2-stream-terminate(7) -
parallel/test-gc-http-client-timeout(4) -
parallel/test-worker-heap-snapshot(4) -
parallel/test-http-server-close-all(3) -
parallel/test-runner-cli(3) -
abort/test-process-abort-exitcode(2) -
abort/test-signal-handler(2) -
node-api/test_fatal/test2(2) -
node-api/test_fatal/test_threads(2) -
parallel/test-https-server-close-idle(2) -
parallel/test-net-connect-memleak(2) -
parallel/test-perf-hooks-histogram(2) -
parallel/test-trace-events-fs-sync(2) -
sequential/test-net-connect-local-error(2) -
Build timed out (after 60 minutes). Marking the build as failed.(3) -
Backing channel 'JNLP4-connect connection from ... is disconnected.(2) -
ERROR: Step ?Publish JUnit test result report? failed: no workspace for ...(3) -
fatal error: ld terminated with signal 9 [Killed](3) -
Unknown(11)
- Dominant language
- Shell
- Stars
- 57
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from nodejs/reliability
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1666 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
nodejs/reliability#1665 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
nodejs/reliability#1664 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1663 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1662 ·
All issues in nodejs/reliability
Similar issues
-
Update Vish to 1.1.5 Openpackage-update
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
oSoWoSo/vOid_Community_repOsitory#144 · 1 comment ·
-
help wanted new command
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
tldr-pages/tldr#24151 ·
-
PacReq: Rune IDE Openpackage request
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
pacstall/pacstall-programs#9402 ·
-
[BUG] ci: the first prefetch-images.sh call runs before shard.txt exists, so it is always a no-op Openbug github-actions
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
update-request
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
msys2/MINGW-packages#31768 ·