CI Reliability 2021-11-04
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 20/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- javascript, node.js, shell
- Domain
- ci-cd, devops, testing-qa
Research direction
Start with the CI logs linked in the issue and compare the failures for sequential/test-debugger-heap-profiler, pummel/test-fs-watch-non-recursive, and parallel/test-datetime-change-notify. Read the referenced test files and their stack traces, then verify the relevant tests across the listed platforms. Done means the recurring CI failures are understood and the affected jobs no longer fail unexpectedly.
Written by the indexing model from the issue text.
Description
Failures in node-test-pull-request/40595 to node-test-pull-request/40693 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)
| UTC Time | RUNNING | SUCCESS | UNSTABLE | ABORTED | FAILURE | Green Rate |
|---|---|---|---|---|---|---|
| 2021-11-04 00:03 | 1 | 3 | 5 | 6 | 85 | 3.23% |
JSTest Failure
Example
not ok 3425 sequential/test-debugger-heap-profiler
---
duration_ms: 18.352
severity: fail
exitcode: 1
stack: |-
/home/iojs/build/workspace/node-test-commit-linux/test/common/debugger.js:84
reject(new Error([
^
Error: Timeout (5000) while waiting for />\s+$/; found: Heap snapshot: 0/0
Heap snapshot: 0/34521
Heap snapshot: 10000/34521
Heap snapshot: 20000/34521
Heap snapshot: 30000/34521
Heap snapshot: 34520/34521
Heap snapshot: 34521/34521
Heap snaphost prepared.
Writing snapshot: 102400
Writing snapshot: 204800
Writing snapshot: 307200
Writing snapshot: 409600
Writing snapshot: 512000
Writing snapshot: 614400
Writing snapshot: 716800
Writing snapshot: 819200
Writing snapshot: 921600
Writing snapshot: 1024000
Writing snapshot: 1126400
Writing snapshot: 1228800
Writing snapshot: 1331200
Writing snapshot: 1433600
Writing snapshot: 153...
Example
not ok 789 pummel/test-fs-watch-non-recursive
---
duration_ms: 3.113
severity: fail
exitcode: 1
stack: |-
node:assert:171
throw err;
^
AssertionError [ERR_ASSERTION]: function should not have been called at C:\workspace\node-test-binary-windows-js-suites\node\test\pummel\test-fs-watch-non-recursive.js:43
called with arguments: 'change', 'testsubdir'
at FSWatcher.mustNotCall (C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:479:12)
at FSWatcher.emit (node:events:390:28)
at FSEvent.FSWatcher._handle.onchange (node:internal/fs/watchers:212:12) {
generatedMessage: false,
code: 'ERR_ASSERTION',
actual: undefined,
expected: undefined,
operator: 'fail'
}
Node.js v18.0.0-pre
...
Example
not ok 157 parallel/test-datetime-change-notify
---
duration_ms: 1.671
severity: fail
exitcode: 1
stack: |-
node:assert:1021
throw err;
^
AssertionError [ERR_ASSERTION]: The input did not match the regular expression /Irish/. Input:
'11/3/2021, 2:20:58 AM Greenwich Mean Time'
at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-datetime-change-notify.js:36:10)
at Module._compile (node:internal/modules/cjs/loader:1095:14)
at Object.Module._extensions..js (node:internal/modules/cjs/loader:1147:10)
at Module.load (node:internal/modules/cjs/loader:975:32)
at Function.Module._load (node:internal/modules/cjs/loader:822:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12)
at node:internal/main/run_main_module:17:47 {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: '11/3/2021, 2:20:58 AM Greenwich Mean Time'...
Example
not ok 797 sequential/test-child-process-pass-fd
---
duration_ms: 122.756
severity: fail
exitcode: 1
stack: |-
timeout
...
Example
not ok 3533 sequential/test-worker-prof
---
duration_ms: 30.277
severity: fail
exitcode: 1
stack: |-
node:assert:123
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: child exited with signal: {
error: Error: spawnSync /home/iojs/build/workspace/node-test-commit-linux/out/Release/node ETIMEDOUT
at Object.spawnSync (node:internal/child_process:1081:20)
at spawnSync (node:child_process:812:24)
at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux/test/sequential/test-worker-prof.js:53:23)
at Module._compile (node:internal/modules/cjs/loader:1095:14)
at Object.Module._extensions..js (node:internal/modules/cjs/loader:1147:10)
at Module.load (node:internal/modules/cjs/loader:975:32)
at Function.Module._load (node:internal/modules/cjs/loader:822:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:81:12)
at node:internal/ma...
Example
not ok 3182 pummel/test-policy-integrity
---
duration_ms: 720.64
severity: fail
exitcode: -15
stack: |-
timeout
...
Example
not ok 3451 sequential/test-heap-prof
---
duration_ms: 120.91
severity: fail
exitcode: -15
stack: |-
timeout
...
Example
not ok 138 benchmark/test-benchmark-buffer
---
duration_ms: 122.879
severity: fail
exitcode: 1
stack: |-
timeout
...
Example
not ok 544 parallel/test-repl-sigint-nested-eval
---
duration_ms: 4.763
severity: fail
exitcode: 1
stack: |-
Stacktrace:
ptr1=0x508027a9
ptr2=(nil)
ptr3=(nil)
ptr4=(nil)
failure_message_object=0x7ef0ed74
==== JS stack trace =========================================
0: ExitFrame [pc: 0x10c5060]
1: StubFrame [pc: 0x1155e00]
Security context: 0x5ecd137d <JSGlobalObject>
2: _fatalException [0x24d874b9] [node:internal/process/execution:151] [bytecode=0x24da0b81 offset=13](this=0x58ac2165 <process map = 0x2ff2c5c1>,0x508027a9 <Odd Oddball: termination_exception>,0x50802449 <false>)
3: InternalFrame [pc: 0x104c774]
4: EntryFrame [pc: 0x104c418]
5: builtin exit frame: evaluate(this=0x36e760f1 <ModuleWrap map = 0x2ff38d49>,0x36e760f1 <ModuleWrap map = 0x2ff38d49>,-1,0x50802449 <false>)
6: getESMFacade [0x58ad15a5] [node:internal/bootstrap/loaders:279] [bytecode=0x24da060d offset=140](this...
Example
not ok 847 wpt/test-user-timing
---
duration_ms: 9.551
severity: fail
exitcode: 1
stack: |-
---- idlharness.any.js ----
[SKIPPED] idlharness cannot recognize Node.js environment
---- invoke_with_timing_attributes.worker.js ----
[SKIPPED] importScripts not supported
---- performance-measure-invalid.worker.js ----
[SKIPPED] importScripts not supported
---- clear_all_marks.any.js ----
[PASS] Clearing all marks remove all of them.
---- case-sensitivity.any.js ----
[PASS] getEntriesByType values are case sensitive
---- buffered-flag.any.js ----
[PASS] PerformanceObserver with buffered flag sees previous marks
---- buffered-flag.any.js ----
[PASS] PerformanceObserver with buffered flag sees previous measures
---- clear_one_measure.any.js ----
[PASS] Clearing an existent measure doesn't affect other existing measures
---- clear_non_existent_measure.any.js ----
[PASS] Clearing a non-existent measure doesn't affect existing measures
...
| Reason | parallel/test-crypto-keygen |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 6 (https://github.com/nodejs/node/pull/40670/, https://github.com/nodejs/node/pull/40660/, https://github.com/nodejs/node/pull/40250/, https://github.com/nodejs/node/pull/40649/, https://github.com/nodejs/node/pull/40664/, https://github.com/nodejs/node/pull/40598/) |
| Appeared | test-rackspace-win2012r2_vs2019-x64-3, test-rackspace-win2012r2_vs2015-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/40608/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/40689/ |
Example
not ok 783 parallel/test-crypto-keygen
---
duration_ms: 120.146
severity: fail
exitcode: 1
stack: |-
timeout
...
Example
not ok 256 parallel/test-fs-rm
---
duration_ms: 3.975
severity: fail
exitcode: 1
stack: |-
Can't clean tmpdir: C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.253
Files blocking: [ 'rm-0', 'rm-4', 'rm-5', 'rm-6', 'rm-7', 'rm-args-file.txt' ]
node:assert:986
throw newErr;
^
AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOTEMPTY: directory not empty, rmdir 'C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.253\rm-0\d-3-1'
at C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:364:12
at C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:401:15
at CB (node:internal/fs/rimraf:60:5)
at node:internal/fs/rimraf:152:18
at CB (node:internal/fs/rimraf:60:5)
at FSReqCallback.oncomplete (node:fs:188:23)
{
generatedMessage: false,
code: 'ERR_ASSERTION',
actual: [Error: ENOTEMPTY: directory not empty, rmdir 'C:\w...
Example
not ok 1330 parallel/test-http2-pipe-named-pipe
---
duration_ms: 0.106
severity: fail
exitcode: 1
stack: |-
node:assert:123
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
139837 !== 139244
at WriteStream.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/test/parallel/test-http2-pipe-named-pipe.js:26:12)
at WriteStream.emit (node:events:402:35)
at finish (node:internal/streams/writable:751:10)
at processTicksAndRejections (node:internal/process/task_queues:83:21) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 139837,
expected: 139244,
operator: 'strictEqual'
}
Node.js v18.0.0-pre
...
Example
not ok 3452 sequential/test-heapdump
---
duration_ms: 127.442
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-http2-cancel-while-client-reading |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 5 (https://github.com/nodejs/node/pull/40684/, https://github.com/nodejs/node/pull/40604/, https://github.com/nodejs/node/pull/40658/, https://github.com/nodejs/node/pull/40661/, https://github.com/nodejs/node/pull/40675/) |
| Appeared | test-orka-macos11-x64-2, test-macstadium-macos11.0-arm64-3, test-nearform-macos10.15-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/40609/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/40665/ |
Example
not ok 1200 parallel/test-http2-cancel-while-client-reading
---
duration_ms: 0.483
severity: fail
exitcode: 1
stack: |-
node:events:368
throw er; // Unhandled 'error' event
^
Error: read ECONNRESET
at TLSWrap.onStreamRead (node:internal/stream_base_commons:220:20)
Emitted 'error' event on ServerHttp2Stream instance at:
at emitErrorNT (node:internal/streams/destroy:164:8)
at emitErrorCloseNT (node:internal/streams/destroy:129:3)
at processTicksAndRejections (node:internal/process/task_queues:83:21) {
errno: -54,
code: 'ECONNRESET',
syscall: 'read'
}
Node.js v18.0.0-pre
...
Example
not ok 3150 pummel/test-fs-readfile-tostring-fail
---
duration_ms: 720.59
severity: fail
exitcode: -15
stack: |-
timeout
...
Example
not ok 3453 sequential/test-heapdump-flag
---
duration_ms: 120.80
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | node-api/test_fatal/test_threads_report |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/40572/, https://github.com/nodejs/node/pull/39240/, https://github.com/nodejs/node/pull/40250/) |
| Appeared | test-joyent-smartos20-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/40601/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/40672/ |
Example
not ok 3341 node-api/test_fatal/test_threads_report
---
duration_ms: 120.135
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-child-process-fork-closed-channel-segfault |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/40604/, https://github.com/nodejs/node/pull/40572/, https://github.com/nodejs/node/pull/40675/) |
| Appeared | test-requireio_williamkapke-debian10-arm64_pi3-2, test-requireio_svincent-debian10-armv7l_pi2-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/40652/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/40665/ |
Example
not ok 99 parallel/test-child-process-fork-closed-channel-segfault
---
duration_ms: 3.998
severity: fail
exitcode: 1
stack: |-
/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-child-process-fork-closed-channel-segfault.js:83
throw err;
^
Error: write EPIPE
at ChildProcess.target._send (node:internal/child_process:844:20)
at ChildProcess.<anonymous> (node:internal/child_process:665:16)
at ChildProcess.emit (node:events:402:35)
at emit (node:internal/child_process:915:12)
at processTicksAndRejections (node:internal/process/task_queues:84:21) {
errno: -32,
code: 'EPIPE',
syscall: 'write'
}
Node.js v18.0.0-pre
...
Example
not ok 160 parallel/test-crypto-binary-default
---
duration_ms: 240.124
severity: fail
exitcode: -15
stack: |-
timeout
...
Example
not ok 881 parallel/test-file-write-stream4
---
duration_ms: 120.88
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-fs-rmdir-recursive |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/40689/, https://github.com/nodejs/node/pull/40658/, https://github.com/nodejs/node/pull/40487/) |
| Appeared | test-azure_msft-win10_vs2019-x64-3, test-azure_msft-win10_vcbt2015-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/40615/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/40687/ |
Example
not ok 252 parallel/test-fs-rmdir-recursive
---
duration_ms: 2.77
severity: fail
exitcode: 1
stack: |-
(node:6148) [DEP0147] DeprecationWarning: In future versions of Node.js, fs.rmdir(path, { recursive: true }) will be removed. Use fs.rm(path, { recursive: true }) instead
(Use `node --trace-deprecation ...` to show where the warning was created)
Can't clean tmpdir: C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.250
Files blocking: [ 'rmdir-recursive-0', 'rmdir-recursive-4', 'rmdir-recursive-5' ]
node:assert:986
throw newErr;
^
AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOTEMPTY: directory not empty, rmdir 'C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.250\rmdir-recursive-0\d-3-2\d-2-1\d-1-1'
at C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:364:12
at C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:401:15
at node:fs:188:...
| Reason | sequential/test-net-connect-econnrefused |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/36111/, https://github.com/nodejs/node/pull/40604/, https://github.com/nodejs/node/pull/40628/) |
| Appeared | test-ibm-rhel7-s390x-1, test-ibm-rhel7-s390x-4, test-softlayer-centos7-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/40627/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/40654/ |
Example
not ok 3478 sequential/test-net-connect-econnrefused
---
duration_ms: 120.87
severity: fail
exitcode: -15
stack: |-
timeout
pending 50 rounds 1
pending 49 rounds 1
pending 48 rounds 1
pending 47 rounds 1
pending 46 rounds 1
pending 45 rounds 1
pending 44 rounds 1
pending 43 rounds 1
pending 42 rounds 1
pending 41 rounds 1
pending 40 rounds 1
pending 39 rounds 1
pending 38 rounds 1
pending 37 rounds 1
pending 36 rounds 1
pending 35 rounds 1
pending 34 rounds 1
pending 33 rounds 1
pending 32 rounds 1
pending 31 rounds 1
pending 30 rounds 1
pending 29 rounds 1
pending 28 rounds 1
pending 27 rounds 1
pending 26 rounds 1
pending 25 rounds 1
pending 24 rounds 1
pending 23 rounds 1
pending 22 rounds 1
pending 21 rounds 1
pending 20 rounds 1
pending 19 rounds 1
pending 18 rounds 1
pending 17 rounds 1
pending 16 rounds 1
pending 15 rounds 1
pending 14 rounds ...
| Reason | parallel/test-child-process-fork-exec-path |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/40665/, https://github.com/nodejs/node/pull/40659/) |
| Appeared | test-digitalocean-ubuntu1804_sharedlibs_container-x64-3, test-digitalocean-ubuntu1804_sharedlibs_container-x64-9, test-digitalocean-ubuntu1804_sharedlibs_container-x64-5 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/40666/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/40686/ |
Example
not ok 509 parallel/test-child-process-fork-exec-path
---
duration_ms: 125.493
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-crypto-secure-heap |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/40250/, https://github.com/nodejs/node/pull/40487/) |
| Appeared | test-requireio_svincent-debian10-armv7l_pi2-3, [test-requireio_rvagg-debian10-ar |
- Dominant language
- Shell
- Stars
- 57
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from nodejs/reliability
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1666 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
nodejs/reliability#1665 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
nodejs/reliability#1664 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1663 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1662 ·
All issues in nodejs/reliability
Similar issues
-
Update Vish to 1.1.5 Openpackage-update
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
oSoWoSo/vOid_Community_repOsitory#144 · 1 comment ·
-
help wanted new command
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
tldr-pages/tldr#24151 ·
-
PacReq: Rune IDE Openpackage request
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
pacstall/pacstall-programs#9402 ·
-
[BUG] ci: the first prefetch-images.sh call runs before shard.txt exists, so it is always a no-op Openbug github-actions
Difficulty 2/5 1-3 hours Newbie friendliness 82/100
-
update-request
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
msys2/MINGW-packages#31768 ·