CI Reliability 2023-10-03
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 25/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- nodejs, shell
- Domain
- ci-cd, testing-qa
Research direction
Start with the linked CI runs and the listed test entry points, especially test/sequential/test-perf-hooks.js and test/parallel/test-tls-socket-close.js; compare the failures across the named platforms. Done means the reported CI failures have confirmed causes and the affected test jobs no longer fail intermittently.
Written by the indexing model from the issue text.
Description
Failures in node-test-pull-request/54379 to node-test-pull-request/54478 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)
| UTC Time | RUNNING | SUCCESS | UNSTABLE | ABORTED | FAILURE | Green Rate |
|---|---|---|---|---|---|---|
| 2023-10-03 00:13 | 0 | 15 | 8 | 0 | 77 | 15.00% |
JSTest Failure
Example
not ok 913 pummel/test-heapdump-shadow-realm
---
duration_ms: 12692.15500
severity: fail
exitcode: 3221226505
stack: |-
(node:5592) internal/test/binding: These APIs are for internal testing only. Do not use them.
(Use `node --trace-warnings ...` to show where the warning was created)
...
Example
not ok 936 sequential/test-http-regr-gh-2928
---
duration_ms: 455.51000
severity: fail
exitcode: 3221226505
stack: |-
.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.
...
| Reason | es-module/test-wasm-web-api |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/49340/, https://github.com/nodejs/node/pull/49974/, https://github.com/nodejs/node/pull/49980/, https://github.com/nodejs/node/pull/49973/) |
| Appeared | test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-equinix-ubuntu2004_sharedlibs_container-arm64-5 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54385/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54417/ |
Example
not ok 3887 es-module/test-wasm-web-api
---
duration_ms: 960096.77100
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | sequential/test-perf-hooks |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/49966/, https://github.com/nodejs/node/pull/49963/, https://github.com/nodejs/node/pull/49837/, https://github.com/nodejs/node/pull/49956/) |
| Appeared | test-ibm-rhel7-s390x-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54391/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54401/ |
Example
not ok 3721 sequential/test-perf-hooks
---
duration_ms: 0.636
severity: fail
exitcode: 1
stack: |-
{
name: 'node',
entryType: 'node',
startTime: 0,
duration: { around: 164.73612546920776 },
nodeStart: { around: 0 },
v8Start: { around: 0 },
bootstrapComplete: { around: 164.71987533569336, delay: 2500 },
environment: { around: 0 },
loopStart: -1,
loopExit: -1
}
node:assert:400
throw err;
^
AssertionError [ERR_ASSERTION]: duration: 313.872624874115 >= 250
at checkNodeTiming (/home/iojs/build/workspace/node-test-commit-linuxone/test/sequential/test-perf-hooks.js:31:7)
at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-linuxone/test/sequential/test-perf-hooks.js:43:1)
at Module._compile (node:internal/modules/cjs/loader:1198:14)
at Object.Module._extensions..js (node:internal/modules/cjs/loader:1252:10)
at Module.load (node:internal/modules/cjs/loader:10...
| Reason | parallel/test-inspector-stop-profile-after-done |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/49966/, https://github.com/nodejs/node/pull/49999/, https://github.com/nodejs/node/pull/50014/) |
| Appeared | test-ibm-rhel8-s390x-1, test-ibm-rhel8-s390x-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54407/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54468/ |
Example
not ok 3640 parallel/test-inspector-stop-profile-after-done
---
duration_ms: 120033.28000
severity: fail
exitcode: -15
stack: |-
timeout
[test] Connecting to a child Node process
[test] Testing /json/list
[err] Debugger listening on ws://127.0.0.1:43109/5b45b8b5-f50b-4eb0-9cce-b9dd2e9cb4cf
[err] For help, see: https://nodejs.org/en/docs/inspector
[err]
[err] Debugger attached.
[err]
...
| Reason | parallel/test-tls-socket-close |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/49974/, https://github.com/nodejs/node/pull/49712/, https://github.com/nodejs/node/pull/50009/) |
| Appeared | test-ibm-rhel8-s390x-4, test-ibm-rhel8-s390x-3, test-nearform-macos11.0-arm64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54400/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54456/ |
Example
not ok 2868 parallel/test-tls-socket-close
---
duration_ms: 228.05000
severity: fail
exitcode: 1
stack: |-
node:assert:125
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
false !== true
at Immediate._onImmediate (/home/iojs/build/workspace/node-test-commit-linuxone/test/parallel/test-tls-socket-close.js:49:18)
at process.processImmediate (node:internal/timers:478:21) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: false,
expected: true,
operator: 'strictEqual'
}
Node.js v21.0.0-pre
...
| Reason | parallel/test-whatwg-webstreams-transfer |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/49974/, https://github.com/nodejs/node/pull/49997/, https://github.com/nodejs/node/pull/49898/) |
| Appeared | test-equinix-ubuntu2004_container-armv7l-1, undefined |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54400/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54474/ |
Example
not ok 3690 parallel/test-whatwg-webstreams-transfer
---
duration_ms: 360036.93900
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-worker-memory |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/49340/, https://github.com/nodejs/node/pull/49992/, https://github.com/nodejs/node/pull/49756/) |
| Appeared | test-rackspace-win2022_vs2022-x64-1, test-rackspace-win2019_vs2019-x64-4, test-azure_msft-win2022_vs2019-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54385/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54462/ |
Example
not ok 860 parallel/test-worker-memory
---
duration_ms: 2119.08100
severity: crashed
exitcode: 3221225477
stack: |-
run() called with n=7.5 (numWorkers=8)
run() called with n=7.5 (numWorkers=8)
run() called with n=7.5 (numWorkers=8)
run() called with n=7.5 (numWorkers=8)
run() called with n=7.5 (numWorkers=8)
run() called with n=7.5 (numWorkers=8)
run() called with n=7.5 (numWorkers=8)
run() called with n=7.5 (numWorkers=8)
run() called with n=6.5 (numWorkers=8)
run() called with n=6.5 (numWorkers=8)
run() called with n=6.5 (numWorkers=8)
run() called with n=6.5 (numWorkers=8)
run() called with n=6.5 (numWorkers=8)
run() called with n=6.5 (numWorkers=8)
run() called with n=6.5 (numWorkers=8)
run() called with n=6.5 (numWorkers=8)
run() called with n=5.5 (numWorkers=8)
run() called with n=5.5 (numWorkers=8)
run() called with n=5.5 (numWorkers=8)
run() called with n=5.5 (numWorkers=8)
run() called with n=5.5 (numWorker...
| Reason | addons/worker-buffer-callback/test-free-called |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/49996/, https://github.com/nodejs/node/pull/50014/) |
| Appeared | test-osuosl-aix72-ppc64_be-2, test-osuosl-aix72-ppc64_be-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54448/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54468/ |
Example
not ok 3748 addons/worker-buffer-callback/test-free-called
---
duration_ms: 300.17500
severity: fail
exitcode: 1
stack: |-
node:assert:125
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
1 !== 0
at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-aix/nodes/aix72-ppc64/test/addons/worker-buffer-callback/test-free-called.js:14:8)
at Module._compile (node:internal/modules/cjs/loader:1369:14)
at Module._extensions..js (node:internal/modules/cjs/loader:1427:10)
at Module.load (node:internal/modules/cjs/loader:1201:32)
at Module._load (node:internal/modules/cjs/loader:1017:12)
at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:104:12)
at node:internal/main/run_main_module:23:47 {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 1,
expected: 0,
operator: 'strictEqual'
}
...
| Reason | es-module/test-esm-loader-resolve-type |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/49982/, https://github.com/nodejs/node/pull/49979/) |
| Appeared | test-nearform-macos11.0-arm64-1, test-digitalocean-freebsd12-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54430/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54435/ |
Example
not ok 3550 es-module/test-esm-loader-resolve-type
---
duration_ms: 315.71100
severity: fail
exitcode: 1
stack: |-
node:internal/process/esm_loader:40
internalBinding('errors').triggerUncaughtException(
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
+ actual - expected
{
code: 0,
signal: null,
stderr: '',
+ stdout: '{"before":{"importedESM":0,"importedCJS":0},"after":{"importedESM":0,"importedCJS":0}}\n'
- stdout: '{"before":{"importedESM":0,"importedCJS":0},"after":{"importedESM":1,"importedCJS":0}}\n'
}
at file:///Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/test/es-module/test-esm-loader-resolve-type.mjs:34:3 {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: {
code: 0,
signal: null,
stderr: '',
stdout: '{"before":{"importedESM":0,"importedCJS":0},"after":{"importedESM":0...
| Reason | parallel/test-blob-file-backed |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/49930/, https://github.com/nodejs/node/pull/49987/) |
| Appeared | test-ibm-rhel8-s390x-1, test-digitalocean-alpine318_container-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54404/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54441/ |
Example
not ok 84 parallel/test-blob-file-backed
---
duration_ms: 85.84600
severity: fail
exitcode: 1
stack: |-
node:internal/per_context/domexception:53
ErrorCaptureStackTrace(this);
^
DOMException [NotReadableError]: The blob could not be read
at new DOMException (node:internal/per_context/domexception:53:5)
at __node_internal_ (node:internal/util:698:10)
at BlobReader.<anonymous> (node:internal/blob:291:25)
Node.js v21.0.0-pre
...
| Reason | parallel/test-fs-watch-recursive-add-file-to-existing-subfolder |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/49905/, https://github.com/nodejs/node/pull/49953/) |
| Appeared | test-ibm-rhel8-s390x-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54405/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54478/ |
Example
not ok 1362 parallel/test-fs-watch-recursive-add-file-to-existing-subfolder
---
duration_ms: 120061.56800
severity: fail
exitcode: -15
stack: |-
timeout
...
Example
not ok 1572 parallel/test-http2-compat-serverrequest-pause
---
duration_ms: 278.26900
severity: fail
exitcode: 1
stack: |-
node:internal/http2/core:2177
this._writableState.buffered.length ||
^
TypeError: Cannot read properties of null (reading 'length')
at node:internal/http2/core:2177:38
at process.processTicksAndRejections (node:internal/process/task_queues:77:11)
Node.js v21.0.0-pre
...
| Reason | parallel/test-inspector-async-stack-traces-set-interval |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/49987/, https://github.com/nodejs/node/pull/49898/) |
| Appeared | test-ibm-rhel8-s390x-4, test-osuosl-rhel8-ppc64_le-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54434/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54474/ |
Example
not ok 2002 parallel/test-inspector-async-stack-traces-set-interval
---
duration_ms: 15316.11700
severity: fail
exitcode: 1
stack: |-
[test] Connecting to a child Node process
[test] Testing /json/list
[err] Debugger listening on ws://127.0.0.1:36207/c9cd8f02-d5d8-4827-ab43-c564a3ed431f
[err] For help, see: https://nodejs.org/en/docs/inspector
[err]
[err] Debugger attached.
[err]
[test] Skipping the first breakpoint in the eval script
Timed out waiting for matching notification (break on [eval]:0)
1
...
| Reason | sequential/test-single-executable-application-snapshot-and-code-cache |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/49958/, https://github.com/nodejs/node/pull/42651/) |
| Appeared | test-azure_msft-win2016_vs2017-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54379/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54384/ |
Example
not ok 945 sequential/test-single-executable-application-snapshot-and-code-cache
---
duration_ms: 16434.31600
severity: fail
exitcode: 1
stack: |-
[process 8000]: --- stderr ---
Aborted()
[process 8000]: --- stdout ---
[36mStart injection of NODE_SEA_BLOB in C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.944\sea.exe...[0m
[31mError: Aborted(). Build with -sASSERTIONS for more info.[0m
[process 8000]: status = 1, signal = null
C:\workspace\node-test-binary-windows-js-suites\node\test\common\child_process.js:86
throw new Error(`${failures.join('\n')}`);
^
Error: - process terminated with status 1, expected 0
at logAndThrow (C:\workspace\node-test-binary-windows-js-suites\node\test\common\child_process.js:86:11)
at expectSyncExit (C:\workspace\node-test-binary-windows-js-suites\node\test\common\child_process.js:91:5)
at spawnSyncAndExitWithoutError (C:\workspace\node-test-binary-windows-js-suites\...
Jenkins Failure
| Reason | Build timed out (after 60 minutes). Marking the build as failed. |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/49930/, https://github.com/nodejs/node/pull/49956/, https://github.com/nodejs/node/pull/49980/) |
| Appeared | test-rackspace-win2019_vs2019-x64-1, test-digitalocean-ubi81_container-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54404/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54413/ |
Example
Build timed out (after 60 minutes). Marking the build as failed.
Git Failure
Build Failure
| Reason | fatal: '/home/iojs/.ccache/node.shared.reference' does not appear to be a git repository |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 11 (https://github.com/nodejs/node/pull/49837/, https://github.com/nodejs/node/pull/49756/, https://github.com/nodejs/node/pull/49974/, https://github.com/nodejs/node/pull/49980/, https://github.com/nodejs/node/pull/49962/, https://github.com/nodejs/node/pull/49979/, https://github.com/nodejs/node/pull/49996/, https://github.com/nodejs/node/pull/49999/, https://github.com/nodejs/node/pull/50009/, https://github.com/nodejs/node/pull/50012/, https://github.com/nodejs/node/pull/49950/) |
| Appeared | test-equinix-ubuntu2004_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54393/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54472/ |
Example
fatal: '/home/iojs/.ccache/node.shared.reference' does not appear to be a git repository
fatal: Could not read from remote repository.
fatal: unable to create thread: Resource temporarily unavailable
fatal: failed to run repack
| Reason | ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/49928/, https://github.com/nodejs/node/pull/49970/) |
| Appeared | test-equinix_mnx-smartos20-x64-4, test-equinix-ubuntu2004_container-armv7l-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/54395/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/54465/ |
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
Progress
-
pummel/test-heapdump-shadow-realm(16) -
sequential/test-http-regr-gh-2928(12) -
es-module/test-wasm-web-api(4) -
sequential/test-perf-hooks(4) -
parallel/test-inspector-stop-profile-after-done(3) -
parallel/test-tls-socket-close(3) -
parallel/test-whatwg-webstreams-transfer(3) -
parallel/test-worker-memory(3) -
addons/worker-buffer-callback/test-free-called(2) -
es-module/test-esm-loader-resolve-type(2) -
parallel/test-blob-file-backed(2) -
parallel/test-fs-watch-recursive-add-file-to-existing-subfolder(2) -
parallel/test-http2-compat-serverrequest-pause(2) -
parallel/test-inspector-async-stack-traces-set-interval(2) -
sequential/test-single-executable-application-snapshot-and-code-cache(2) -
Build timed out (after 60 minutes). Marking the build as failed.(3) -
fatal: '/home/iojs/.ccache/node.shared.reference' does not appear to be a git repository(11) -
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?(2)
- Dominant language
- Shell
- Stars
- 57
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from nodejs/reliability
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1666 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
nodejs/reliability#1665 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
nodejs/reliability#1664 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1663 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1662 ·
All issues in nodejs/reliability
Similar issues
-
area: compat bug
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
-
intake mcp-intake needs-ac needs-human-review priority:medium type:bug
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
Ikalus1988/MisakaNet#2019 · 2 comments ·
-
type:content-error
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
stephrobert/blog-roadmap#15 ·
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 85/100
hust-open-atom-club/hustmirror-cli#52 · 1 comment ·