CI Reliability 2023-10-25
Open
Nobody has claimed this yet.
- Dominant language
- Shell
- Stars
- 57
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Description
Failures in node-test-pull-request/55112 to node-test-pull-request/55209 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)
| UTC Time | RUNNING | SUCCESS | UNSTABLE | ABORTED | FAILURE | Green Rate |
|---|---|---|---|---|---|---|
| 2023-10-25 00:13 | 2 | 1 | 23 | 5 | 69 | 1.08% |
JSTest Failure
Example
not ok 2247 parallel/test-release-changelog
---
duration_ms: 162.06700
severity: fail
exitcode: 1
stack: |-
node:assert:1026
throw err;
^
AssertionError [ERR_ASSERTION]: The input did not match the regular expression /<b><a href="doc\/changelogs\/CHANGELOG_V21.md#21\.0\.0">21\.0\.0<\/a><\/b><br\/>/. Input:
'# Node.js Changelog\n' +
'\n' +
'Select a Node.js version below to view the changelog history:\n' +
'\n' +
'* [Node.js 21](doc/changelogs/CHANGELOG_V21.md) **Current**\n' +
'* [Node.js 20](doc/changelogs/CHANGELOG_V20.md) **Long Term Support**\n' +
'* [Node.js 19](doc/changelogs/CHANGELOG_V19.md) End-of-Life\n' +
'* [Node.js 18](doc/changelogs/CHANGELOG_V18.md) **Long Term Support**\n' +
'* [Node.js 17](doc/changelogs/CHANGELOG_V17.md) End-of-Life\n' +
'* [Node.js 16](doc/changelogs/CHANGELOG_V16.md) End-of-Life\n' +
'* [Node.js 15](doc/changelogs/CHANGELOG_V15.md) End-of-Life\n' +
'* [Node.js ...
| Reason | parallel/test-child-process-exec-timeout-kill |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/50327/, https://github.com/nodejs/node/pull/49292/, https://github.com/nodejs/node/pull/50331/) |
| Appeared | test-nearform-macos10.15-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/55120/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/55140/ |
Example
not ok 158 parallel/test-child-process-exec-timeout-kill
---
duration_ms: 0.204
severity: fail
exitcode: 1
stack: |-
[stdout]
[stderr]
node:assert:124
throw new AssertionError(obj);
^
AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
1 !== null
at /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/parallel/test-child-process-exec-timeout-kill.js:32:10
at /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/common/index.js:446:15
at ChildProcess.exithandler (node:child_process:410:5)
at ChildProcess.emit (node:events:513:28)
at maybeClose (node:internal/child_process:1100:16)
at Process.ChildProcess._handle.onexit (node:internal/child_process:304:5) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: 1,
expected: null,
operator: 'strictEqual'
}
...
| Reason | parallel/test-fs-watch-recursive-add-file-to-existing-subfolder |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/50292/, https://github.com/nodejs/node/pull/50354/, https://github.com/nodejs/node/pull/50363/) |
| Appeared | test-ibm-rhel8-s390x-4, test-ibm-rhel8-s390x-2, test-digitalocean-alpine318_container-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/55136/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/55209/ |
Example
not ok 1369 parallel/test-fs-watch-recursive-add-file-to-existing-subfolder
---
duration_ms: 120127.18200
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | sequential/test-single-executable-application-snapshot-and-code-cache |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/50331/, https://github.com/nodejs/node/pull/49772/, https://github.com/nodejs/node/pull/50359/) |
| Appeared | test-digitalocean-ubuntu1804_sharedlibs_container-x64-5, test-equinix_mnx-ubuntu1804-x64-1, test-softlayer-debian10-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/55140/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/55183/ |
Example
not ok 4039 sequential/test-single-executable-application-snapshot-and-code-cache
---
duration_ms: 13070.82800
severity: fail
exitcode: 1
stack: |-
[process 7129]: --- stderr ---
[process 7129]: --- stdout ---
[process 7129]: status = null, signal = SIGSEGV
/home/iojs/build/workspace/node-test-commit-linux-containered/test/common/child_process.js:86
throw new Error(`${failures.join('\n')}`);
^
Error: - process terminated with status null, expected 0
- process terminated with signal SIGSEGV, expected null
at logAndThrow (/home/iojs/build/workspace/node-test-commit-linux-containered/test/common/child_process.js:86:11)
at expectSyncExit (/home/iojs/build/workspace/node-test-commit-linux-containered/test/common/child_process.js:91:5)
at spawnSyncAndExitWithoutError (/home/iojs/build/workspace/node-test-commit-linux-containered/test/common/child_process.js:125:10)
at Object.<anonymous> (/home/iojs/build/workspace/node-...
| Reason | es-module/test-esm-loader-hooks |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/49756/, https://github.com/nodejs/node/pull/50335/) |
| Appeared | test-digitalocean-freebsd12-x64-2, test-azure_msft-win11_vs2022-arm64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/55126/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/55142/ |
Example
not ok 3445 es-module/test-esm-loader-hooks
---
duration_ms: 14991.65100
severity: fail
exitcode: 1
stack: |-
TAP version 13
# Subtest: Loader hooks
# Subtest: are called with all expected arguments
ok 1 - are called with all expected arguments
---
duration_ms: 11680.862687
...
| Reason | parallel/test-fs-write-stream-eagain |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/50331/, https://github.com/nodejs/node/pull/50359/) |
| Appeared | test-osuosl-rhel8-ppc64_le-4, test-ibm-aix72-ppc64_be-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/55149/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/55183/ |
Example
not ok 1243 parallel/test-fs-write-stream-eagain
---
duration_ms: 329.69000
severity: fail
exitcode: 1
stack: |-
TAP version 13
# Subtest: WriteStream EAGAIN
# Subtest: _write
not ok 1 - _write
---
duration_ms: 16.229279
location: 'file:///home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/parallel/test-fs-write-stream-eagain.mjs:15:3'
failureType: 'testCodeFailure'
error: |-
Expected values to be strictly equal:
'' !== 'foo'
code: 'ERR_ASSERTION'
name: 'AssertionError'
expected: 'foo'
actual: ''
operator: 'strictEqual'
stack: |-
TestContext.<anonymous> (file:///home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/parallel/test-fs-write-stream-eagain.mjs:30:12)
process.processTicksAndRejections (node:internal/process/task_queues:95:5)
asy...
| Reason | parallel/test-inspector-esm |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/49756/, https://github.com/nodejs/node/pull/49785/) |
| Appeared | test-ibm-rhel8-s390x-4, test-osuosl-rhel8-ppc64_le-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/55126/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/55151/ |
Example
not ok 1874 parallel/test-inspector-esm
---
duration_ms: 15528.48500
severity: fail
exitcode: 1
stack: |-
[test] Connecting to a child Node process
[test] Testing /json/list
[err] Debugger listening on ws://127.0.0.1:32853/98155325-add9-43c9-9333-ca50736d2c18
[err] For help, see: https://nodejs.org/en/docs/inspector
[err]
[test] Verifying debugger stops on start (--inspect-brk option)
[err] Debugger attached.
[err]
Timed out waiting for matching notification (break on file:///home/iojs/build/workspace/node-test-commit-linuxone/test/fixtures/es-modules/message.mjs:0)
1
...
| Reason | parallel/test-inspector-stop-profile-after-done |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/50331/, https://github.com/nodejs/node/pull/50361/) |
| Appeared | test-ibm-rhel8-s390x-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/55140/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/55181/ |
Example
not ok 3282 parallel/test-inspector-stop-profile-after-done
---
duration_ms: 120056.51000
severity: fail
exitcode: -15
stack: |-
timeout
[test] Connecting to a child Node process
[test] Testing /json/list
[err] Debugger listening on ws://127.0.0.1:39575/68c63c9f-95d8-49d6-b645-02051e90f4e1
[err] For help, see: https://nodejs.org/en/docs/inspector
[err]
[err] Debugger attached.
[err]
...
| Reason | parallel/test-runner-output |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/50331/, https://github.com/nodejs/node/pull/50018/) |
| Appeared | test-azure_msft-win2016_vs2017-x64-6, test-rackspace-win2019_vs2019-x64-3, test-azure_msft-win2022_vs2019-x64-1, test-azure_msft-win11_vs2022-arm64-3, test-osuosl-aix72-ppc64_be-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/55143/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/55175/ |
Example
not ok 653 parallel/test-runner-output
---
duration_ms: 2509.99000
severity: fail
exitcode: 1
stack: |-
TAP version 13
# Subtest: test runner output
# Subtest: test-runner/output/abort.js
ok 1 - test-runner/output/abort.js
---
duration_ms: 1427.0994
...
Jenkins Failure
| Reason | Build timed out (after 60 minutes). Marking the build as failed. |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 4 (https://github.com/nodejs/node/pull/50292/, https://github.com/nodejs/node/pull/50357/, https://github.com/nodejs/node/pull/50350/, https://github.com/nodejs/node/pull/50371/) |
| Appeared | test-rackspace-win2022_vs2022-x64-2, test-rackspace-win2022_vs2022-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/55136/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/55200/ |
Example
Build timed out (after 60 minutes). Marking the build as failed.
Git Failure
Build Failure
Example
fatal error: string_view: No such file or directory
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
Example
fatal error: charconv: No such file or directory
| Reason | fatal: '/home/iojs/.ccache/node.shared.reference' does not appear to be a git repository |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 6 (https://github.com/nodejs/node/pull/50308/, https://github.com/nodejs/node/pull/50318/, https://github.com/nodejs/node/pull/50331/, https://github.com/nodejs/node/pull/50337/, https://github.com/nodejs/node/pull/50198/, https://github.com/nodejs/node/pull/50363/) |
| Appeared | test-equinix-ubuntu2004_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/55116/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/55209/ |
Example
fatal: '/home/iojs/.ccache/node.shared.reference' does not appear to be a git repository
fatal: Could not read from remote repository.
fatal: failed to run repack
| Reason | sh: line 12: [: -gt: unary operator expected |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 5 (https://github.com/nodejs/node/pull/50292/, https://github.com/nodejs/node/pull/48462/, https://github.com/nodejs/node/pull/50357/, https://github.com/nodejs/node/pull/50350/, https://github.com/nodejs/node/pull/50371/) |
| Appeared | test-rackspace-win2019_vs2019-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/55146/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/55200/ |
Example
sh: line 12: [: -gt: unary operator expected
| Reason | Failed to trigger sub builds |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/50294/, https://github.com/nodejs/node/pull/50018/, https://github.com/nodejs/node/pull/50289/) |
| Appeared | undefined |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/55123/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/55206/ |
Example
Failed to trigger sub builds
CCTest Failure
Progress
-
parallel/test-release-changelog(13) -
parallel/test-child-process-exec-timeout-kill(3) -
parallel/test-fs-watch-recursive-add-file-to-existing-subfolder(3) -
sequential/test-single-executable-application-snapshot-and-code-cache(3) -
es-module/test-esm-loader-hooks(2) -
parallel/test-fs-write-stream-eagain(2) -
parallel/test-inspector-esm(2) -
parallel/test-inspector-stop-profile-after-done(2) -
parallel/test-runner-output(2) -
Build timed out (after 60 minutes). Marking the build as failed.(4) -
fatal error: string_view: No such file or directory(16) -
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?(15) -
fatal error: charconv: No such file or directory(12) -
fatal: '/home/iojs/.ccache/node.shared.reference' does not appear to be a git repository(6) -
sh: line 12: [: -gt: unary operator expected(5) -
Failed to trigger sub builds(3)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the parallel/test-release-changelog failure and the linked CI console example, then compare the first and last CI runs listed in the issue. Done means identifying the recurring cause and confirming that this test no longer fails across the affected CI environments.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- node.js, shell
- Domain
- ci-cd, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100