CI Reliability 2023-12-30
Nobody has claimed this yet.
Assessment
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Newbie friendliness
- 20/100
- Issue type
- Bug
- Clarity
- Needs clarification
- Activity status
- Stale
- Tech stack
- javascript, nodejs, shell
- Domain
- ci-cd, testing-qa
Research direction
Start with the linked CI console logs and the named tests, including test/parallel/test-whatwg-webstreams-transfer.js and test/async-hooks/test-fsreqcallback-readFile.js. Run the relevant tests on the reported platforms and determine which failures remain reproducible; done requires an identified resolution for the reported CI failures, but the issue does not specify a single fix scope.
Written by the indexing model from the issue text.
Description
Failures in node-test-pull-request/56494 to node-test-pull-request/56588 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)
| UTC Time | RUNNING | SUCCESS | UNSTABLE | ABORTED | FAILURE | Green Rate |
|---|---|---|---|---|---|---|
| 2023-12-30 00:12 | 2 | 6 | 17 | 9 | 66 | 6.74% |
JSTest Failure
Example
not ok 3450 parallel/test-whatwg-webstreams-transfer
---
duration_ms: 243.69700
severity: fail
exitcode: 1
stack: |-
Mismatched <anonymous> function calls. Expected exactly 1, actual 0.
at Proxy.mustCall (/home/iojs/build/workspace/node-test-commit-linux/test/common/index.js:434:10)
at MessagePort.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-whatwg-webstreams-transfer.js:280:33)
at MessagePort.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux/test/common/index.js:476:15)
at MessagePort.eventHandler (node:internal/event_target:1106:12)
at [nodejs.internal.kHybridDispatch] (node:internal/event_target:822:20)
at exports.emitMessage (node:internal/per_context/messageport:23:28)
Mismatched <anonymous> function calls. Expected exactly 1, actual 0.
at Proxy.mustCall (/home/iojs/build/workspace/node-test-commit-linux/test/common/index.js:434:10)
at MessagePort.<anonymous> (/home/iojs/bui...
| Reason | async-hooks/test-fsreqcallback-readFile |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/51264/, https://github.com/nodejs/node/pull/51291/, https://github.com/nodejs/node/pull/49790/) |
| Appeared | test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-9 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56504/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56585/ |
Example
not ok 3602 async-hooks/test-fsreqcallback-readFile
---
duration_ms: 408.16900
severity: fail
exitcode: 1
stack: |-
node:assert:408
throw err;
^
AssertionError [ERR_ASSERTION]: Checking invocations at stage "reqwrap[2]: while in onread callback":
Never called "destroy", but expected 1 invocation(s).
at checkHook (/home/iojs/build/workspace/node-test-commit-linux-containered/test/async-hooks/hook-checks.js:44:7)
at Array.forEach (<anonymous>)
at checkInvocations (/home/iojs/build/workspace/node-test-commit-linux-containered/test/async-hooks/hook-checks.js:27:62)
at onread (/home/iojs/build/workspace/node-test-commit-linux-containered/test/async-hooks/test-fsreqcallback-readFile.js:32:3)
at onread (/home/iojs/build/workspace/node-test-commit-linux-containered/test/common/index.js:476:15)
at FSReqCallback.readFileAfterClose [as oncomplete] (node:internal/fs/read/context:68:3)
at FSReqCallback.callbackTrampoline...
| Reason | parallel/test-inspector-async-stack-traces-set-interval |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/51112/, https://github.com/nodejs/node/pull/51293/, https://github.com/nodejs/node/pull/51305/) |
| Appeared | test-ibm-rhel8-s390x-4 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56506/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56575/ |
Example
not ok 2013 parallel/test-inspector-async-stack-traces-set-interval
---
duration_ms: 15297.94500
severity: fail
exitcode: 1
stack: |-
[test] Connecting to a child Node process
[test] Testing /json/list
[err] Debugger listening on ws://127.0.0.1:44065/252f88f7-319a-4204-a748-47ae86e401dd
[err] For help, see: https://nodejs.org/en/docs/inspector
[err]
[err] Debugger attached.
[err]
[test] Skipping the first breakpoint in the eval script
Timed out waiting for matching notification (break on [eval]:0)
1
...
| Reason | parallel/test-assert-esm-cjs-message-verify |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/51255/, https://github.com/nodejs/node/pull/51168/) |
| Appeared | test-azure_msft-win2016_vs2017-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56509/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56512/ |
Example
not ok 69 parallel/test-assert-esm-cjs-message-verify
---
duration_ms: 427.00200
severity: fail
exitcode: 1
stack: |-
TAP version 13
# Subtest: ensure the assert.ok throwing similar error messages for esm and cjs files
# Subtest: should return code 1 for each command
ok 1 - should return code 1 for each command
---
duration_ms: 182.1517
...
| Reason | parallel/test-fs-watch-recursive-add-file-to-existing-subfolder |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/51146/, https://github.com/nodejs/node/pull/51305/) |
| Appeared | test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-ibm-rhel8-s390x-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56523/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56577/ |
Example
not ok 1321 parallel/test-fs-watch-recursive-add-file-to-existing-subfolder
---
duration_ms: 120075.74900
severity: fail
exitcode: -15
stack: |-
timeout
...
| Reason | parallel/test-http-server-request-timeouts-mixed |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/51112/, https://github.com/nodejs/node/pull/51032/) |
| Appeared | test-ibm-aix72-ppc64_be-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56502/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56525/ |
Example
not ok 1617 parallel/test-http-server-request-timeouts-mixed
---
duration_ms: 3208.43500
severity: fail
exitcode: 1
stack: |-
node:assert:408
throw err;
^
AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
assert(request2.completed)
at Timeout._onTimeout (/home/iojs/build/workspace/node-test-commit-aix/nodes/aix72-ppc64/test/parallel/test-http-server-request-timeouts-mixed.js:108:5)
at listOnTimeout (node:internal/timers:573:17)
at process.processTimers (node:internal/timers:514:7) {
generatedMessage: true,
code: 'ERR_ASSERTION',
actual: false,
expected: true,
operator: '=='
}
Node.js v22.0.0-pre
...
| Reason | pummel/test-fs-readfile-tostring-fail |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/50115/, https://github.com/nodejs/node/pull/49790/) |
| Appeared | test-orka-macos11-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56579/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56585/ |
Example
not ok 3693 pummel/test-fs-readfile-tostring-fail
---
duration_ms: 1355.71800
severity: fail
exitcode: 7
stack: |-
/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/pummel/test-fs-readfile-tostring-fail.js:77
throw err;
^
AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOSPC: no space left on device, write
at Object.callback (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/pummel/test-fs-readfile-tostring-fail.js:35:37)
at callback (node:internal/streams/writable:757:21)
at onwriteError (node:internal/streams/writable:597:3)
at onwrite (node:internal/streams/writable:640:7)
at node:internal/fs/streams:513:5
at node:internal/fs/streams:455:14
at FSReqCallback.wrapper [as oncomplete] (node:fs:953:5) {
generatedMessage: false,
code: 'ERR_ASSERTION',
actual: [Error: ENOSPC: no space left on device, write] {
errno: -28,
code: 'ENOSPC...
| Reason | sequential/test-worker-fshandles-open-close-on-termination |
|---|---|
| Type | JS_TEST_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/51138/, https://github.com/nodejs/node/pull/51305/) |
| Appeared | test-azure_msft-win2016_vs2017-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56517/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56575/ |
Example
not ok 963 sequential/test-worker-fshandles-open-close-on-termination
---
duration_ms: 1326.56000
severity: fail
exitcode: 3221226356
stack: |-
...
Jenkins Failure
| Reason | Cannot retrieve the node's workspace for hudson.matrix.MatrixProject@78fd291b[node-test-commit-osx]. Most probably the node is offline |
|---|---|
| Type | JENKINS_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/51291/, https://github.com/nodejs/node/pull/51295/) |
| Appeared | test-nearform-macos10.15-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56558/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56568/ |
Example
java.io.IOException: Cannot retrieve the node's workspace for hudson.matrix.MatrixProject@78fd291b[node-test-commit-osx]. Most probably the node is offline
at hudson.matrix.MatrixRun$MatrixRunExecution.getParentWorkspaceLease(MatrixRun.java:173)
at hudson.matrix.MatrixRun$MatrixRunExecution.decideWorkspace(MatrixRun.java:187)
at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:511)
at hudson.model.Run.execute(Run.java:1895)
at hudson.matrix.MatrixRun.run(MatrixRun.java:153)
Build Failure
| Reason | error: The last gc run reported the following. Please correct the root cause |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 11 (https://github.com/nodejs/node/pull/51264/, https://github.com/nodejs/node/pull/51278/, https://github.com/nodejs/node/pull/51146/, https://github.com/nodejs/node/pull/50120/, https://github.com/nodejs/node/pull/48882/, https://github.com/nodejs/node/pull/51112/, https://github.com/nodejs/node/pull/51037/, https://github.com/nodejs/node/pull/51291/, https://github.com/nodejs/node/pull/51295/, https://github.com/nodejs/node/pull/51305/, https://github.com/nodejs/node/pull/49790/) |
| Appeared | test-digitalocean-ubuntu1804_sharedlibs_container-x64-3, test-ibm-ubuntu1804-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56504/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56585/ |
Example
error: The last gc run reported the following. Please correct the root cause
and remove .git/gc.log.
Automatic cleanup will not be performed until the file is removed.
warning: There are too many unreachable loose objects; run 'git prune' to remove them.
Example
error: unrecognized command line option '-std=gnu++20'; did you mean '-std=gnu++2a'?
deps/simdutf/simdutf.target.mk:86: recipe for target '/home/iojs/build/workspace/node-test-commit-linux-containered/out/Release/obj.target/simdutf/deps/simdutf/simdutf.o' failed
make[2]: *** [/home/iojs/build/workspace/node-test-commit-linux-containered/out/Release/obj.target/simdutf/deps/simdutf/simdutf.o] Error 1
make[2]: *** Waiting for unfinished jobs....
Makefile:134: recipe for target 'node' failed
make[1]: *** [node] Error 2
| Reason | error: unrecognized command line option ‘-std=gnu++20’; did you mean ‘-std=gnu++2a’? |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 6 (https://github.com/nodejs/node/pull/50354/, https://github.com/nodejs/node/pull/51146/, https://github.com/nodejs/node/pull/51112/, https://github.com/nodejs/node/pull/50758/, https://github.com/nodejs/node/pull/50610/, https://github.com/nodejs/node/pull/50115/) |
| Appeared | test-equinix_mnx-ubuntu1804-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56521/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56579/ |
Example
error: unrecognized command line option ‘-std=gnu++20’; did you mean ‘-std=gnu++2a’?
deps/simdutf/simdutf.target.mk:84: recipe for target '/home/iojs/build/workspace/node-test-commit-linux/out/Release/obj.target/simdutf/deps/simdutf/simdutf.o' failed
make[2]: *** [/home/iojs/build/workspace/node-test-commit-linux/out/Release/obj.target/simdutf/deps/simdutf/simdutf.o] Error 1
Makefile:134: recipe for target 'node' failed
make[1]: *** [node] Error 2
Makefile:565: recipe for target 'build-ci' failed
Example
fatal: No rebase in progress?
| Reason | ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 3 (https://github.com/nodejs/node/pull/50405/, https://github.com/nodejs/node/pull/50653/, https://github.com/nodejs/node/pull/50890/) |
| Appeared | test-equinix-debian11_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-1, test-equinix-debian11_container-armv7l-2, test-osuosl-ubuntu2004_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56522/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56582/ |
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
[PostBuildScript] - [INFO] Executing post build scripts.
[node-test-binary-armv7l] $ /bin/bash -ex /tmp/jenkins1143784169819737445.sh
+ '[' -d .git ']'
+ git clean -fdx
Removing out/
| Reason | ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for ... |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/50354/, https://github.com/nodejs/node/pull/50115/) |
| Appeared | test-digitalocean-fedora38-x64-2, test-digitalocean-fedora37-x64-1 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56521/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56579/ |
Example
ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for node-test-commit-linux/nodes=fedora-latest-x64 #55614
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
| Reason | error: remote GitHub already exists. |
|---|---|
| Type | BUILD_FAILURE |
| Failed PR | 2 (https://github.com/nodejs/node/pull/50653/, https://github.com/nodejs/node/pull/51290/) |
| Appeared | test-rackspace-win2022_vs2022-x64-2 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56548/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56561/ |
Example
error: remote GitHub already exists.
> git fetch --prune --no-tags GitHub
> git fetch --prune --no-tags https://github.com/nodejs/build.git +refs/heads/main:refs/remotes/jenkins_tmp
Git Failure
| Reason | Failed to delete workspace |
|---|---|
| Type | GIT_FAILURE |
| Failed PR | 5 (https://github.com/nodejs/node/pull/51295/, https://github.com/nodejs/node/pull/50115/, https://github.com/nodejs/node/pull/51309/, https://github.com/nodejs/node/pull/50614/, https://github.com/nodejs/node/pull/49790/) |
| Appeared | test-nearform-macos10.15-x64-3 |
| First CI | https://ci.nodejs.org/job/node-test-pull-request/56573/ |
| Last CI | https://ci.nodejs.org/job/node-test-pull-request/56585/ |
Example
hudson.plugins.git.GitException: Failed to delete workspace
at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$2.execute(CliGitAPIImpl.java:813)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:170)
at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:161)
at hudson.remoting.UserRequest.perform(UserRequest.java:211)
CCTest Failure
Progress
-
parallel/test-whatwg-webstreams-transfer(6) -
async-hooks/test-fsreqcallback-readFile(3) -
parallel/test-inspector-async-stack-traces-set-interval(3) -
parallel/test-assert-esm-cjs-message-verify(2) -
parallel/test-fs-watch-recursive-add-file-to-existing-subfolder(2) -
parallel/test-http-server-request-timeouts-mixed(2) -
pummel/test-fs-readfile-tostring-fail(2) -
sequential/test-worker-fshandles-open-close-on-termination(2) -
Cannot retrieve the node's workspace for hudson.matrix.MatrixProject@78fd291b[node-test-commit-osx]. Most probably the node is offline(2) -
error: The last gc run reported the following. Please correct the root cause(11) -
error: unrecognized command line option '-std=gnu++20'; did you mean '-std=gnu++2a'?(11) -
error: unrecognized command line option ‘-std=gnu++20’; did you mean ‘-std=gnu++2a’?(6) -
fatal: No rebase in progress?(6) -
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?(3) -
ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for ...(2) -
error: remote GitHub already exists.(2) -
Failed to delete workspace(5)
- Dominant language
- Shell
- Stars
- 57
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from nodejs/reliability
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1666 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 25/100
nodejs/reliability#1665 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
nodejs/reliability#1664 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1663 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
nodejs/reliability#1662 ·
All issues in nodejs/reliability
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
community-scripts/ProxmoxVE#17396 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
mattpocock/skills#1099 ·
-
Update Vish to 1.1.5 Openpackage-update
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
oSoWoSo/vOid_Community_repOsitory#144 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
help wanted new command
Difficulty 2/5 1-3 hours Newbie friendliness 72/100
tldr-pages/tldr#24151 ·