nodejs / nodejs/reliability

CI Reliability 2022-10-20

Open
#405 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/47254 to node-test-pull-request/47350 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2022-10-20 00:21 1 15 26 6 52 16.13%
Jenkins Failure
Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/44950/, https://github.com/nodejs/node/pull/45046/, https://github.com/nodejs/node/pull/45026/)
Appeared test-digitalocean-freebsd12-x64-2, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/47285/
Last CI https://ci.nodejs.org/job/node-test-pull-request/47327/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 107.170.28.213/107.170.28.213:40160' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at jdk.proxy2/jdk.proxy2.$Proxy92.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)

Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/45032/, https://github.com/nodejs/node/pull/45046/, https://github.com/nodejs/node/pull/45026/)
Appeared test-softlayer-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/47291/
Last CI https://ci.nodejs.org/job/node-test-pull-request/47327/
Example
Build timed out (after 60 minutes). Marking the build as failed.

Git Failure
Build Failure
Reason error: remote GitHub already exists.
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/44250/, https://github.com/nodejs/node/pull/45058/)
Appeared test-rackspace-win2012r2_vs2017-x64-1, test-rackspace-win2012r2_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/47257/
Last CI https://ci.nodejs.org/job/node-test-pull-request/47330/
Example
error: remote GitHub already exists.

> git fetch --prune --no-tags GitHub 
From https://github.com/nodejs/build
 * [new branch]      windows-flaky-tests -> GitHub/windows-flaky-tests

JSTest Failure
Reason pummel/test-fs-readfile-tostring-fail
Type JS_TEST_FAILURE
Failed PR 10 (https://github.com/nodejs/node/pull/44250/, https://github.com/nodejs/node/pull/44970/, https://github.com/nodejs/node/pull/45043/, https://github.com/nodejs/node/pull/45058/, https://github.com/nodejs/node/pull/45046/, https://github.com/nodejs/node/pull/41276/, https://github.com/nodejs/node/pull/43716/, https://github.com/nodejs/node/pull/45068/, https://github.com/nodejs/node/pull/45026/, https://github.com/nodejs/node/pull/45061/)
Appeared test-orka-macos11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/47266/
Last CI https://ci.nodejs.org/job/node-test-pull-request/47350/
Example
not ok 3407 pummel/test-fs-readfile-tostring-fail
  ---
  duration_ms: 0.127
  severity: fail
  exitcode: 7
  stack: |-
    /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/pummel/test-fs-readfile-tostring-fail.js:73
      throw err;
      ^
    
    AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOSPC: no space left on device, write
        at Object.callback (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/pummel/test-fs-readfile-tostring-fail.js:31:37)
        at callback (node:internal/streams/writable:555:21)
        at onwriteError (node:internal/streams/writable:418:3)
        at onwrite (node:internal/streams/writable:460:7)
        at node:internal/fs/streams:439:14
        at FSReqCallback.wrapper [as oncomplete] (node:fs:946:5) {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: [Error: ENOSPC: no space left on device, write] {
        errno: -28,
        code: 'ENOSPC',
        syscall: 'write'
      },
      expe...

Reason sequential/test-watch-mode-inspect
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/44968/, https://github.com/nodejs/node/pull/44250/, https://github.com/nodejs/node/pull/45041/, https://github.com/nodejs/node/pull/45045/, https://github.com/nodejs/node/pull/41276/)
Appeared test-nearform-macos10.15-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/47263/
Last CI https://ci.nodejs.org/job/node-test-pull-request/47336/
Example
not ok 3804 sequential/test-watch-mode-inspect
  ---
  duration_ms: 120.94
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    [test] Connecting to a child Node process
    [test] Testing /json/list
    TAP version 13
    [err] (node:23416) ExperimentalWarning: Watch mode is an experimental feature. This feature could change at any time
    [err] (Use `node --trace-warnings ...` to show where the warning was created)
    [err] 
    [err] Debugger listening on ws://127.0.0.1:58845/b9017f08-ecdb-485a-a05e-bf9f2f4d52ba
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [err] Debugger attached.
    [err] 
    [out] safe to debug now
    [out] 
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger ending on ws://127.0.0.1:58845/b9017f08-ecdb-485a-a05e-bf9f2f4d52ba
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
  ...


Reason abort/test-addon-uv-handle-leak
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/44626/, https://github.com/nodejs/node/pull/43716/)
Appeared test-joyent-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/47300/
Last CI https://ci.nodejs.org/job/node-test-pull-request/47340/
Example
not ok 3646 abort/test-addon-uv-handle-leak
  ---
  duration_ms: 300.91
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason addons/request-interrupt/test
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/45000/, https://github.com/nodejs/node/pull/45076/)
Appeared test-joyent-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/47275/
Last CI https://ci.nodejs.org/job/node-test-pull-request/47344/
Example
not ok 3411 addons/request-interrupt/test
  ---
  duration_ms: 300.141
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-child-process-exec-timeout-kill
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/44626/, https://github.com/nodejs/node/pull/45046/)
Appeared test-digitalocean-freebsd12-x64-2, test-digitalocean-freebsd12-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/47300/
Last CI https://ci.nodejs.org/job/node-test-pull-request/47312/
Example
not ok 398 parallel/test-child-process-exec-timeout-kill
  ---
  duration_ms: 0.313
  severity: fail
  exitcode: 1
  stack: |-
    [stdout] 
    [stderr] 
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    1 !== null
    
        at /usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/parallel/test-child-process-exec-timeout-kill.js:32:10
        at /usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/common/index.js:448:15
        at ChildProcess.exithandler (node:child_process:427:5)
        at ChildProcess.emit (node:events:513:28)
        at maybeClose (node:internal/child_process:1098:16)
        at Socket.<anonymous> (node:internal/child_process:456:11)
        at Socket.emit (node:events:513:28)
        at Pipe.<anonymous> (node:net:298:12) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 1,
      expected: null,
      op...

Reason sequential/test-perf-hooks
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/44626/, https://github.com/nodejs/node/pull/45042/)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/47298/
Last CI https://ci.nodejs.org/job/node-test-pull-request/47301/
Example
not ok 3796 sequential/test-perf-hooks
  ---
  duration_ms: 1.913
  severity: fail
  exitcode: 1
  stack: |-
    {
      name: 'node',
      entryType: 'node',
      startTime: 0,
      duration: { around: 34.9045524597168 },
      nodeStart: { around: 0 },
      v8Start: { around: 0 },
      bootstrapComplete: { around: 34.8656005859375, delay: 2500 },
      environment: { around: 0 },
      loopStart: -1,
      loopExit: -1
    }
    {
      name: 'node',
      entryType: 'node',
      startTime: 0,
      duration: { around: 1039.352783203125 },
      nodeStart: { around: 0 },
      v8Start: { around: 0 },
      bootstrapComplete: { around: 34.8656005859375, delay: 2500 },
      environment: { around: 0 },
      loopStart: { around: 34.8656005859375, delay: 2500 },
      loopExit: -1
    }
    {
      name: 'node',
      entryType: 'node',
      startTime: 0,
      duration: { around: 1758.757698059082 },
      nodeStart: { around: 0 },
      v8Start: { around: 0 },
      bootstrapComplete: { around: 34.865...

Reason wasi/test-wasi
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/44862/, https://github.com/nodejs/node/pull/45032/)
Appeared test-osuosl-aix72-ppc64_be-3
First CI https://ci.nodejs.org/job/node-test-pull-request/47269/
Last CI https://ci.nodejs.org/job/node-test-pull-request/47291/
Example
not ok 3393 wasi/test-wasi
  ---
  duration_ms: 0.978
  severity: fail
  exitcode: 1
  stack: |-
    executing cant_dotdot
    (node:6226428) ExperimentalWarning: WASI is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69720)
    fd_prestat_dir_name(3, 131088, 9)
    fd_prestat_get(4, 69720)
    fd_prestat_dir_name(4, 131152, 5)
    fd_prestat_get(5, 69720)
    environ_sizes_get(69724, 69720)
    environ_get(135168, 131168)
    fd_fdstat_get(3, 69672)
    path_open(3, 1, 1033, 14, 0, 264240830, 268435455, 0, 69668)
    
    executing clock_getres
    (node:6226430) ExperimentalWarning: WASI is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69688)
    fd_prestat_dir_name(3, 131088, 9)
    fd_prestat_get(4, 69688)
    fd_prestat_dir_name(4, 131152, 5)
    fd_prestat_get(5, 69688)
    envi...

Progress
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (3)
  • Build timed out (after 60 minutes). Marking the build as failed. (3)
  • error: remote GitHub already exists. (2)
  • pummel/test-fs-readfile-tostring-fail (10)
  • sequential/test-watch-mode-inspect (5)
  • abort/test-addon-uv-handle-leak (2)
  • addons/request-interrupt/test (2)
  • parallel/test-child-process-exec-timeout-kill (2)
  • sequential/test-perf-hooks (2)
  • wasi/test-wasi (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the generated ncu-ci walk pr report and the linked Jenkins console logs, then inspect the named test entry points: test/pummel/test-fs-readfile-tostring-fail.js, test/sequential/test-watch-mode-inspect, test/abort/test-addon-uv-handle-leak, test/addons/request-interrupt/test, test/parallel/test-child-process-exec-timeout-kill.js, and test/sequential/test-perf-hooks. Reproduce the failures on the reported workers and identify which failures are actionable; done means the recurring CI failures have a documented cause and a verified fix or mitigation.

Written by the indexing model from the issue text.

Assessment

Tech stack
git, node.js, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.