nodejs / nodejs/reliability

CI Reliability 2022-09-20

Open
#384 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/46565 to node-test-pull-request/46663 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2022-09-20 00:21 0 17 23 4 56 17.71%
JSTest Failure
Reason pummel/test-fs-readfile-tostring-fail
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/44683/, https://github.com/nodejs/node/pull/44677/, https://github.com/nodejs/node/pull/44561/, https://github.com/nodejs/node/pull/44682/, https://github.com/nodejs/node/pull/44680/)
Appeared test-digitalocean-fedora34-x64-2, test-digitalocean-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46630/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46643/
Example
not ok 3390 pummel/test-fs-readfile-tostring-fail
  ---
  duration_ms: 0.811
  severity: fail
  exitcode: 7
  stack: |-
    /home/iojs/build/workspace/node-test-commit-linux/test/pummel/test-fs-readfile-tostring-fail.js:73
      throw err;
      ^
    
    AssertionError [ERR_ASSERTION]: 490655744 bytes written (expected 539555154 bytes).
        at WriteStream.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux/test/pummel/test-fs-readfile-tostring-fail.js:37:10)
        at WriteStream.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux/test/common/index.js:446:15)
        at WriteStream.emit (node:events:513:28)
        at finish (node:internal/streams/writable:750:10)
        at finishMaybe (node:internal/streams/writable:735:9)
        at afterWrite (node:internal/streams/writable:507:3)
        at onwrite (node:internal/streams/writable:480:7)
        at node:internal/fs/streams:443:5
        at FSReqCallback.wrapper [as oncomplete] (node:fs:941:5) {
      generatedMessage: false,
 ...

Reason parallel/test-watch-mode
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/44633/, https://github.com/nodejs/node/pull/44618/, https://github.com/nodejs/node/pull/44571/, https://github.com/nodejs/node/pull/44680/)
Appeared test-ibm-rhel8-s390x-2, test-osuosl-aix72-ppc64_be-3, test-ibm-rhel8-s390x-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/46573/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46643/
Example
not ok 3387 parallel/test-watch-mode
  ---
  duration_ms: 120.44
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    TAP version 13
    # Subtest: watch mode
        # Subtest: should watch changes to a file - event loop ended
        ok 1 - should watch changes to a file - event loop ended
          ---
          duration_ms: 231.57343
          ...


Reason node-api/test_fatal/test2
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/44635/, https://github.com/nodejs/node/pull/44637/, https://github.com/nodejs/node/pull/44561/)
Appeared test-joyent-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/46575/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46640/
Example
not ok 3584 node-api/test_fatal/test2
  ---
  duration_ms: 300.155
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason abort/test-addon-uv-handle-leak
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/44580/, https://github.com/nodejs/node/pull/44621/)
Appeared test-joyent-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/46574/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46623/
Example
not ok 3627 abort/test-addon-uv-handle-leak
  ---
  duration_ms: 300.102
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason addons/report-fatalerror/test
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/44678/, https://github.com/nodejs/node/pull/44686/)
Appeared test-joyent-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/46638/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46663/
Example
not ok 3458 addons/report-fatalerror/test
  ---
  duration_ms: 300.66
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-fs-readfile
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/42835/, https://github.com/nodejs/node/pull/42083/)
Appeared test-rackspace-win2012r2_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/46584/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46590/
Example
not ok 273 parallel/test-fs-readfile
  ---
  duration_ms: 0.973
  severity: fail
  exitcode: 1
  stack: |-
    Can't clean tmpdir: C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.264
    Files blocking: [
      '.removeme-fs-readfile-4860-1K.txt',
      '.removeme-fs-readfile-4860-1M.txt',
      '.removeme-fs-readfile-4860-1MPlusOne.txt',
      '.removeme-fs-readfile-4860-64K.txt',
      '.removeme-fs-readfile-4860-64KLessOne.txt'
    ]
    
    node:internal/fs/utils:347
        throw err;
        ^
    
    Error: ENOSPC: no space left on device, ftruncate
        at Object.ftruncateSync (node:fs:1126:3)
        at Object.truncateSync (node:fs:1085:14)
        at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-fs-readfile.js:61:6)
        at Module._compile (node:internal/modules/cjs/loader:1129:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1183:10)
        at Module.load (node:internal/modules/cjs/loader:1007:32)
        a...

Reason parallel/test-runner-inspect
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/44635/, https://github.com/nodejs/node/pull/44707/)
Appeared test-ibm-rhel8-s390x-4, test-azure_msft-win10_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/46575/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46648/
Example
not ok 3387 parallel/test-runner-inspect
  ---
  duration_ms: 120.97
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] (node:4009003) Warning: Using the inspector with --test forces running at a concurrency of 1. Use the inspectPort option to run with concurrency
    [err] (Use `node --trace-warnings ...` to show where the warning was created)
    [err] 
    [out] TAP version 13
    [out] 
    [err] Debugger listening on ws://127.0.0.1:41309/aa56a18b-cbc0-46f7-8182-9b85fe06aa39
    [err] 
    [err] Debugger attached.
    [err] 
  ...


Jenkins Failure
Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/44348/, https://github.com/nodejs/node/pull/44579/, https://github.com/nodejs/node/pull/42083/, https://github.com/nodejs/node/pull/44580/, https://github.com/nodejs/node/pull/44621/, https://github.com/nodejs/node/pull/44675/, https://github.com/nodejs/node/pull/44704/)
Appeared test-digitalocean-freebsd12-x64-2, test-orka-macos10.15-x64-1, test-orka-macos11-x64-2, test-azure_msft-win10_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/46571/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46645/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 107.170.28.213/107.170.28.213:26374' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at jdk.proxy2/jdk.proxy2.$Proxy88.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)

Reason Build timed out (after 15 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/44606/, https://github.com/nodejs/node/pull/42083/, https://github.com/nodejs/node/pull/44619/)
Appeared test-joyent-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/46565/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46636/
Example
Build timed out (after 15 minutes). Marking the build as failed.

Reason Cannot read file /home/iojs/.config/jgit/config
Type JENKINS_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/44580/, https://github.com/nodejs/node/pull/44632/)
Appeared test-osuosl-aix72-ppc64_be-2
First CI https://ci.nodejs.org/job/node-test-pull-request/46578/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46582/
Example
java.io.IOException: Cannot read file /home/iojs/.config/jgit/config
 > git rev-list --no-walk 20ccab19d56b69ebd221d89b4f29b7710e45393b # timeout=30
First time build. Skipping changelog.
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=30
Resetting working tree

Build Failure
Reason sh: line 3: ./build/jenkins/scripts/node-test-commit-diagnostics.sh: No such file or directory
Type BUILD_FAILURE
Failed PR 10 (https://github.com/nodejs/node/pull/44580/, https://github.com/nodejs/node/pull/39392/, https://github.com/nodejs/node/pull/44639/, https://github.com/nodejs/node/pull/42083/, https://github.com/nodejs/node/pull/44640/, https://github.com/nodejs/node/pull/44637/, https://github.com/nodejs/node/pull/42835/, https://github.com/nodejs/node/pull/44635/, https://github.com/nodejs/node/pull/44624/, https://github.com/nodejs/node/pull/44537/)
Appeared test-osuosl-aix72-ppc64_be-3
First CI https://ci.nodejs.org/job/node-test-pull-request/46574/
Last CI https://ci.nodejs.org/job/node-test-pull-request/46587/
Example
sh: line 3: ./build/jenkins/scripts/node-test-commit-diagnostics.sh: No such file or directory

Progress
  • pummel/test-fs-readfile-tostring-fail (5)
  • parallel/test-watch-mode (4)
  • node-api/test_fatal/test2 (3)
  • abort/test-addon-uv-handle-leak (2)
  • addons/report-fatalerror/test (2)
  • parallel/test-fs-readfile (2)
  • parallel/test-runner-inspect (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (7)
  • Build timed out (after 15 minutes). Marking the build as failed. (3)
  • Cannot read file /home/iojs/.config/jgit/config (2)
  • sh: line 3: ./build/jenkins/scripts/node-test-commit-diagnostics.sh: No such file or directory (10)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the generated ncu-ci walk pr --stats=true report and the linked Jenkins logs. Review the named tests, including pummel/test-fs-readfile-tostring-fail, parallel/test-watch-mode, node-api/test_fatal/test2, and parallel/test-fs-readfile, along with the affected CI machines. Done requires diagnosing and resolving or explicitly triaging the repeated test and infrastructure failures, then confirming the relevant CI jobs are reliable.

Written by the indexing model from the issue text.

Assessment

Tech stack
node.js, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.