nodejs / nodejs/reliability

CI Reliability 2023-03-01

Open
#510 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/50020 to node-test-pull-request/50111 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2023-03-01 00:18 0 5 27 6 62 5.32%
CCTest Failure
Jenkins Failure
Git Failure
Reason warning: failed to remove Release/node.exe: Invalid argument
Type GIT_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/46839/, https://github.com/nodejs/node/pull/46767/, https://github.com/nodejs/node/pull/46768/)
Appeared test-rackspace-win2012r2_vs2015-x64-1, test-azure_msft-win2016_vs2017-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/50020/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50027/
Example
warning: failed to remove Release/node.exe: Invalid argument

Build Failure
Reason Error: getWindowSize EINVAL
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/46767/, https://github.com/nodejs/node/pull/46330/, https://github.com/nodejs/node/pull/46365/, https://github.com/nodejs/node/pull/46839/)
Appeared test-equinix_mnx-smartos20-x64-3, test-equinix_mnx-smartos20-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/50040/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50085/
Example
Error: getWindowSize EINVAL
outline =     at WriteStream._refreshSize (node:tty:132:31)
outline =     at process.refreshStderrOnSigWinch (node:internal/bootstrap/switches/is_main_thread:137:10)
outline =     at process.emit (node:events:525:35)
outline = Emitted 'error' event on WriteStream instance at:
outline =     at WriteStream._refreshSize (node:tty:132:10)

Reason error: remote GitHub already exists.
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/46365/, https://github.com/nodejs/node/pull/46790/, https://github.com/nodejs/node/pull/46878/)
Appeared test-rackspace-win2012r2_vs2017-x64-1, test-rackspace-win2012r2_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/50046/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50094/
Example
error: remote GitHub already exists.

> git fetch --prune --no-tags GitHub 
From https://github.com/nodejs/node
   d610096dcb..7a37829ccb  main       -> GitHub/main

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46599/, https://github.com/nodejs/node/pull/41439/)
Appeared test-equinix_mnx-smartos20-x64-3, test-osuosl-aix72-ppc64_be-3, test-equinix-debian10_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-1, test-osuosl-debian10_container-armv7l-1, test-osuosl-ubuntu2004_container-armv7l-1, test-osuosl-aix72-ppc64_be-4
First CI https://ci.nodejs.org/job/node-test-pull-request/50083/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50107/
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

Reason Failed to trigger sub builds
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46664/, https://github.com/nodejs/node/pull/46579/)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/50031/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50064/
Example
Failed to trigger sub builds

Reason Makefile:1499: recipe for target 'tools/.cpplintstamp' failed
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46658/)
Appeared test-ibm-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/50077/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50104/
Example
Makefile:1499: recipe for target 'tools/.cpplintstamp' failed
make: *** [tools/.cpplintstamp] Error 1
+ cat test-eslint.tap
+ grep -v '^ok\|^TAP version 13\|^1\.\.'
+ sed '/^\s*$/d'
+ exit 1

undefined
Reason Unknown
Type undefined
Failed PR 16 (https://github.com/nodejs/node/pull/46839/, https://github.com/nodejs/node/pull/46767/, https://github.com/nodejs/node/pull/46768/, https://github.com/nodejs/node/pull/46810/, https://github.com/nodejs/node/pull/46867/, https://github.com/nodejs/node/pull/46588/, https://github.com/nodejs/node/pull/46831/, https://github.com/nodejs/node/pull/46812/, https://github.com/nodejs/node/pull/46809/, https://github.com/nodejs/node/pull/46832/, https://github.com/nodejs/node/pull/46672/, https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46658/, https://github.com/nodejs/node/pull/46742/, https://github.com/nodejs/node/pull/41439/, https://github.com/nodejs/node/pull/46825/)
Appeared test-nearform_arm-win10_vs2019-arm64-2, test-nearform_arm-win10_vs2019-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/50020/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50111/
Example
Unknown

JSTest Failure
Reason sequential/test-worker-prof
Type JS_TEST_FAILURE
Failed PR 9 (https://github.com/nodejs/node/pull/46810/, https://github.com/nodejs/node/pull/46863/, https://github.com/nodejs/node/pull/46867/, https://github.com/nodejs/node/pull/46831/, https://github.com/nodejs/node/pull/46832/, https://github.com/nodejs/node/pull/46742/, https://github.com/nodejs/node/pull/46672/, https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46658/)
Appeared test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win10_vs2019-x64-3, test-digitalocean-ubuntu1804_sharedlibs_container-x64-1, test-rackspace-win2012r2_vs2013-x64-1, test-nearform-macos11.0-arm64-1, test-azure_msft-win10_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/50048/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50104/
Example
not ok 929 sequential/test-worker-prof
  ---
  duration_ms: 1.253
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: child exited with non-zero status:                      {
      status: 3221226505,
      signal: null,
      output: [ null, '', '' ],
      pid: 4608,
      stdout: '',
      stderr: ''
    }
        at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\sequential\test-worker-prof.js:61:10)
        at Module._compile (node:internal/modules/cjs/loader:1287:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1341:10)
        at Module.load (node:internal/modules/cjs/loader:1145:32)
        at Module._load (node:internal/modules/cjs/loader:984:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:83:12)
        at node:internal/main/run_main_module:23:47 {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
 ...

Reason pummel/test-net-throttle
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/46810/, https://github.com/nodejs/node/pull/46831/, https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46872/, https://github.com/nodejs/node/pull/46884/, https://github.com/nodejs/node/pull/46672/)
Appeared test-digitalocean-freebsd12-x64-1, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/50048/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50102/
Example
not ok 3544 pummel/test-net-throttle
  ---
  duration_ms: 0.549
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at process.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/pummel/test-net-throttle.js:87:10)
        at process.emit (node:events:522:35) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v20.0.0-pre
  ...


Reason parallel/test-corepack-yarn-install
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/46863/, https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46867/, https://github.com/nodejs/node/pull/46831/, https://github.com/nodejs/node/pull/46742/)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/50056/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50091/
Example
not ok 591 parallel/test-corepack-yarn-install
  ---
  duration_ms: 2.557
  severity: fail
  exitcode: 1
  stack: |-
    (node:2447) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
    (Use `node --trace-deprecation ...` to show where the warning was created)
    Segmentation fault (core dumped)
    assert.js:118
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: yarn install got error code 139
        at handleExit (/home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-corepack-yarn-install.js:60:10)
        at handleExit (/home/iojs/build/workspace/node-test-commit-linux-containered/test/common/index.js:380:15)
        at ChildProcess.exithandler (child_process.js:390:5)
        at ChildProcess.emit (events.js:400:28)
        at maybeClose (internal/child_process.js:1088:16)
        at Process.ChildProcess._handle.onex...

Reason parallel/test-http-remove-header-stays-removed
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/46863/, https://github.com/nodejs/node/pull/46867/, https://github.com/nodejs/node/pull/46831/, https://github.com/nodejs/node/pull/46742/, https://github.com/nodejs/node/pull/46817/)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-6, test-softlayer-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubi81_container-x64-1, test-osuosl-rhel8-ppc64_le-2, test-softlayer-ubuntu1804_sharedlibs_container-x64-3, test-digitalocean-ubuntu1804_sharedlibs_container-x64-10
First CI https://ci.nodejs.org/job/node-test-pull-request/50056/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50101/
Example
not ok 1372 parallel/test-http-remove-header-stays-removed
  ---
  duration_ms: 0.232
  severity: fail
  exitcode: 1
  stack: |-
    ok
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at Timeout._onTimeout (/home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-http-remove-header-stays-removed.js:62:14)
        at listOnTimeout (node:internal/timers:573:17)
        at process.processTimers (node:internal/timers:514:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v20.0.0-pre
  ...


Reason parallel/test-http-remove-connection-header-persists-connection
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/46863/, https://github.com/nodejs/node/pull/46588/, https://github.com/nodejs/node/pull/46878/, https://github.com/nodejs/node/pull/46884/)
Appeared test-digitalocean-freebsd12-x64-1, test-equinix-ubuntu2004_container-armv7l-2, test-osuosl-rhel8-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/50056/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50100/
Example
not ok 1268 parallel/test-http-remove-connection-header-persists-connection
  ---
  duration_ms: 0.665
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at /usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/parallel/test-http-remove-connection-header-persists-connection.js:67:16
        at Timeout._onTimeout (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/parallel/test-http-remove-connection-header-persists-connection.js:54:7)
        at listOnTimeout (node:internal/timers:573:17)
        at process.processTimers (node:internal/timers:514:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v20.0.0-pre
  ...


Reason parallel/test-inspector-esm
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/46790/, https://github.com/nodejs/node/pull/46832/, https://github.com/nodejs/node/pull/46855/)
Appeared test-osuosl-rhel8-ppc64_le-2, test-ibm-rhel8-s390x-1, test-ibm-rhel8-s390x-4
First CI https://ci.nodejs.org/job/node-test-pull-request/50051/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50110/
Example
not ok 2053 parallel/test-inspector-esm
  ---
  duration_ms: 15.380
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:36041/ec344faf-232b-4481-81bf-32de56ad6989
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [test] Verifying debugger stops on start (--inspect-brk option)
    [err] Debugger attached.
    [err] 
    Timed out waiting for matching notification (break on file:///home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/fixtures/es-modules/message.mjs:0)
    1
  ...


Reason parallel/test-single-executable-application
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/46832/, https://github.com/nodejs/node/pull/46810/, https://github.com/nodejs/node/pull/46868/)
Appeared test-softlayer-alpine311_container-x64-1, test-digitalocean-alpine312_container-x64-2, test-ibm-rhel8-s390x-4, test-osuosl-rhel8-ppc64_le-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-8, test-azure_msft-win10_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/50036/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50103/
Example
not ok 3181 parallel/test-single-executable-application
  ---
  duration_ms: 73.209
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/modules/cjs/loader:1233
        throw err;
        ^
    
    TypeError [ERR_INVALID_ARG_TYPE]: The "code" argument must be of type string. Received undefined
        at new NodeError (node:internal/errors:399:5)
        at validateString (node:internal/validators:163:11)
        at internalCompileFunction (node:internal/vm:32:3)
        at wrapSafe (node:internal/modules/cjs/loader:1207:20)
        at node:internal/main/single_executable_application:28:25 {
      code: 'ERR_INVALID_ARG_TYPE'
    }
    
    Node.js v20.0.0-pre
    node:child_process:924
        throw err;
        ^
    
    Error: Command failed: /home/iojs/node-tmp/.tmp.2466/sea -a --b=c d
    node:internal/modules/cjs/loader:1233
        throw err;
        ^
    
    TypeError [ERR_INVALID_ARG_TYPE]: The "code" argument must be of type string. Received undefined
        at new NodeError (node:inter...

Reason sequential/test-child-process-pass-fd
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46832/)
Appeared test-macstadium-macos11.0-arm64-3, test-macstadium-macos11.0-arm64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/50077/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50089/
Example
not ok 3774 sequential/test-child-process-pass-fd
  ---
  duration_ms: 0.337
  severity: crashed
  exitcode: -10
  stack: |-
  ...


Progress
  • warning: failed to remove Release/node.exe: Invalid argument (3)
  • Error: getWindowSize EINVAL (4)
  • error: remote GitHub already exists. (3)
  • ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? (2)
  • Failed to trigger sub builds (2)
  • Makefile:1499: recipe for target 'tools/.cpplintstamp' failed (2)
  • Unknown (16)
  • sequential/test-worker-prof (9)
  • pummel/test-net-throttle (6)
  • parallel/test-corepack-yarn-install (5)
  • parallel/test-http-remove-header-stays-removed (5)
  • parallel/test-http-remove-connection-header-persists-connection (4)
  • parallel/test-inspector-esm (3)
  • parallel/test-single-executable-application (3)
  • sequential/test-child-process-pass-fd (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the generated report and the linked node-test-pull-request CI logs, then inspect the named test entries such as test/sequential/test-worker-prof.js and test/pummel/test-net-throttle.js. The report groups several unrelated failures and does not define a specific change or completion criterion, so further investigation would be needed before work can be considered done.

Written by the indexing model from the issue text.

Assessment

Tech stack
git, javascript, node.js, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.