nodejs / nodejs/reliability

CI Reliability 2023-02-28

Open
#509 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/49978 to node-test-pull-request/50069 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2023-02-28 00:15 7 5 27 9 52 5.95%
JSTest Failure
Reason parallel/test-http-remove-header-stays-removed
Type JS_TEST_FAILURE
Failed PR 9 (https://github.com/nodejs/node/pull/46770/, https://github.com/nodejs/node/pull/46816/, https://github.com/nodejs/node/pull/46818/, https://github.com/nodejs/node/pull/46838/, https://github.com/nodejs/node/pull/46833/, https://github.com/nodejs/node/pull/46842/, https://github.com/nodejs/node/pull/46742/, https://github.com/nodejs/node/pull/46863/, https://github.com/nodejs/node/pull/46867/)
Appeared test-osuosl-rhel8-ppc64_le-2, test-softlayer-ubuntu1804_sharedlibs_container-x64-3, test-digitalocean-ubuntu1804_sharedlibs_container-x64-10, test-softlayer-ubuntu1804_sharedlibs_container-x64-4, test-softlayer-ubuntu1804_sharedlibs_container-x64-5, test-digitalocean-alpine311_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-5, test-softlayer-alpine312_container-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-9
First CI https://ci.nodejs.org/job/node-test-pull-request/49979/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50068/
Example
not ok 1468 parallel/test-http-remove-header-stays-removed
  ---
  duration_ms: 0.639
  severity: fail
  exitcode: 1
  stack: |-
    ok
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at Timeout._onTimeout (/home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/parallel/test-http-remove-header-stays-removed.js:62:14)
        at listOnTimeout (node:internal/timers:568:17)
        at process.processTimers (node:internal/timers:511:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v20.0.0-pre
  ...


Reason parallel/test-single-executable-application
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/46815/, https://github.com/nodejs/node/pull/46833/, https://github.com/nodejs/node/pull/46832/, https://github.com/nodejs/node/pull/46810/, https://github.com/nodejs/node/pull/46868/)
Appeared test-softlayer-alpine311_container-x64-1, test-digitalocean-alpine312_container-x64-2, test-osuosl-rhel8-ppc64_le-2, test-ibm-rhel8-s390x-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-8, test-azure_msft-win10_vs2019-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/49978/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50057/
Example
not ok 3142 parallel/test-single-executable-application
  ---
  duration_ms: 67.983
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/modules/cjs/loader:1233
        throw err;
        ^
    
    TypeError [ERR_INVALID_ARG_TYPE]: The "code" argument must be of type string. Received undefined
        at new NodeError (node:internal/errors:399:5)
        at validateString (node:internal/validators:163:11)
        at internalCompileFunction (node:internal/vm:32:3)
        at wrapSafe (node:internal/modules/cjs/loader:1207:20)
        at node:internal/main/single_executable_application:28:25 {
      code: 'ERR_INVALID_ARG_TYPE'
    }
    
    Node.js v20.0.0-pre
    node:child_process:924
        throw err;
        ^
    
    Error: Command failed: /home/iojs/node-tmp/.tmp.2466/sea -a --b=c d
    node:internal/modules/cjs/loader:1233
        throw err;
        ^
    
    TypeError [ERR_INVALID_ARG_TYPE]: The "code" argument must be of type string. Received undefined
        at new NodeError (node:inter...

Reason sequential/test-worker-prof
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/46810/, https://github.com/nodejs/node/pull/46742/, https://github.com/nodejs/node/pull/46863/, https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46867/)
Appeared test-nearform-macos11.0-arm64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-1, test-azure_msft-win10_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/50048/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50068/
Example
not ok 3923 sequential/test-worker-prof
  ---
  duration_ms: 0.630
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:399
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: 13 >= 15
        at Object.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/test/sequential/test-worker-prof.js:78:5)
        at Module._compile (node:internal/modules/cjs/loader:1287:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1341:10)
        at Module.load (node:internal/modules/cjs/loader:1145:32)
        at Module._load (node:internal/modules/cjs/loader:984:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:83:12)
        at node:internal/main/run_main_module:23:47 {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: '=='
    }
    
    Node.js v20.0.0-pre
  ...


Reason parallel/test-corepack-yarn-install
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/46742/, https://github.com/nodejs/node/pull/46863/, https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46867/)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/50055/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50062/
Example
not ok 591 parallel/test-corepack-yarn-install
  ---
  duration_ms: 2.557
  severity: fail
  exitcode: 1
  stack: |-
    (node:2447) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
    (Use `node --trace-deprecation ...` to show where the warning was created)
    Segmentation fault (core dumped)
    assert.js:118
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: yarn install got error code 139
        at handleExit (/home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-corepack-yarn-install.js:60:10)
        at handleExit (/home/iojs/build/workspace/node-test-commit-linux-containered/test/common/index.js:380:15)
        at ChildProcess.exithandler (child_process.js:390:5)
        at ChildProcess.emit (events.js:400:28)
        at maybeClose (internal/child_process.js:1088:16)
        at Process.ChildProcess._handle.onex...

Reason parallel/test-http-remove-connection-header-persists-connection
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/46815/, https://github.com/nodejs/node/pull/46816/, https://github.com/nodejs/node/pull/46863/, https://github.com/nodejs/node/pull/46588/)
Appeared test-osuosl-rhel8-ppc64_le-2, test-digitalocean-freebsd12-x64-1, test-digitalocean-ubi81_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-2, test-equinix-ubuntu2004_sharedlibs_container-arm64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/49978/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50065/
Example
not ok 1466 parallel/test-http-remove-connection-header-persists-connection
  ---
  duration_ms: 0.232
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at /home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/parallel/test-http-remove-connection-header-persists-connection.js:67:16
        at Timeout._onTimeout (/home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/parallel/test-http-remove-connection-header-persists-connection.js:54:7)
        at listOnTimeout (node:internal/timers:568:17)
        at process.processTimers (node:internal/timers:511:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v20.0.0-pre
  ...


Reason pummel/test-net-throttle
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/46768/, https://github.com/nodejs/node/pull/46810/, https://github.com/nodejs/node/pull/46817/)
Appeared test-digitalocean-freebsd12-x64-1, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/50001/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50059/
Example
not ok 3542 pummel/test-net-throttle
  ---
  duration_ms: 0.574
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at process.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/pummel/test-net-throttle.js:87:10)
        at process.emit (node:events:522:35) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v20.0.0-pre
  ...


Reason parallel/test-http-request-join-authorization-headers
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46838/, https://github.com/nodejs/node/pull/46365/)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-5, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/50005/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50046/
Example
not ok 1353 parallel/test-http-request-join-authorization-headers
  ---
  duration_ms: 0.299
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    '1, 2' !== '1'
    
        at Server.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-http-request-join-authorization-headers.js:39:12)
        at Server.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux-containered/test/common/index.js:446:15)
        at Server.emit (node:events:513:28)
        at parserOnIncoming (node:_http_server:1072:12)
        at HTTPParser.parserOnHeadersComplete (node:_http_common:119:17) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: '1, 2',
      expected: '1',
      operator: 'strictEqual'
    }
    
    Node.js v18.14.3-pre
  ...


Reason parallel/test-inspector-esm
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46579/, https://github.com/nodejs/node/pull/46790/)
Appeared test-ibm-rhel8-s390x-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/49985/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50051/
Example
not ok 1858 parallel/test-inspector-esm
  ---
  duration_ms: 15.506
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:41361/f9be2b7b-8d9b-4993-9bc4-b24fbfa39e0f
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [test] Verifying debugger stops on start (--inspect-brk option)
    [err] Debugger attached.
    [err] 
    Timed out waiting for matching notification (break on file:///home/iojs/build/workspace/node-test-commit-linuxone/test/fixtures/es-modules/message.mjs:0)
    1
  ...


Reason sequential/test-http-regr-gh-2928
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46838/, https://github.com/nodejs/node/pull/46853/)
Appeared test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/50005/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50039/
Example
not ok 3831 sequential/test-http-regr-gh-2928
  ---
  duration_ms: 120.43
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    .+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.
  ...


Jenkins Failure
Git Failure
Reason warning: failed to remove Release/node.exe: Invalid argument
Type GIT_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/46839/, https://github.com/nodejs/node/pull/46767/, https://github.com/nodejs/node/pull/46768/)
Appeared test-rackspace-win2012r2_vs2015-x64-1, test-azure_msft-win2016_vs2017-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/50020/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50027/
Example
warning: failed to remove Release/node.exe: Invalid argument

Build Failure
Reason error: remote GitHub already exists.
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/46818/, https://github.com/nodejs/node/pull/46815/, https://github.com/nodejs/node/pull/46722/, https://github.com/nodejs/node/pull/46365/, https://github.com/nodejs/node/pull/46790/)
Appeared test-rackspace-win2012r2_vs2017-x64-1, test-rackspace-win2012r2_vs2019-x64-1, test-rackspace-win2012r2_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/49992/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50051/
Example
error: remote GitHub already exists.

> git fetch --prune --no-tags GitHub 

> git fetch --prune --no-tags https://github.com/nodejs/build.git +refs/heads/main:refs/remotes/jenkins_tmp

Reason Error: getWindowSize EINVAL
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/46839/, https://github.com/nodejs/node/pull/46767/, https://github.com/nodejs/node/pull/46330/, https://github.com/nodejs/node/pull/46365/)
Appeared test-equinix_mnx-smartos20-x64-3, test-equinix_mnx-smartos20-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/50020/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50050/
Example
Error: getWindowSize EINVAL
outline =     at WriteStream._refreshSize (node:tty:132:31)
outline =     at process.refreshStderrOnSigWinch (node:internal/bootstrap/switches/is_main_thread:137:10)
outline =     at process.emit (node:events:525:35)
outline = Emitted 'error' event on WriteStream instance at:
outline =     at WriteStream._refreshSize (node:tty:132:10)

Reason fatal error: ld terminated with signal 9 [Killed]
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/46768/, https://github.com/nodejs/node/pull/46838/, https://github.com/nodejs/node/pull/46833/, https://github.com/nodejs/node/pull/46842/)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-8
First CI https://ci.nodejs.org/job/node-test-pull-request/50001/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50009/
Example
fatal error: ld terminated with signal 9 [Killed]

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46599/, https://github.com/nodejs/node/pull/41439/)
Appeared test-equinix_mnx-smartos20-x64-3, test-osuosl-aix72-ppc64_be-3, test-equinix-debian10_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-1, test-osuosl-debian10_container-armv7l-1, test-osuosl-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/50047/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50069/
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

Reason Failed to trigger sub builds
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46664/, https://github.com/nodejs/node/pull/46579/)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/50031/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50064/
Example
Failed to trigger sub builds

undefined
Reason Unknown
Type undefined
Failed PR 10 (https://github.com/nodejs/node/pull/46839/, https://github.com/nodejs/node/pull/46767/, https://github.com/nodejs/node/pull/46768/, https://github.com/nodejs/node/pull/46832/, https://github.com/nodejs/node/pull/46812/, https://github.com/nodejs/node/pull/46810/, https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46867/, https://github.com/nodejs/node/pull/46588/, https://github.com/nodejs/node/pull/41439/)
Appeared test-nearform_arm-win10_vs2019-arm64-2, test-nearform_arm-win10_vs2019-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/50020/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50069/
Example
Unknown

Progress
  • parallel/test-http-remove-header-stays-removed (9)
  • parallel/test-single-executable-application (5)
  • sequential/test-worker-prof (5)
  • parallel/test-corepack-yarn-install (4)
  • parallel/test-http-remove-connection-header-persists-connection (4)
  • pummel/test-net-throttle (3)
  • parallel/test-http-request-join-authorization-headers (2)
  • parallel/test-inspector-esm (2)
  • sequential/test-http-regr-gh-2928 (2)
  • warning: failed to remove Release/node.exe: Invalid argument (3)
  • error: remote GitHub already exists. (5)
  • Error: getWindowSize EINVAL (4)
  • fatal error: ld terminated with signal 9 [Killed] (4)
  • ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? (2)
  • Failed to trigger sub builds (2)
  • Unknown (10)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the failing tests named in the report, including test/parallel/test-http-remove-header-stays-removed.js, test/parallel/test-single-executable-application.js, test/sequential/test-worker-prof.js, and test/parallel/test-corepack-yarn-install.js. Reproduce the failures using the linked CI jobs and identify the causes across the affected platforms. Done means the reported failures are addressed and the relevant CI runs are green.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js
Domain
ci-cd, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.