nodejs / nodejs/reliability

CI Reliability 2023-03-02

Open
#511 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/50042 to node-test-pull-request/50140 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2023-03-02 00:17 0 5 30 1 64 5.05%
JSTest Failure
Reason sequential/test-worker-prof
Type JS_TEST_FAILURE
Failed PR 9 (https://github.com/nodejs/node/pull/46810/, https://github.com/nodejs/node/pull/46863/, https://github.com/nodejs/node/pull/46867/, https://github.com/nodejs/node/pull/46831/, https://github.com/nodejs/node/pull/46832/, https://github.com/nodejs/node/pull/46742/, https://github.com/nodejs/node/pull/46672/, https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46658/)
Appeared test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win10_vs2019-x64-3, test-digitalocean-ubuntu1804_sharedlibs_container-x64-1, test-rackspace-win2012r2_vs2013-x64-1, test-nearform-macos11.0-arm64-1, test-azure_msft-win10_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/50048/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50104/
Example
not ok 929 sequential/test-worker-prof
  ---
  duration_ms: 1.253
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: child exited with non-zero status:                      {
      status: 3221226505,
      signal: null,
      output: [ null, '', '' ],
      pid: 4608,
      stdout: '',
      stderr: ''
    }
        at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\sequential\test-worker-prof.js:61:10)
        at Module._compile (node:internal/modules/cjs/loader:1287:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1341:10)
        at Module.load (node:internal/modules/cjs/loader:1145:32)
        at Module._load (node:internal/modules/cjs/loader:984:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:83:12)
        at node:internal/main/run_main_module:23:47 {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
 ...

Reason parallel/test-http-remove-header-stays-removed
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/46863/, https://github.com/nodejs/node/pull/46867/, https://github.com/nodejs/node/pull/46831/, https://github.com/nodejs/node/pull/46742/, https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46872/, https://github.com/nodejs/node/pull/46860/)
Appeared test-softlayer-ubuntu1804_sharedlibs_container-x64-5, test-digitalocean-ubuntu1804_sharedlibs_container-x64-6, test-softlayer-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubi81_container-x64-1, test-osuosl-rhel8-ppc64_le-2, test-softlayer-ubuntu1804_sharedlibs_container-x64-3, test-digitalocean-ubuntu1804_sharedlibs_container-x64-10
First CI https://ci.nodejs.org/job/node-test-pull-request/50056/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50120/
Example
not ok 1441 parallel/test-http-remove-header-stays-removed
  ---
  duration_ms: 0.220
  severity: fail
  exitcode: 1
  stack: |-
    ok
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at Timeout._onTimeout (/home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-http-remove-header-stays-removed.js:62:14)
        at listOnTimeout (node:internal/timers:573:17)
        at process.processTimers (node:internal/timers:514:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v20.0.0-pre
  ...


Reason parallel/test-corepack-yarn-install
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/46863/, https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46867/, https://github.com/nodejs/node/pull/46831/, https://github.com/nodejs/node/pull/46742/, https://github.com/nodejs/node/pull/41439/)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/50056/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50135/
Example
not ok 591 parallel/test-corepack-yarn-install
  ---
  duration_ms: 2.617
  severity: fail
  exitcode: 1
  stack: |-
    (node:3074) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
    (Use `node --trace-deprecation ...` to show where the warning was created)
    Segmentation fault (core dumped)
    assert.js:118
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: yarn install got error code 139
        at handleExit (/home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-corepack-yarn-install.js:60:10)
        at handleExit (/home/iojs/build/workspace/node-test-commit-linux-containered/test/common/index.js:380:15)
        at ChildProcess.exithandler (child_process.js:390:5)
        at ChildProcess.emit (events.js:400:28)
        at maybeClose (internal/child_process.js:1088:16)
        at Socket.<anonymous> (internal/chil...

Reason pummel/test-net-throttle
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/46810/, https://github.com/nodejs/node/pull/46831/, https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46872/, https://github.com/nodejs/node/pull/46884/, https://github.com/nodejs/node/pull/46672/)
Appeared test-digitalocean-freebsd12-x64-1, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/50048/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50102/
Example
not ok 3544 pummel/test-net-throttle
  ---
  duration_ms: 0.549
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at process.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/pummel/test-net-throttle.js:87:10)
        at process.emit (node:events:522:35) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v20.0.0-pre
  ...


Reason parallel/test-http-remove-connection-header-persists-connection
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/46863/, https://github.com/nodejs/node/pull/46588/, https://github.com/nodejs/node/pull/46878/, https://github.com/nodejs/node/pull/46884/)
Appeared test-digitalocean-freebsd12-x64-1, test-equinix-ubuntu2004_container-armv7l-2, test-osuosl-rhel8-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/50056/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50100/
Example
not ok 1268 parallel/test-http-remove-connection-header-persists-connection
  ---
  duration_ms: 0.665
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at /usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/parallel/test-http-remove-connection-header-persists-connection.js:67:16
        at Timeout._onTimeout (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/parallel/test-http-remove-connection-header-persists-connection.js:54:7)
        at listOnTimeout (node:internal/timers:573:17)
        at process.processTimers (node:internal/timers:514:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v20.0.0-pre
  ...


Reason parallel/test-inspector-esm
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/46790/, https://github.com/nodejs/node/pull/46832/, https://github.com/nodejs/node/pull/46855/)
Appeared test-osuosl-rhel8-ppc64_le-2, test-ibm-rhel8-s390x-1, test-ibm-rhel8-s390x-4
First CI https://ci.nodejs.org/job/node-test-pull-request/50051/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50110/
Example
not ok 2053 parallel/test-inspector-esm
  ---
  duration_ms: 15.380
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:36041/ec344faf-232b-4481-81bf-32de56ad6989
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [test] Verifying debugger stops on start (--inspect-brk option)
    [err] Debugger attached.
    [err] 
    Timed out waiting for matching notification (break on file:///home/iojs/build/workspace/node-test-commit-plinux/nodes/rhel8-ppc64le/test/fixtures/es-modules/message.mjs:0)
    1
  ...


Reason parallel/test-single-executable-application
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46810/, https://github.com/nodejs/node/pull/46868/)
Appeared test-softlayer-alpine311_container-x64-1, test-digitalocean-alpine312_container-x64-2, test-ibm-rhel8-s390x-4, test-osuosl-rhel8-ppc64_le-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-8
First CI https://ci.nodejs.org/job/node-test-pull-request/50048/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50103/
Example
not ok 3181 parallel/test-single-executable-application
  ---
  duration_ms: 73.209
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/modules/cjs/loader:1233
        throw err;
        ^
    
    TypeError [ERR_INVALID_ARG_TYPE]: The "code" argument must be of type string. Received undefined
        at new NodeError (node:internal/errors:399:5)
        at validateString (node:internal/validators:163:11)
        at internalCompileFunction (node:internal/vm:32:3)
        at wrapSafe (node:internal/modules/cjs/loader:1207:20)
        at node:internal/main/single_executable_application:28:25 {
      code: 'ERR_INVALID_ARG_TYPE'
    }
    
    Node.js v20.0.0-pre
    node:child_process:924
        throw err;
        ^
    
    Error: Command failed: /home/iojs/node-tmp/.tmp.2466/sea -a --b=c d
    node:internal/modules/cjs/loader:1233
        throw err;
        ^
    
    TypeError [ERR_INVALID_ARG_TYPE]: The "code" argument must be of type string. Received undefined
        at new NodeError (node:inter...

Reason sequential/test-child-process-pass-fd
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46832/)
Appeared test-macstadium-macos11.0-arm64-3, test-macstadium-macos11.0-arm64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/50077/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50089/
Example
not ok 3774 sequential/test-child-process-pass-fd
  ---
  duration_ms: 0.337
  severity: crashed
  exitcode: -10
  stack: |-
  ...


CCTest Failure
Reason ../test/cctest/test_inspector_socket.cc:323: Failure
Type CC_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46672/, https://github.com/nodejs/node/pull/46330/)
Appeared test-softlayer-alpine311_container-x64-1, test-digitalocean-alpine311_container-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/50102/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50137/
Example
../test/cctest/test_inspector_socket.cc:323: Failure
Value of: (!expectation.read_expected)
  Actual: true
Expected: false
[  FAILED  ] InspectorSocketTest.HostIPv6NonRoutable (4999 ms)

Jenkins Failure
Reason Cannot read file /home/iojs/.config/jgit/config
Type JENKINS_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46872/, https://github.com/nodejs/node/pull/41439/)
Appeared test-osuosl-aix72-ppc64_be-2
First CI https://ci.nodejs.org/job/node-test-pull-request/50119/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50140/
Example
java.io.IOException: Cannot read file /home/iojs/.config/jgit/config
 > git rev-list --no-walk d943964dba3438af0f0d37aa30ece4380e5180b5 # timeout=30
First time build. Skipping changelog.
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=30
Resetting working tree

Git Failure
Build Failure
Reason error: remote GitHub already exists.
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/46365/, https://github.com/nodejs/node/pull/46790/, https://github.com/nodejs/node/pull/46878/, https://github.com/nodejs/node/pull/46872/)
Appeared test-rackspace-win2012r2_vs2017-x64-1, test-rackspace-win2012r2_vs2019-x64-6, test-rackspace-win2012r2_vs2019-x64-3, test-rackspace-win2012r2_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/50046/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50119/
Example
error: remote GitHub already exists.

> git fetch --prune --no-tags GitHub 

> git fetch --prune --no-tags https://github.com/nodejs/build.git +refs/heads/main:refs/remotes/jenkins_tmp

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/46599/, https://github.com/nodejs/node/pull/46872/, https://github.com/nodejs/node/pull/41439/)
Appeared test-equinix_mnx-smartos20-x64-4, test-equinix_mnx-smartos20-x64-3, test-osuosl-aix72-ppc64_be-3, test-equinix-debian10_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-1, test-osuosl-debian10_container-armv7l-1, test-osuosl-ubuntu2004_container-armv7l-1, test-osuosl-aix72-ppc64_be-4
First CI https://ci.nodejs.org/job/node-test-pull-request/50083/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50140/
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

Reason Error: getWindowSize EINVAL
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/46330/, https://github.com/nodejs/node/pull/46365/, https://github.com/nodejs/node/pull/46839/)
Appeared test-equinix_mnx-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/50044/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50085/
Example
Error: getWindowSize EINVAL
outline =     at WriteStream._refreshSize (node:tty:132:31)
outline =     at process.refreshStderrOnSigWinch (node:internal/bootstrap/switches/is_main_thread:137:10)
outline =     at process.emit (node:events:525:35)
outline = Emitted 'error' event on WriteStream instance at:
outline =     at WriteStream._refreshSize (node:tty:132:10)

Reason Makefile:1499: recipe for target 'tools/.cpplintstamp' failed
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46658/)
Appeared test-ibm-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/50077/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50104/
Example
Makefile:1499: recipe for target 'tools/.cpplintstamp' failed
make: *** [tools/.cpplintstamp] Error 1
+ cat test-eslint.tap
+ grep -v '^ok\|^TAP version 13\|^1\.\.'
+ sed '/^\s*$/d'
+ exit 1

undefined
Reason Unknown
Type undefined
Failed PR 13 (https://github.com/nodejs/node/pull/46810/, https://github.com/nodejs/node/pull/46867/, https://github.com/nodejs/node/pull/46588/, https://github.com/nodejs/node/pull/46831/, https://github.com/nodejs/node/pull/46812/, https://github.com/nodejs/node/pull/46672/, https://github.com/nodejs/node/pull/46817/, https://github.com/nodejs/node/pull/46658/, https://github.com/nodejs/node/pull/46742/, https://github.com/nodejs/node/pull/46825/, https://github.com/nodejs/node/pull/46832/, https://github.com/nodejs/node/pull/46809/, https://github.com/nodejs/node/pull/41439/)
Appeared test-nearform_arm-win10_vs2019-arm64-2, test-nearform_arm-win10_vs2019-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/50048/
Last CI https://ci.nodejs.org/job/node-test-pull-request/50135/
Example
Unknown

Progress
  • sequential/test-worker-prof (9)
  • parallel/test-http-remove-header-stays-removed (7)
  • parallel/test-corepack-yarn-install (6)
  • pummel/test-net-throttle (6)
  • parallel/test-http-remove-connection-header-persists-connection (4)
  • parallel/test-inspector-esm (3)
  • parallel/test-single-executable-application (2)
  • sequential/test-child-process-pass-fd (2)
  • ../test/cctest/test_inspector_socket.cc:323: Failure (2)
  • Cannot read file /home/iojs/.config/jgit/config (2)
  • error: remote GitHub already exists. (4)
  • ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? (3)
  • Error: getWindowSize EINVAL (3)
  • Makefile:1499: recipe for target 'tools/.cpplintstamp' failed (2)
  • Unknown (13)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the linked CI logs and the named tests, including test/sequential/test-worker-prof.js, test/parallel/test-http-remove-header-stays-removed.js, and test/pummel/test-net-throttle.js. Compare the reported failures across platforms and runs; done means the causes are identified and the affected CI tests no longer fail intermittently.

Written by the indexing model from the issue text.

Assessment

Tech stack
node.js, shell
Domain
ci-cd, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.