nodejs / nodejs/reliability

CI Reliability 2023-05-14

Open
#565 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/51679 to node-test-pull-request/51776 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2023-05-14 00:14 0 5 42 1 52 5.05%
CCTest Failure
Jenkins Failure
Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/47911/, https://github.com/nodejs/node/pull/47931/)
Appeared test-softlayer-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/51692/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51754/
Example
Build timed out (after 60 minutes). Marking the build as failed.

Git Failure
Build Failure
Reason error: argument --input/-i: can't open 'cctest.tap': [Errno 2] No such file or directory: 'cctest.tap'
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/47706/, https://github.com/nodejs/node/pull/47891/, https://github.com/nodejs/node/pull/47884/)
Appeared test-ibm-rhel7-s390x-1
First CI https://ci.nodejs.org/job/node-test-pull-request/51680/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51685/
Example
error: argument --input/-i: can't open 'cctest.tap': [Errno 2] No such file or directory: 'cctest.tap'
+ true
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Recording test results
[Checks API] No suitable checks publisher found.

Reason error: remote GitHub already exists.
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/47909/, https://github.com/nodejs/node/pull/47927/)
Appeared test-rackspace-win2012r2_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/51698/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51722/
Example
error: remote GitHub already exists.

> git fetch --prune --no-tags GitHub 

> git fetch --prune --no-tags https://github.com/nodejs/build.git +refs/heads/main:refs/remotes/jenkins_tmp

Reason sh: line 12: [: -gt: unary operator expected
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/47909/, https://github.com/nodejs/node/pull/47860/)
Appeared test-rackspace-win2012r2_vs2017-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/51698/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51753/
Example
sh: line 12: [: -gt: unary operator expected

JSTest Failure
Reason es-module/test-esm-loader-http-imports
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/47706/, https://github.com/nodejs/node/pull/47909/, https://github.com/nodejs/node/pull/47727/, https://github.com/nodejs/node/pull/47927/, https://github.com/nodejs/node/pull/47946/, https://github.com/nodejs/node/pull/47957/, https://github.com/nodejs/node/pull/47983/)
Appeared test-digitalocean-freebsd12-x64-1, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/51680/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51768/
Example
not ok 57 es-module/test-esm-loader-http-imports
  ---
  duration_ms: 36801.57700
  severity: fail
  exitcode: 1
  stack: |-
    TAP version 13
    # Subtest: ESM: http import via loader
        # Subtest: should load using --import flag
        ok 1 - should load using --import flag
          ---
          duration_ms: 33635.031089
          ...


Reason pummel/test-net-throttle
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/47933/, https://github.com/nodejs/node/pull/47909/, https://github.com/nodejs/node/pull/47860/, https://github.com/nodejs/node/pull/47983/, https://github.com/nodejs/node/pull/47949/)
Appeared test-digitalocean-freebsd12-x64-2, test-digitalocean-freebsd12-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/51711/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51767/
Example
not ok 3587 pummel/test-net-throttle
  ---
  duration_ms: 505.05900
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at process.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/pummel/test-net-throttle.js:87:10)
        at process.emit (node:events:523:35) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v21.0.0-pre
  ...


Reason parallel/test-http-remove-connection-header-persists-connection
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/47160/, https://github.com/nodejs/node/pull/47919/, https://github.com/nodejs/node/pull/47931/, https://github.com/nodejs/node/pull/47364/)
Appeared test-orka-macos11-x64-2, test-digitalocean-ubi81_container-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/51679/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51746/
Example
not ok 1233 parallel/test-http-remove-connection-header-persists-connection
  ---
  duration_ms: 343.42900
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/parallel/test-http-remove-connection-header-persists-connection.js:67:16
        at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/parallel/test-http-remove-connection-header-persists-connection.js:54:7)
        at listOnTimeout (node:internal/timers:573:17)
        at process.processTimers (node:internal/timers:514:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v21.0.0-pre
  ...


Reason parallel/test-x509-escaping
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/47903/, https://github.com/nodejs/node/pull/47055/, https://github.com/nodejs/node/pull/47933/, https://github.com/nodejs/node/pull/47931/)
Appeared test-rackspace-win2012r2_vs2019-x64-6, test-rackspace-win2012r2_vs2015-x64-2, test-rackspace-win2012r2_vs2017-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/51691/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51744/
Example
not ok 885 parallel/test-x509-escaping
  ---
  duration_ms: 5805.00300
  severity: fail
  exitcode: 1
  stack: |-
    node:events:489
          throw er; // Unhandled 'error' event
          ^
    
    Error [ERR_SOCKET_CONNECTION_TIMEOUT]: Socket connection timeout
        at new NodeError (node:internal/errors:399:5)
        at internalConnectMultiple (node:net:1099:20)
        at Timeout.internalConnectMultipleTimeout (node:net:1638:3)
        at listOnTimeout (node:internal/timers:575:11)
        at process.processTimers (node:internal/timers:514:7)
    Emitted 'error' event on TLSSocket instance at:
        at emitErrorNT (node:internal/streams/destroy:151:8)
        at emitErrorCloseNT (node:internal/streams/destroy:116:3)
        at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
      code: 'ERR_SOCKET_CONNECTION_TIMEOUT'
    }
    
    Node.js v21.0.0-pre
  ...


Reason parallel/test-http2-misbehaving-multiplex
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/47933/, https://github.com/nodejs/node/pull/47943/, https://github.com/nodejs/node/pull/47977/)
Appeared test-orka-macos11-x64-2, test-ibm-rhel8-s390x-4, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/51715/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51775/
Example
not ok 1481 parallel/test-http2-misbehaving-multiplex
  ---
  duration_ms: 537.18400
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected "actual" to be strictly unequal to: 5
        at Http2Server.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/parallel/test-http2-misbehaving-multiplex.js:45:10)
        at Http2Server.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/common/index.js:465:15)
        at Http2Server.emit (node:events:511:28)
        at ServerHttp2Session.sessionOnStream (node:internal/http2/core:3003:19)
        at ServerHttp2Session.emit (node:events:511:28)
        at emit (node:internal/http2/core:331:3)
        at process.processTicksAndRejections (node:internal/process/task_queues:85:22) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 5,
      expected: 5,
      operator: 'notStrictEqual'
   ...

Reason parallel/test-runner-watch-mode
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/47160/, https://github.com/nodejs/node/pull/47881/, https://github.com/nodejs/node/pull/47939/)
Appeared test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-equinix-ubuntu2004_container-armv7l-1, test-equinix-ubuntu2004_sharedlibs_container-arm64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/51679/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51730/
Example
not ok 3931 parallel/test-runner-watch-mode
  ---
  duration_ms: 960039.98100
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    TAP version 13
  ...


Reason sequential/test-http-regr-gh-2928
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/47884/, https://github.com/nodejs/node/pull/47706/, https://github.com/nodejs/node/pull/47364/)
Appeared test-digitalocean-freebsd12-x64-1, test-rackspace-win2012r2_vs2017-x64-4, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/51685/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51746/
Example
not ok 3857 sequential/test-http-regr-gh-2928
  ---
  duration_ms: 120031.35100
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    .+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+....

Reason parallel/test-fs-watch-recursive-symlink
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/47650/, https://github.com/nodejs/node/pull/47939/)
Appeared test-ibm-rhel8-s390x-3, test-ibm-rhel8-s390x-1
First CI https://ci.nodejs.org/job/node-test-pull-request/51720/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51730/
Example
not ok 1343 parallel/test-fs-watch-recursive-symlink
  ---
  duration_ms: 120040.27600
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-inspector-async-stack-traces-promise-then
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/47706/, https://github.com/nodejs/node/pull/47931/)
Appeared test-ibm-rhel8-s390x-4
First CI https://ci.nodejs.org/job/node-test-pull-request/51680/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51732/
Example
not ok 1867 parallel/test-inspector-async-stack-traces-promise-then
  ---
  duration_ms: 15315.87700
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:34957/b46fe697-e072-463a-985c-335e8246e0d1
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [err] Debugger attached.
    [err] 
    Timed out waiting for matching notification (break on [eval]:0)
    1
  ...


Reason parallel/test-inspector-debug-end
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/47055/, https://github.com/nodejs/node/pull/45629/)
Appeared test-ibm-rhel8-s390x-4
First CI https://ci.nodejs.org/job/node-test-pull-request/51719/
Last CI https://ci.nodejs.org/job/node-test-pull-request/51770/
Example
not ok 2771 parallel/test-inspector-debug-end
  ---
  duration_ms: 120073.39400
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    Test there's no crash stopping server that was not started
    Test there's no crash stopping server without connecting
    [err] Debugger listening on ws://127.0.0.1:35517/b91d9414-9655-4044-853f-2b2e90c916c1
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    Test there's no crash stopping server after connecting
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:44563/01abed30-af5f-4de0-81c7-d5ba92958139
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [err] Debugger attached.
    [err] 
  ...


Progress
  • Build timed out (after 60 minutes). Marking the build as failed. (2)
  • error: argument --input/-i: can't open 'cctest.tap': [Errno 2] No such file or directory: 'cctest.tap' (3)
  • error: remote GitHub already exists. (2)
  • sh: line 12: [: -gt: unary operator expected (2)
  • es-module/test-esm-loader-http-imports (7)
  • pummel/test-net-throttle (5)
  • parallel/test-http-remove-connection-header-persists-connection (4)
  • parallel/test-x509-escaping (4)
  • parallel/test-http2-misbehaving-multiplex (3)
  • parallel/test-runner-watch-mode (3)
  • sequential/test-http-regr-gh-2928 (3)
  • parallel/test-fs-watch-recursive-symlink (2)
  • parallel/test-inspector-async-stack-traces-promise-then (2)
  • parallel/test-inspector-debug-end (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the linked CI console examples and the named tests, including test/pummel/test-net-throttle.js, test/parallel/test-http-remove-connection-header-persists-connection.js, and test/parallel/test-http2-misbehaving-multiplex.js. The report aggregates several unrelated CI, build, and test failures and does not define a single fix or completion condition, so scope must be established before implementation.

Written by the indexing model from the issue text.

Assessment

Tech stack
git, javascript, nodejs, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.