nodejs / nodejs/reliability

CI Reliability 2024-07-23

Open
#927 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/60449 to node-test-pull-request/60540 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-07-23 00:09 5 10 16 16 53 12.66%
Jenkins Failure
Build Failure
Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/53866/, https://github.com/nodejs/node/pull/53651/, https://github.com/nodejs/node/pull/53966/, https://github.com/nodejs/node/pull/53878/, https://github.com/nodejs/node/pull/53984/, https://github.com/nodejs/node/pull/53865/)
Appeared test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-ibm-ubuntu2204_sharedlibs_container-x64-4, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60449/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60529/
Example
fatal: No rebase in progress?

Reason Error: getWindowSize EINVAL
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53695/, https://github.com/nodejs/node/pull/53959/, https://github.com/nodejs/node/pull/53614/, https://github.com/nodejs/node/pull/53757/, https://github.com/nodejs/node/pull/53981/)
Appeared test-equinix_mnx-smartos20-x64-3, test-equinix_mnx-smartos20-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/60459/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60522/
Example
Error: getWindowSize EINVAL
outline =     at WriteStream._refreshSize (node:tty:137:24)
outline =     at process.refreshStderrOnSigWinch (node:internal/bootstrap/switches/is_main_thread:142:10)
outline =     at process.emit (node:events:532:35)
outline = Emitted 'error' event on WriteStream instance at:
outline =     at WriteStream._refreshSize (node:tty:137:10)

JSTest Failure
Reason parallel/test-assert-esm-cjs-message-verify
Type JS_TEST_FAILURE
Failed PR 15 (https://github.com/nodejs/node/pull/53866/, https://github.com/nodejs/node/pull/53940/, https://github.com/nodejs/node/pull/53695/, https://github.com/nodejs/node/pull/53952/, https://github.com/nodejs/node/pull/53865/, https://github.com/nodejs/node/pull/48528/, https://github.com/nodejs/node/pull/53879/, https://github.com/nodejs/node/pull/53966/, https://github.com/nodejs/node/pull/53972/, https://github.com/nodejs/node/pull/53931/, https://github.com/nodejs/node/pull/53938/, https://github.com/nodejs/node/pull/53959/, https://github.com/nodejs/node/pull/53830/, https://github.com/nodejs/node/pull/53781/, https://github.com/nodejs/node/pull/53878/)
Appeared test-softlayer-debian12-x64-1, test-linuxonecc-rhel9-s390x-3, undefined, test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-linuxonecc-rhel9-s390x-1, test-digitalocean-fedora40-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3, test-osuosl-rhel9-ppc64_le-3, test-ibm-rhel9-x64-1, test-orka-macos11-x64-2, test-rackspace-win2022_vs2022-x64-4, test-ibm-alpine319_container-x64-1, test-ibm-rhel8-s390x-1, test-ibm-rhel8-s390x-4, test-digitalocean-ubuntu2204-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-ibm-ubuntu2204_sharedlibs_container-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60449/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60491/
Example
not ok 184 parallel/test-assert-esm-cjs-message-verify
  ---
  duration_ms: 328.26900
  severity: fail
  exitcode: 1
  stack: |-
    TAP version 13
    # Subtest: ensure the assert.ok throwing similar error messages for esm and cjs files
        # Subtest: should return code 1 for each command
        ok 1 - should return code 1 for each command
          ---
          duration_ms: 143.568038
          ...


Reason parallel/test-sqlite
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53972/, https://github.com/nodejs/node/pull/53938/, https://github.com/nodejs/node/pull/53981/, https://github.com/nodejs/node/pull/53931/, https://github.com/nodejs/node/pull/53830/)
Appeared test-osuosl-rhel8-ppc64_le-2, test-osuosl-rhel8-ppc64_le-4
First CI https://ci.nodejs.org/job/node-test-pull-request/60478/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60535/
Example
not ok 3828 parallel/test-sqlite
  ---
  duration_ms: 120147.76100
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    TAP version 13
    # Subtest: accessing the node:sqlite module
        # Subtest: cannot be accessed without the node: scheme
        ok 1 - cannot be accessed without the node: scheme
          ---
          duration_ms: 2.857753
          ...


Reason parallel/test-cli-bad-options
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53931/, https://github.com/nodejs/node/pull/53830/, https://github.com/nodejs/node/pull/53945/)
Appeared test-rackspace-win2019_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60474/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60489/
Example
not ok 124 parallel/test-cli-bad-options
  ---
  duration_ms: 1482.01400
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    3221226505 !== 1
    
        at missingOption (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-cli-bad-options.js:22:10)
        at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-cli-bad-options.js:17:1)
        at Module._compile (node:internal/modules/cjs/loader:1358:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1416:10)
        at Module.load (node:internal/modules/cjs/loader:1208:32)
        at Module._load (node:internal/modules/cjs/loader:1024:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:174:12)
        at node:internal/main/run_main_module:28:49 {
      generatedMessage: true,
      code: 'ERR_ASSER...

Reason parallel/test-cli-node-options
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53931/, https://github.com/nodejs/node/pull/53830/, https://github.com/nodejs/node/pull/53945/)
Appeared test-rackspace-win2019_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60474/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60489/
Example
not ok 123 parallel/test-cli-node-options
  ---
  duration_ms: 1099.01000
  severity: crashed
  exitcode: 2147483651
  stack: |-
    
    #
    # Fatal process OOM in Re-embedded builtins: set permissions
    #
    
  ...


Reason parallel/test-http2-socket-close
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53931/, https://github.com/nodejs/node/pull/53830/, https://github.com/nodejs/node/pull/53952/)
Appeared test-azure_msft-win10_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60474/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60496/
Example
not ok 488 parallel/test-http2-socket-close
  ---
  duration_ms: 1247.00700
  severity: fail
  exitcode: 1
  stack: |-
    node:events:498
          throw er; // Unhandled 'error' event
          ^
    
    Error: read ECONNRESET
        at TLSWrap.onStreamRead (node:internal/stream_base_commons:218:20)
    Emitted 'error' event on ClientHttp2Stream instance at:
        at emitErrorNT (node:internal/streams/destroy:170:8)
        at emitErrorCloseNT (node:internal/streams/destroy:129:3)
        at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
      errno: -4077,
      code: 'ECONNRESET',
      syscall: 'read'
    }
    
    Node.js v23.0.0-pre
  ...


Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53781/, https://github.com/nodejs/node/pull/53865/, https://github.com/nodejs/node/pull/53982/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-rhel8-x64-1, test-ibm-ubuntu2204-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60463/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60501/
Example
not ok 2428 parallel/test-performance-function
  ---
  duration_ms: 221.88000
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/histogram:291
        validateInteger(val, 'val', 1);
        ^
    
    RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0
        at RecordableHistogram.record (node:internal/histogram:291:5)
        at processComplete (node:internal/perf/timerify:40:15)
        at timerified m (node:internal/perf/timerify:87:5)
        at /home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-performance-function.js:103:5
        at runNextTicks (node:internal/process/task_queues:60:5)
        at listOnTimeout (node:internal/timers:565:9)
        at process.processTimers (node:internal/timers:539:7) {
      code: 'ERR_OUT_OF_RANGE'
    }
    
    Node.js v23.0.0-pre
  ...


Reason sequential/test-http-server-request-timeouts-mixed
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53921/, https://github.com/nodejs/node/pull/53941/, https://github.com/nodejs/node/pull/53865/)
Appeared test-orka-macos11-x64-1, test-orka-macos11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60452/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60534/
Example
not ok 4148 sequential/test-http-server-request-timeouts-mixed
  ---
  duration_ms: 3166.53100
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:408
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
    
      assert(request2.completed)
    
        at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5)
        at listOnTimeout (node:internal/timers:601:17)
        at process.processTimers (node:internal/timers:539:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: '=='
    }
    
    Node.js v23.0.0-pre
  ...


Reason parallel/test-child-process-spawn-windows-batch-file
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53931/, https://github.com/nodejs/node/pull/53830/)
Appeared test-rackspace-win2019_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60474/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60486/
Example
not ok 127 parallel/test-child-process-spawn-windows-batch-file
  ---
  duration_ms: 4709.02100
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    1 !== 0
    
        at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-child-process-spawn-windows-batch-file.js:35:10)
        at Module._compile (node:internal/modules/cjs/loader:1358:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1416:10)
        at Module.load (node:internal/modules/cjs/loader:1208:32)
        at Module._load (node:internal/modules/cjs/loader:1024:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:174:12)
        at node:internal/main/run_main_module:28:49 {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 1,
      expected: 0,
      operator: 'strictEqual'
    }
    
  ...

Reason parallel/test-crypto-authenticated
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53695/, https://github.com/nodejs/node/pull/53669/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-azure_msft-win11_vs2022-arm64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/60459/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60514/
Example
not ok 1218 parallel/test-crypto-authenticated
  ---
  duration_ms: 120082.98700
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-dns
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53941/, https://github.com/nodejs/node/pull/53952/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-4, test-azure_msft-win10_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60457/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60464/
Example
not ok 629 parallel/test-dns
  ---
  duration_ms: 509.27200
  severity: fail
  exitcode: 1
  stack: |-
    (node:2471535) [DEP0118] DeprecationWarning: The provided hostname "" is not a valid hostname, and is supported in the dns module solely for compatibility.
    (Use `node --trace-deprecation ...` to show where the warning was created)
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
    + actual - expected ... Lines skipped
    
      [
        {
          address: '1.2.3.4',
    +     ttl: 3333333332,
    -     ttl: 3333333333,
          type: 'A'
        },
        {
          address: '::42',
    +     ttl: 3333333332,
    -     ttl: 3333333333,
          type: 'AAAA'
    ...


Reason parallel/test-fs-utimes
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53931/, https://github.com/nodejs/node/pull/53972/)
Appeared test-osuosl-rhel8-ppc64_le-4, test-osuosl-rhel8-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60477/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60478/
Example
not ok 1489 parallel/test-fs-utimes
  ---
  duration_ms: 160050.51000
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-fs-watch-recursive-linux-parallel-remove
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53972/, https://github.com/nodejs/node/pull/53931/)
Appeared test-osuosl-rhel8-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60475/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60477/
Example
not ok 1288 parallel/test-fs-watch-recursive-linux-parallel-remove
  ---
  duration_ms: 120681.03400
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    a rename
    a rename
    a rename
    a rename
    a rename
    a rename
    a change
    a rename
    a rename
    a rename
  ...


Reason parallel/test-fs-write-file-flush
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53931/, https://github.com/nodejs/node/pull/53972/)
Appeared test-osuosl-rhel8-ppc64_le-4, test-osuosl-rhel8-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60474/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60478/
Example
not ok 1347 parallel/test-fs-write-file-flush
  ---
  duration_ms: 129513.28400
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    TAP version 13
    # Subtest: synchronous version
        # Subtest: validation
        ok 1 - validation
          ---
          duration_ms: 3.483035
          ...


Reason parallel/test-fs-write-stream-flush
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53931/, https://github.com/nodejs/node/pull/53972/)
Appeared test-osuosl-rhel8-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60474/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60475/
Example
not ok 1321 parallel/test-fs-write-stream-flush
  ---
  duration_ms: 123657.11100
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    TAP version 13
    # Subtest: validation
    ok 1 - validation
      ---
      duration_ms: 4.527742
      ...


Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53921/, https://github.com/nodejs/node/pull/53984/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-ibm-ubuntu2204_sharedlibs_container-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60452/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60502/
Example
not ok 2481 parallel/test-http2-large-write-multiple-requests
  ---
  duration_ms: 120078.25800
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    server sends content 1
    server sends content 2
    server sends content 3
    server sends content 4
    server sends content 5
    server sends content 6
    server sends content 7
    server sends content 8
    server sends content 9
    server sends content 10
    server sends content 11
    server sends content 12
    server sends content 13
    server sends content 14
    server sends content 15
    server sends content 16
    server sends content 17
    server sends content 18
    server sends content 19
    server sends content 20
    server sends content 21
    server sends content 22
    server sends content 23
    server sends content 24
    server sends content 25
    server sends content 26
    server sends content 27
    server sends content 28
    server sends content 29
    server sends content 30
    server sends content 31
    server s...

Progress
  • fatal: No rebase in progress? (6)
  • Error: getWindowSize EINVAL (5)
  • parallel/test-assert-esm-cjs-message-verify (15)
  • parallel/test-sqlite (5)
  • parallel/test-cli-bad-options (3)
  • parallel/test-cli-node-options (3)
  • parallel/test-http2-socket-close (3)
  • parallel/test-performance-function (3)
  • sequential/test-http-server-request-timeouts-mixed (3)
  • parallel/test-child-process-spawn-windows-batch-file (2)
  • parallel/test-crypto-authenticated (2)
  • parallel/test-dns (2)
  • parallel/test-fs-utimes (2)
  • parallel/test-fs-watch-recursive-linux-parallel-remove (2)
  • parallel/test-fs-write-file-flush (2)
  • parallel/test-fs-write-stream-flush (2)
  • parallel/test-http2-large-write-multiple-requests (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the linked Jenkins console logs and the named failures, including parallel/test-assert-esm-cjs-message-verify, parallel/test-sqlite, and parallel/test-cli-bad-options. Compare the repeated failures across the listed platforms and determine which CI or test problems remain; done means the reported recurring failures no longer affect pull-request CI.

Written by the indexing model from the issue text.

Assessment

Tech stack
nodejs, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.