nodejs / nodejs/reliability

CI Reliability 2024-07-27

Open
#931 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/60563 to node-test-pull-request/60657 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-07-27 00:08 2 13 19 4 62 13.83%
JSTest Failure
Reason parallel/test-dns
Type JS_TEST_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/54004/, https://github.com/nodejs/node/pull/53980/, https://github.com/nodejs/node/pull/54031/, https://github.com/nodejs/node/pull/54013/, https://github.com/nodejs/node/pull/53997/, https://github.com/nodejs/node/pull/54045/, https://github.com/nodejs/node/pull/54039/, https://github.com/nodejs/node/pull/54054/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-orka-macos11-x64-1, test-equinix-debian11_container-armv7l-1, test-rackspace-win2019_vs2019-x64-3, test-rackspace-debian11-x64-1, test-digitalocean-rhel9-x64-1, test-equinix-ubuntu2004_sharedlibs_container-arm64-5, test-orka-macos11-x64-2, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60568/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60654/
Example
not ok 634 parallel/test-dns
  ---
  duration_ms: 245.80600
  severity: fail
  exitcode: 1
  stack: |-
    (node:2969242) [DEP0118] DeprecationWarning: The provided hostname "" is not a valid hostname, and is supported in the dns module solely for compatibility.
    (Use `node --trace-deprecation ...` to show where the warning was created)
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
    + actual - expected ... Lines skipped
    
      [
        {
          address: '1.2.3.4',
    +     ttl: 3333333332,
    -     ttl: 3333333333,
          type: 'A'
        },
        {
          address: '::42',
    +     ttl: 3333333332,
    -     ttl: 3333333333,
          type: 'AAAA'
    ...


Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/48528/, https://github.com/nodejs/node/pull/53980/, https://github.com/nodejs/node/pull/54007/, https://github.com/nodejs/node/pull/53934/, https://github.com/nodejs/node/pull/53886/, https://github.com/nodejs/node/pull/53997/, https://github.com/nodejs/node/pull/54028/)
Appeared test-equinix_mnx-smartos20-x64-3, test-equinix_mnx-smartos20-x64-4, test-equinix-ubuntu2004_container-armv7l-2, test-equinix-ubuntu2004_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60575/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60657/
Example
not ok 3843 parallel/test-net-write-fully-async-buffer
  ---
  duration_ms: 300189.97500
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-runner-run-watch
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/53866/, https://github.com/nodejs/node/pull/54014/, https://github.com/nodejs/node/pull/52984/, https://github.com/nodejs/node/pull/34111/, https://github.com/nodejs/node/pull/54013/, https://github.com/nodejs/node/pull/53997/, https://github.com/nodejs/node/pull/54045/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-9, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-4, test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win10_vs2019-x64-1, test-azure_msft-win11_vs2022-x64-2, test-rackspace-win2019_vs2019-x64-4, test-rackspace-win2022_vs2022-x64-3, test-azure_msft-win11_vs2022-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60571/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60630/
Example
not ok 2479 parallel/test-runner-run-watch
  ---
  duration_ms: 27595.11700
  severity: fail
  exitcode: 1
  stack: |-
    TAP version 13
    # Subtest: test runner watch mode
        # Subtest: should run tests repeatedly
        ok 1 - should run tests repeatedly
          ---
          duration_ms: 3688.818883
          ...


Reason parallel/test-http2-socket-close
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/54020/, https://github.com/nodejs/node/pull/54013/, https://github.com/nodejs/node/pull/53822/, https://github.com/nodejs/node/pull/53863/, https://github.com/nodejs/node/pull/54014/, https://github.com/nodejs/node/pull/54028/)
Appeared test-azure_msft-win10_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60592/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60608/
Example
not ok 478 parallel/test-http2-socket-close
  ---
  duration_ms: 1171.00300
  severity: fail
  exitcode: 1
  stack: |-
    node:events:497
          throw er; // Unhandled 'error' event
          ^
    
    Error: read ECONNRESET
        at TLSWrap.onStreamRead (node:internal/stream_base_commons:218:20)
    Emitted 'error' event on ClientHttp2Stream instance at:
        at emitErrorNT (node:internal/streams/destroy:169:8)
        at emitErrorCloseNT (node:internal/streams/destroy:128:3)
        at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
      errno: -4077,
      code: 'ECONNRESET',
      syscall: 'read'
    }
    
    Node.js v20.15.2-pre
  ...


Reason parallel/test-assert-esm-cjs-message-verify
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53863/, https://github.com/nodejs/node/pull/53866/, https://github.com/nodejs/node/pull/48528/, https://github.com/nodejs/node/pull/54014/, https://github.com/nodejs/node/pull/53980/)
Appeared test-rackspace-win2016_vs2015-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60564/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60579/
Example
not ok 77 parallel/test-assert-esm-cjs-message-verify
  ---
  duration_ms: 736.00800
  severity: fail
  exitcode: 1
  stack: |-
    TAP version 13
    # Subtest: ensure the assert.ok throwing similar error messages for esm and cjs files
        # Subtest: should return code 1 for each command
        ok 1 - should return code 1 for each command
          ---
          duration_ms: 298.7248
          ...


Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/54004/, https://github.com/nodejs/node/pull/54013/, https://github.com/nodejs/node/pull/54042/, https://github.com/nodejs/node/pull/53886/, https://github.com/nodejs/node/pull/48528/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-rackspace-win2019_vs2019-x64-4, test-ibm-ubuntu2204_sharedlibs_container-x64-1, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60568/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60656/
Example
not ok 2819 parallel/test-http2-large-write-multiple-requests
  ---
  duration_ms: 120035.15000
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    server sends content 1
    server sends content 2
    server sends content 3
    server sends content 4
    server sends content 5
    server sends content 6
    server sends content 7
    server sends content 8
    server sends content 9
    server sends content 10
    server sends content 11
    server sends content 12
    server sends content 13
    server sends content 14
    server sends content 15
    server sends content 16
    server sends content 17
    server sends content 18
    server sends content 19
    server sends content 20
    server sends content 21
    server sends content 22
    server sends content 23
    server sends content 24
    server sends content 25
    server sends content 26
    server sends content 27
    server sends content 28
    server sends content 29
    server sends content 30
    server sends content 31
    server s...

Reason sequential/test-http-server-request-timeouts-mixed
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53863/, https://github.com/nodejs/node/pull/54014/, https://github.com/nodejs/node/pull/54013/, https://github.com/nodejs/node/pull/54044/, https://github.com/nodejs/node/pull/54054/)
Appeared test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60564/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60650/
Example
not ok 4156 sequential/test-http-server-request-timeouts-mixed
  ---
  duration_ms: 3170.07000
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:408
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
    
      assert(request2.completed)
    
        at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5)
        at listOnTimeout (node:internal/timers:601:17)
        at process.processTimers (node:internal/timers:539:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: '=='
    }
    
    Node.js v23.0.0-pre
  ...


Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53863/, https://github.com/nodejs/node/pull/53997/, https://github.com/nodejs/node/pull/54038/, https://github.com/nodejs/node/pull/48528/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-2, undefined, test-ibm-rhel8-x64-2, test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60587/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60656/
Example
not ok 2433 parallel/test-performance-function
  ---
  duration_ms: 225.90300
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/histogram:291
        validateInteger(val, 'val', 1);
        ^
    
    RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0
        at RecordableHistogram.record (node:internal/histogram:291:5)
        at processComplete (node:internal/perf/timerify:40:15)
        at timerified m (node:internal/perf/timerify:87:5)
        at /home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-performance-function.js:103:5
        at runNextTicks (node:internal/process/task_queues:65:5)
        at listOnTimeout (node:internal/timers:575:9)
        at process.processTimers (node:internal/timers:549:7) {
      code: 'ERR_OUT_OF_RANGE'
    }
    
    Node.js v23.0.0-pre
  ...


Reason parallel/test-sqlite
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53980/, https://github.com/nodejs/node/pull/53997/, https://github.com/nodejs/node/pull/54014/, https://github.com/nodejs/node/pull/48528/)
Appeared test-osuosl-rhel8-ppc64_le-3, test-azure_msft-win11_vs2022-arm64-1, test-azure_msft-win11_vs2022-arm64-3, test-osuosl-rhel8-ppc64_le-2, test-azure_msft-win10_vs2019-x64-3, test-azure_msft-win11_vs2022-x64-4, test-rackspace-win2019_vs2019-x64-1, test-rackspace-win2022_vs2022-x64-3, test-osuosl-rhel8-ppc64_le-4, test-azure_msft-win11_vs2022-x64-1, test-rackspace-win2019_vs2019-x64-3, test-rackspace-win2022_vs2022-x64-4, test-azure_msft-win11_vs2022-arm64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/60579/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60607/
Example
not ok 3507 parallel/test-sqlite
  ---
  duration_ms: 121010.43900
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    TAP version 13
    # Subtest: accessing the node:sqlite module
        # Subtest: cannot be accessed without the node: scheme
        ok 1 - cannot be accessed without the node: scheme
          ---
          duration_ms: 2.689924
          ...


Reason parallel/test-worker-memory
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53863/, https://github.com/nodejs/node/pull/53822/, https://github.com/nodejs/node/pull/54020/, https://github.com/nodejs/node/pull/54028/)
Appeared test-azure_msft-win11_vs2022-x64-4, test-azure_msft-win11_vs2022-x64-3, test-rackspace-win2019_vs2019-x64-2, test-azure_msft-win10_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60564/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60653/
Example
not ok 902 parallel/test-worker-memory
  ---
  duration_ms: 377.01100
  severity: crashed
  exitcode: 3221225477
  stack: |-
    run() called with n=15 (numWorkers=4)
    run() called with n=15 (numWorkers=4)
    run() called with n=15 (numWorkers=4)
    run() called with n=15 (numWorkers=4)
  ...


Reason pummel/test-hash-seed
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53997/, https://github.com/nodejs/node/pull/52984/, https://github.com/nodejs/node/pull/54039/)
Appeared test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60617/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60639/
Example
not ok 3844 pummel/test-hash-seed
  ---
  duration_ms: 81616.99000
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/errors:983
      const err = new Error(message);
                  ^
    
    Error: Command failed: /home/iojs/build/workspace/node-test-commit-linux/out/Release/node --allow-natives-syntax /home/iojs/build/workspace/node-test-commit-linux/test/fixtures/guess-hash-seed.js
    /home/iojs/build/workspace/node-test-commit-linux/test/fixtures/guess-hash-seed.js:163
      throw new Error('no candidates remaining');
      ^
    
    Error: no candidates remaining
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux/test/fixtures/guess-hash-seed.js:163:9)
        at Module._compile (node:internal/modules/cjs/loader:1542:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1687:10)
        at Module.load (node:internal/modules/cjs/loader:1313:32)
        at Module._load (node:internal/modules/cjs/loader:1123:12)
        at TracingChannel.traceS...

Reason async-hooks/test-writewrap
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/54014/, https://github.com/nodejs/node/pull/54039/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/60604/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60637/
Example
not ok 558 async-hooks/test-writewrap
  ---
  duration_ms: 120051.71600
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-file-write-stream4
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/54005/, https://github.com/nodejs/node/pull/53964/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-9, test-osuosl-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60572/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60613/
Example
not ok 1456 parallel/test-file-write-stream4
  ---
  duration_ms: 120023.90800
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason wpt/test-url
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53980/, https://github.com/nodejs/node/pull/54044/)
Appeared test-rackspace-win2022_vs2022-x64-1, test-azure_msft-win10_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60579/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60627/
Example
not ok 988 wpt/test-url
  ---
  duration_ms: 1087.03500
  severity: crashed
  exitcode: 3221225477
  stack: |-
    [SKIPPED] idlharness-shadowrealm.window.js: ShadowRealm support is not enabled
    [SKIPPED] javascript-urls.window.js: requires document.body reference
    [SKIPPED] percent-encoding.window.js: TODO: port from .window.js
    [SKIPPED] url-setters-a-area.window.js?include=file: already tested in url-setters.any.js
    [SKIPPED] url-setters-a-area.window.js?include=javascript: already tested in url-setters.any.js
    [SKIPPED] url-setters-a-area.window.js?include=mailto: already tested in url-setters.any.js
    [SKIPPED] url-setters-a-area.window.js?exclude=(file|javascript|mailto): already tested in url-setters.any.js
    [EXPECTED_FAILURE][FAIL] searchParams on location object
    assert_false: location object should not have a searchParams attribute expected false got true
        at Test.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\fixtures\wpt\url\historical.any.js:3...

Jenkins Failure
Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/48528/, https://github.com/nodejs/node/pull/53997/)
Appeared test-digitalocean-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60575/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60611/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 167.99.124.188/167.99.124.188:34848' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at jdk.proxy2/jdk.proxy2.$Proxy82.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1212)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1204)

Build Failure
Reason Error: getWindowSize EINVAL
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53757/, https://github.com/nodejs/node/pull/48528/, https://github.com/nodejs/node/pull/53980/, https://github.com/nodejs/node/pull/53997/, https://github.com/nodejs/node/pull/54028/)
Appeared test-equinix_mnx-smartos20-x64-3, test-equinix_mnx-smartos20-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/60563/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60653/
Example
Error: getWindowSize EINVAL
outline =     at WriteStream._refreshSize (node:tty:137:24)
outline =     at process.refreshStderrOnSigWinch (node:internal/bootstrap/switches/is_main_thread:142:10)
outline =     at process.emit (node:events:532:35)
outline = Emitted 'error' event on WriteStream instance at:
outline =     at WriteStream._refreshSize (node:tty:137:10)

Reason Failed to trigger fanned build
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53964/, https://github.com/nodejs/node/pull/54030/, https://github.com/nodejs/node/pull/53997/)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/60613/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60617/
Example
Failed to trigger fanned build

Reason fatal error: Killed signal terminated program cc1plus
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53997/, https://github.com/nodejs/node/pull/48528/, https://github.com/nodejs/node/pull/54013/)
Appeared test-digitalocean-ubi81_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-digitalocean-rhel8_arm_cross_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60620/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60626/
Example
fatal error: Killed signal terminated program cc1plus

Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/54014/, https://github.com/nodejs/node/pull/53964/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/60578/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60649/
Example
fatal: No rebase in progress?

Progress
  • parallel/test-dns (8)
  • parallel/test-net-write-fully-async-buffer (7)
  • parallel/test-runner-run-watch (7)
  • parallel/test-http2-socket-close (6)
  • parallel/test-assert-esm-cjs-message-verify (5)
  • parallel/test-http2-large-write-multiple-requests (5)
  • sequential/test-http-server-request-timeouts-mixed (5)
  • parallel/test-performance-function (4)
  • parallel/test-sqlite (4)
  • parallel/test-worker-memory (4)
  • pummel/test-hash-seed (3)
  • async-hooks/test-writewrap (2)
  • parallel/test-file-write-stream4 (2)
  • wpt/test-url (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (2)
  • Error: getWindowSize EINVAL (5)
  • Failed to trigger fanned build (3)
  • fatal error: Killed signal terminated program cc1plus (3)
  • fatal: No rebase in progress? (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the linked Jenkins console logs and the failures for parallel/test-dns, parallel/test-net-write-fully-async-buffer, parallel/test-runner-run-watch, and parallel/test-http2-socket-close. Compare the first and last CI runs across the listed platforms to identify reproducible causes; done means the reported failures are addressed and the affected CI jobs remain reliable.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js
Domain
ci-cd, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.