nodejs / nodejs/reliability

CI Reliability 2024-07-09

Open
#915 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/60090 to node-test-pull-request/60186 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-07-09 00:09 1 4 24 2 69 4.12%
JSTest Failure
Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 11 (https://github.com/nodejs/node/pull/53686/, https://github.com/nodejs/node/pull/53573/, https://github.com/nodejs/node/pull/53517/, https://github.com/nodejs/node/pull/53563/, https://github.com/nodejs/node/pull/53728/, https://github.com/nodejs/node/pull/53657/, https://github.com/nodejs/node/pull/53593/, https://github.com/nodejs/node/pull/52166/, https://github.com/nodejs/node/pull/53748/, https://github.com/nodejs/node/pull/53678/, https://github.com/nodejs/node/pull/53658/)
Appeared test-equinix_mnx-smartos20-x64-3, test-equinix_mnx-smartos20-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/60092/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60172/
Example
not ok 3819 parallel/test-net-write-fully-async-buffer
  ---
  duration_ms: 300161.41000
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53724/, https://github.com/nodejs/node/pull/53728/, https://github.com/nodejs/node/pull/53682/, https://github.com/nodejs/node/pull/52166/, https://github.com/nodejs/node/pull/53759/)
Appeared undefined, test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-ibm-rhel9-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60098/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60162/
Example
not ok 2452 parallel/test-performance-function
  ---
  duration_ms: 264.51400
  severity: fail
  exitcode: 1
  stack: |-
    
    node:internal/event_target:1090
      process.nextTick(() => { throw err; });
                               ^
    RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0
        at RecordableHistogram.record (node:internal/histogram:291:5)
        at processComplete (node:internal/perf/timerify:40:15)
        at timerified m (node:internal/perf/timerify:87:5)
        at /home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-performance-function.js:103:5
        at runNextTicks (node:internal/process/task_queues:60:5)
        at listOnTimeout (node:internal/timers:565:9)
        at process.processTimers (node:internal/timers:539:7) {
      code: 'ERR_OUT_OF_RANGE'
    }
    
    Node.js v23.0.0-pre
  ...


Reason parallel/test-snapshot-reproducible
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53593/, https://github.com/nodejs/node/pull/53682/, https://github.com/nodejs/node/pull/53619/, https://github.com/nodejs/node/pull/53605/, https://github.com/nodejs/node/pull/53766/)
Appeared test-azure_msft-win10_vs2019-x64-1, test-azure_msft-win11_vs2022-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-rackspace-win2022_vs2022-x64-2, test-ibm-ubi81_container-x64-1, test-azure_msft-win11_vs2022-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60134/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60186/
Example
not ok 696 parallel/test-snapshot-reproducible
  ---
  duration_ms: 1648.59900
  severity: fail
  exitcode: 1
  stack: |-
    0x0: Write magic 143da19
    0x4: Write metadata
    0x37: Write snapshot blob
    0x1720a8: Write IsolateDataSerializeInfo
    0x173584: Write EnvSerializeInfo
    0x17441d: Write CodeCacheInfo
    0x0: Write magic 143da19
    0x4: Write metadata
    0x37: Write snapshot blob
    0x1720a8: Write IsolateDataSerializeInfo
    0x173584: Write EnvSerializeInfo
    0x17441d: Write CodeCacheInfo
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
    + actual - expected
    
    + [
    +   {
    +     offset: '0x40',
    +     slice1: '000000634a94a5993c18d631322e342e',
    +     slice2: '0000005d4a7345993c18d631322e342e'
    +   },
    +   {
    +     offset: '0xf3bc0',
    +     slice1: '00000069a83091c10000000000000000',
    +     slice2: '00000061aa3091c10000000000000000'
    +   }
    + ]
...

Reason sequential/test-http-server-request-timeouts-mixed
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53669/, https://github.com/nodejs/node/pull/53686/, https://github.com/nodejs/node/pull/53685/, https://github.com/nodejs/node/pull/53750/, https://github.com/nodejs/node/pull/52166/)
Appeared test-orka-macos11-x64-2, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60097/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60169/
Example
not ok 4133 sequential/test-http-server-request-timeouts-mixed
  ---
  duration_ms: 3455.81400
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:408
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
    
      assert(request2.completed)
    
        at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5)
        at listOnTimeout (node:internal/timers:601:17)
        at process.processTimers (node:internal/timers:539:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: '=='
    }
    
    Node.js v23.0.0-pre
  ...


Reason parallel/test-dns
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53685/, https://github.com/nodejs/node/pull/53678/, https://github.com/nodejs/node/pull/53728/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-digitalocean-fedora39-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60091/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60123/
Example
not ok 631 parallel/test-dns
  ---
  duration_ms: 535.94100
  severity: fail
  exitcode: 1
  stack: |-
    (node:1167898) [DEP0118] DeprecationWarning: The provided hostname "" is not a valid hostname, and is supported in the dns module solely for compatibility.
    (Use `node --trace-deprecation ...` to show where the warning was created)
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
    + actual - expected ... Lines skipped
    
      [
        {
          address: '1.2.3.4',
    +     ttl: 3333333332,
    -     ttl: 3333333333,
          type: 'A'
        },
        {
          address: '::42',
    +     ttl: 3333333332,
    -     ttl: 3333333333,
          type: 'AAAA'
    ...


Reason parallel/test-permission-fs-read
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53685/, https://github.com/nodejs/node/pull/53698/, https://github.com/nodejs/node/pull/53657/)
Appeared test-azure_msft-win11_vs2022-arm64-6, test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win11_vs2022-x64-3, test-rackspace-win2019_vs2019-x64-2, test-rackspace-win2022_vs2022-x64-6, test-azure_msft-win11_vs2022-arm64-3, test-azure_msft-win10_vs2019-x64-4, test-azure_msft-win11_vs2022-x64-2, test-rackspace-win2019_vs2019-x64-1, test-rackspace-win2022_vs2022-x64-3, test-azure_msft-win2016_vs2017-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60091/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60173/
Example
not ok 602 parallel/test-permission-fs-read
  ---
  duration_ms: 562.00000
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: node:assert:644
    
          throw err;
    
          ^
    
    
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
    
    + actual - expected
    
    
    
      Comparison {
    
        code: 'ERR_ACCESS_DENIED',
    
        permission: 'FileSystemRead',
    
    +   resource: 'd:\\workspace\\node-test-binary-windows-js-suites\\node\\test\\fixtures\\permission\\deny\\protected-file.md'
    
    -   resource: '\\\\?\\d:\\workspace\\node-test-binary-windows-js-suites\\node\\test\\fixtures\\permission\\deny\\protected-file.md'
    
      }
    
        at Object.<anonymous> (d:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:740:12)
    
        at Object.<anonymous> (d:\workspace\node-test-binary-windows-js-suites\node\test\c...

Reason parallel/test-bootstrap-modules
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34111/, https://github.com/nodejs/node/pull/53682/)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/60120/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60168/
Example
not ok 412 parallel/test-bootstrap-modules
  ---
  duration_ms: 268.27800
  severity: fail
  exitcode: 1
  stack: |-
    
    node:internal/event_target:1090
      process.nextTick(() => { throw err; });
                               ^
    AssertionError [ERR_ASSERTION]: These builtins are now unexpectedly loaded at run time.
    If this is intentional, add them to `expected.atRunTime`.
    
    # Note: loading more builtins at run time can lead to startup performance regression.
    - Consider lazy loading builtins that are not used universally.
    
    --- These could be added to expected.atRunTime ---
    [
      'NativeModule internal/worker/messaging'
    ]
    
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-bootstrap-modules.js:242:8)
        at Module._compile (node:internal/modules/cjs/loader:1458:14)
        at Object..js (node:internal/modules/cjs/loader:1542:10)
        at Module.load (node:internal/modules/cjs/loader:1282:32)...

Reason parallel/test-buffer-tostring-rangeerror
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53611/, https://github.com/nodejs/node/pull/53553/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60100/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60150/
Example
not ok 1524 parallel/test-buffer-tostring-rangeerror
  ---
  duration_ms: 120020.94300
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    (node:699603) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
    (Use `node --trace-deprecation ...` to show where the warning was created)
  ...


Reason parallel/test-file-write-stream4
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53698/, https://github.com/nodejs/node/pull/53721/)
Appeared test-equinix-ubuntu2004_container-armv7l-2, test-osuosl-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60094/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60157/
Example
not ok 3853 parallel/test-file-write-stream4
  ---
  duration_ms: 360107.11900
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-http-remove-header-stays-removed
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53686/, https://github.com/nodejs/node/pull/53563/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60092/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60109/
Example
not ok 1641 parallel/test-http-remove-header-stays-removed
  ---
  duration_ms: 911.31800
  severity: fail
  exitcode: 1
  stack: |-
    ok
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at Timeout._onTimeout (/home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-http-remove-header-stays-removed.js:61:18)
        at listOnTimeout (node:internal/timers:601:17)
        at process.processTimers (node:internal/timers:539:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v23.0.0-pre
  ...


Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53728/, https://github.com/nodejs/node/pull/53766/)
Appeared test-azure_msft-win10_vs2019-x64-4, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/60108/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60186/
Example
not ok 955 parallel/test-http2-large-write-multiple-requests
  ---
  duration_ms: 120214.89300
  severity: fail
  exitcode: 1
  stack: |-
    timeout
    server sends content 1
    server sends content 2
    server sends content 3
    server sends content 4
    server sends content 5
    server sends content 6
    server sends content 7
    server sends content 8
    server sends content 9
    server sends content 10
    server sends content 11
    server sends content 12
    server sends content 13
    server sends content 14
    server sends content 15
    server sends content 16
    server sends content 17
    server sends content 18
    server sends content 19
    server sends content 20
    server sends content 21
    server sends content 22
    server sends content 23
    server sends content 24
    server sends content 25
    server sends content 26
    server sends content 27
    server sends content 28
    server sends content 29
    server sends content 30
    server sends content 31
    server send...

Reason parallel/test-performance-eventlooputil
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53686/, https://github.com/nodejs/node/pull/53748/)
Appeared test-ibm-ubuntu2204-x64-1, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/60132/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60141/
Example
not ok 2453 parallel/test-performance-eventlooputil
  ---
  duration_ms: 515.13900
  severity: fail
  exitcode: 1
  stack: |-
    
    node:internal/event_target:1090
      process.nextTick(() => { throw err; });
                               ^
    AssertionError [ERR_ASSERTION]: 96.63115298748016 < 96.63115302116773
        at Timeout.runCalcTest (/home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-performance-eventlooputil.js:85:10)
        at Timeout.runCalcTest [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-linux/test/common/index.js:487:15)
        at listOnTimeout (node:internal/timers:603:11)
        at process.processTimers (node:internal/timers:539:7) {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: '=='
    }
    
    Node.js v23.0.0-pre
  ...


Reason pummel/test-hash-seed
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53593/, https://github.com/nodejs/node/pull/53766/)
Appeared test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60095/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60186/
Example
not ok 3821 pummel/test-hash-seed
  ---
  duration_ms: 82658.55000
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/errors:983
      const err = new Error(message);
                  ^
    
    Error: Command failed: /home/iojs/build/workspace/node-test-commit-linux/out/Release/node --allow-natives-syntax /home/iojs/build/workspace/node-test-commit-linux/test/fixtures/guess-hash-seed.js
    /home/iojs/build/workspace/node-test-commit-linux/test/fixtures/guess-hash-seed.js:163
      throw new Error('no candidates remaining');
      ^
    
    Error: no candidates remaining
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux/test/fixtures/guess-hash-seed.js:163:9)
        at Module._compile (node:internal/modules/cjs/loader:1458:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1542:10)
        at Module.load (node:internal/modules/cjs/loader:1282:32)
        at Module._load (node:internal/modules/cjs/loader:1098:12)
        at TracingChannel.traceS...

Jenkins Failure
Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53724/, https://github.com/nodejs-private/node-private/pull/617/)
Appeared test-digitalocean-ubi81_container-x64-2, test-ibm-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60098/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60117/
Example
Build timed out (after 60 minutes). Marking the build as failed.

Git Failure
Build Failure
Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/34111/, https://github.com/nodejs/node/pull/53686/, https://github.com/nodejs-private/node-private/pull/617/, https://github.com/nodejs/node/pull/53465/, https://github.com/nodejs/node/pull/53721/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-4, test-equinix-rhel8_container-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60110/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60157/
Example
fatal: No rebase in progress?

Progress
  • parallel/test-net-write-fully-async-buffer (11)
  • parallel/test-performance-function (5)
  • parallel/test-snapshot-reproducible (5)
  • sequential/test-http-server-request-timeouts-mixed (5)
  • parallel/test-dns (3)
  • parallel/test-permission-fs-read (3)
  • parallel/test-bootstrap-modules (2)
  • parallel/test-buffer-tostring-rangeerror (2)
  • parallel/test-file-write-stream4 (2)
  • parallel/test-http-remove-header-stays-removed (2)
  • parallel/test-http2-large-write-multiple-requests (2)
  • parallel/test-performance-eventlooputil (2)
  • pummel/test-hash-seed (2)
  • Build timed out (after 60 minutes). Marking the build as failed. (2)
  • fatal: No rebase in progress? (5)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the ncu-ci reliability report and the linked CI console output for each failing test, including parallel/test-net-write-fully-async-buffer, parallel/test-performance-function, parallel/test-snapshot-reproducible, sequential/test-http-server-request-timeouts-mixed, and parallel/test-dns. Reproduce the failures in their reported environments, trace each to its test or relevant subsystem, and consider the work complete only when the identified CI failures are fixed or clearly categorized.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
18/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.