nodejs / nodejs/reliability

CI Reliability 2024-07-11

Open
#917 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/60134 to node-test-pull-request/60228 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-07-11 00:09 1 4 21 6 68 4.30%
JSTest Failure
Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/53593/, https://github.com/nodejs/node/pull/52166/, https://github.com/nodejs/node/pull/53748/, https://github.com/nodejs/node/pull/53678/, https://github.com/nodejs/node/pull/53790/, https://github.com/nodejs/node/pull/53658/)
Appeared test-equinix_mnx-smartos20-x64-4, test-equinix-ubuntu2004_container-armv7l-2, test-equinix_mnx-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60134/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60216/
Example
not ok 3828 parallel/test-net-write-fully-async-buffer
  ---
  duration_ms: 300132.66700
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/53682/, https://github.com/nodejs/node/pull/52166/, https://github.com/nodejs/node/pull/53759/, https://github.com/nodejs/node/pull/53605/, https://github.com/nodejs/node/pull/53766/, https://github.com/nodejs/node/pull/53627/)
Appeared test-ibm-ubuntu2204-x64-2, test-ibm-rhel8-x64-2, test-ibm-rhel8-x64-1, undefined, test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-ibm-rhel9-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60135/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60219/
Example
not ok 2453 parallel/test-performance-function
  ---
  duration_ms: 264.09800
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/histogram:291
        validateInteger(val, 'val', 1);
        ^
    
    RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0
        at RecordableHistogram.record (node:internal/histogram:291:5)
        at processComplete (node:internal/perf/timerify:40:15)
        at timerified m (node:internal/perf/timerify:87:5)
        at /home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-performance-function.js:103:5
        at runNextTicks (node:internal/process/task_queues:60:5)
        at listOnTimeout (node:internal/timers:565:9)
        at process.processTimers (node:internal/timers:539:7) {
      code: 'ERR_OUT_OF_RANGE'
    }
    
    Node.js v23.0.0-pre
  ...


Reason parallel/test-snapshot-reproducible
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53593/, https://github.com/nodejs/node/pull/53682/, https://github.com/nodejs/node/pull/53619/, https://github.com/nodejs/node/pull/53766/, https://github.com/nodejs/node/pull/53605/)
Appeared test-rackspace-debian11-x64-1, test-ibm-rhel9-x64-1, test-digitalocean-fedora38-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-9, test-azure_msft-win10_vs2019-x64-1, test-azure_msft-win11_vs2022-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-rackspace-win2022_vs2022-x64-2, test-ibm-ubi81_container-x64-1, test-azure_msft-win11_vs2022-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60134/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60195/
Example
not ok 2530 parallel/test-snapshot-reproducible
  ---
  duration_ms: 1522.44600
  severity: fail
  exitcode: 1
  stack: |-
    0x0: Write magic 143da19
    0x4: Write metadata
    0x37: Write snapshot blob
    0x1734bf: Write IsolateDataSerializeInfo
    0x17499b: Write EnvSerializeInfo
    0x175834: Write CodeCacheInfo
    0x0: Write magic 143da19
    0x4: Write metadata
    0x37: Write snapshot blob
    0x1734bf: Write IsolateDataSerializeInfo
    0x17499b: Write EnvSerializeInfo
    0x175834: Write CodeCacheInfo
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
    + actual - expected
    
    + [
    +   {
    +     offset: '0x40',
    +     slice1: '0000002ea4fee4821f137731322e342e',
    +     slice2: '00000034a4dbcf821f137731322e342e'
    +   },
    +   {
    +     offset: '0x100e00',
    +     slice1: '000000000000590b31471d2c00000000',
    +     slice2: '000000000000610931471d2c00000000'
    +   }
    + ...

Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53766/, https://github.com/nodejs/node/pull/53776/, https://github.com/nodejs/node/pull/53623/, https://github.com/nodejs/node/pull/53781/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-azure_msft-win10_vs2019-x64-4, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/60186/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60221/
Example
not ok 2846 parallel/test-http2-large-write-multiple-requests
  ---
  duration_ms: 120019.17100
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    server sends content 1
    server sends content 2
    server sends content 3
    server sends content 4
    server sends content 5
    server sends content 6
    server sends content 7
    server sends content 8
    server sends content 9
    server sends content 10
    server sends content 11
    server sends content 12
    server sends content 13
    server sends content 14
    server sends content 15
    server sends content 16
    server sends content 17
    server sends content 18
    server sends content 19
    server sends content 20
    server sends content 21
    server sends content 22
    server sends content 23
    server sends content 24
    server sends content 25
    server sends content 26
    server sends content 27
    server sends content 28
    server sends content 29
    server sends content 30
    server sends content 31
    server s...

Reason sequential/test-http-server-request-timeouts-mixed
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53750/, https://github.com/nodejs/node/pull/52166/, https://github.com/nodejs/node/pull/53793/)
Appeared test-orka-macos11-x64-2, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60152/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60207/
Example
not ok 4139 sequential/test-http-server-request-timeouts-mixed
  ---
  duration_ms: 3198.53600
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:408
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
    
      assert(request2.completed)
    
        at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5)
        at listOnTimeout (node:internal/timers:601:17)
        at process.processTimers (node:internal/timers:539:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: '=='
    }
    
    Node.js v23.0.0-pre
  ...


Reason sequential/test-performance-eventloopdelay
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53576/, https://github.com/nodejs/node/pull/53781/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-ibm-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60147/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60204/
Example
not ok 3890 sequential/test-performance-eventloopdelay
  ---
  duration_ms: 7348.14600
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:408
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
    
      assert(histogram.min > 0)
    
        at Timeout.spinAWhile [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-linux-containered/test/sequential/test-performance-eventloopdelay.js:65:7)
        at listOnTimeout (node:internal/timers:601:17)
        at process.processTimers (node:internal/timers:539:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: '=='
    }
    
    Node.js v23.0.0-pre
  ...


Reason wpt/test-streams
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53682/, https://github.com/nodejs/node/pull/53605/)
Appeared test-rackspace-win2022_vs2022-x64-6, test-equinix_mnx-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60164/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60201/
Example
not ok 999 wpt/test-streams
  ---
  duration_ms: 1770.39200
  severity: crashed
  exitcode: 3221225477
  stack: |-
    [SKIPPED] idlharness-shadowrealm.window.js: ShadowRealm support is not enabled
    [SKIPPED] queuing-strategies-size-function-per-global.window.js: Browser-specific test
    [SKIPPED] readable-streams\cross-realm-crash.window.js: Browser-specific test
    [SKIPPED] readable-streams\owning-type-video-frame.any.js: Browser-specific test
    [SKIPPED] readable-streams\read-task-handling.window.js: Browser-specific test
    [SKIPPED] transferable\deserialize-error.window.js: Browser-specific test
    [SKIPPED] transferable\transfer-with-messageport.window.js: Browser-specific test
    [SKIPPED] transform-streams\invalid-realm.tentative.window.js: Browser-specific test
  ...


Jenkins Failure
Git Failure
Build Failure
Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs-private/node-private/pull/617/, https://github.com/nodejs/node/pull/53465/, https://github.com/nodejs/node/pull/53721/, https://github.com/nodejs/node/pull/53630/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/60137/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60224/
Example
fatal: No rebase in progress?

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53752/, https://github.com/nodejs/node/pull/53781/)
Appeared test-equinix-debian11_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-1, test-equinix_mnx-smartos20-x64-3, test-equinix-rhel8_container-arm64-1, test-equinix-ubuntu2004_container-arm64-2, test-osuosl-ubuntu2004_container-armv7l-1, test-equinix-ubuntu2004_sharedlibs_container-arm64-5, test-osuosl-aix72-ppc64_be-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60189/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60221/
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
[PostBuildScript] - [INFO] Executing post build scripts.
[node-test-binary-armv7l] $ /bin/bash -ex /tmp/jenkins2664230670017109998.sh
+ '[' -d .git ']'
+ git clean -fdx
Removing out/

Reason Failed to trigger sub builds
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53614/, https://github.com/nodejs/node/pull/53623/)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/60191/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60194/
Example
Failed to trigger sub builds

Progress
  • parallel/test-net-write-fully-async-buffer (6)
  • parallel/test-performance-function (6)
  • parallel/test-snapshot-reproducible (5)
  • parallel/test-http2-large-write-multiple-requests (4)
  • sequential/test-http-server-request-timeouts-mixed (3)
  • sequential/test-performance-eventloopdelay (2)
  • wpt/test-streams (2)
  • fatal: No rebase in progress? (4)
  • ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? (2)
  • Failed to trigger sub builds (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the linked CI console logs and the listed test names: parallel/test-net-write-fully-async-buffer, parallel/test-performance-function, parallel/test-snapshot-reproducible, parallel/test-http2-large-write-multiple-requests, and sequential/test-http-server-request-timeouts-mixed. Compare their first and last reported runs across the referenced platforms, then determine whether each failure still reproduces; done means the reported CI failures are understood and no longer recur.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.