nodejs / nodejs/reliability

CI Reliability 2024-07-31

Open
#935 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/60661 to node-test-pull-request/60756 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-07-31 00:08 0 11 20 10 59 12.22%
JSTest Failure
Reason parallel/test-http-get-pipeline-problem
Type JS_TEST_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/54087/, https://github.com/nodejs/node/pull/54070/, https://github.com/nodejs/node/pull/54045/, https://github.com/nodejs/node/pull/54076/, https://github.com/nodejs/node/pull/54092/, https://github.com/nodejs/node/pull/54104/, https://github.com/nodejs/node/pull/53825/, https://github.com/nodejs/node/pull/54049/)
Appeared test-azure_msft-win2016_vs2017-x64-2, test-azure_msft-win2016_vs2017-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60708/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60742/
Example
not ok 352 parallel/test-http-get-pipeline-problem
  ---
  duration_ms: 351.00300
  severity: fail
  exitcode: 3221226505
  stack: |-
    image.length = 45658
    recv 0
    done 0
    recv 1
    done 1
    recv 2
    done 2
    recv 3
    done 3
    recv 4
    done 4
    recv 5
    done 5
    recv 6
    done 6
    recv 7
    done 7
    recv 8
  ...


Reason wasi/test-wasi
Type JS_TEST_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/54087/, https://github.com/nodejs/node/pull/54070/, https://github.com/nodejs/node/pull/54045/, https://github.com/nodejs/node/pull/54076/, https://github.com/nodejs/node/pull/54092/, https://github.com/nodejs/node/pull/54104/, https://github.com/nodejs/node/pull/53825/, https://github.com/nodejs/node/pull/54049/)
Appeared test-azure_msft-win11_vs2022-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60708/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60742/
Example
not ok 895 wasi/test-wasi
  ---
  duration_ms: 1288.65100
  severity: fail
  exitcode: 1
  stack: |-
    executing cant_dotdot
    (node:6552) ExperimentalWarning: WASI is an experimental feature and might change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69720)
    fd_prestat_dir_name(3, 131088, 8)
    fd_prestat_get(4, 69720)
    fd_prestat_dir_name(4, 131152, 4)
    fd_prestat_get(5, 69720)
    environ_sizes_get(69724, 69720)
    environ_get(138464, 131168)
    fd_fdstat_get(3, 69672)
    path_open(3, 1, 1033, 14, 0, 264240830, 268435455, 0, 69668)
    
    executing clock_getres
    (node:5012) ExperimentalWarning: WASI is an experimental feature and might change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69688)
    fd_prestat_dir_name(3, 131088, 8)
    fd_prestat_get(4, 69688)
    fd_prestat_dir_name(4, 131152, 4)
    fd_prestat_get(5, 69688)
    environ_sizes_get(69692, 6...

Reason parallel/test-crypto-authenticated
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/54088/, https://github.com/nodejs/node/pull/54070/, https://github.com/nodejs/node/pull/54120/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-4, test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-equinix-debian11_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60700/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60745/
Example
not ok 1180 parallel/test-crypto-authenticated
  ---
  duration_ms: 120046.39500
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/54012/, https://github.com/nodejs/node/pull/53825/, https://github.com/nodejs/node/pull/54092/)
Appeared test-rackspace-win2022_vs2022-x64-5, test-digitalocean-ubi81_container-x64-1, test-ibm-alpine319_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60681/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60753/
Example
not ok 992 parallel/test-http2-large-write-multiple-requests
  ---
  duration_ms: 120190.76100
  severity: fail
  exitcode: 1
  stack: |-
    timeout
    server sends content 1
    server sends content 2
    server sends content 3
    server sends content 4
    server sends content 5
    server sends content 6
    server sends content 7
    server sends content 8
    server sends content 9
    server sends content 10
    server sends content 11
    server sends content 12
    server sends content 13
    server sends content 14
    server sends content 15
    server sends content 16
    server sends content 17
    server sends content 18
    server sends content 19
    server sends content 20
    server sends content 21
    server sends content 22
    server sends content 23
    server sends content 24
    server sends content 25
    server sends content 26
    server sends content 27
    server sends content 28
    server sends content 29
    server sends content 30
    server sends content 31
    server send...

Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/54054/, https://github.com/nodejs/node/pull/54087/, https://github.com/nodejs/node/pull/54062/)
Appeared test-ibm-ubuntu2204-x64-2, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/60667/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60714/
Example
not ok 2459 parallel/test-performance-function
  ---
  duration_ms: 215.30400
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/histogram:291
        validateInteger(val, 'val', 1);
        ^
    
    RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0
        at RecordableHistogram.record (node:internal/histogram:291:5)
        at processComplete (node:internal/perf/timerify:40:15)
        at timerified m (node:internal/perf/timerify:87:5)
        at /home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-performance-function.js:103:5
        at runNextTicks (node:internal/process/task_queues:60:5)
        at listOnTimeout (node:internal/timers:565:9)
        at process.processTimers (node:internal/timers:539:7) {
      code: 'ERR_OUT_OF_RANGE'
    }
    
    Node.js v23.0.0-pre
  ...


Reason parallel/test-dns
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/54054/, https://github.com/nodejs/node/pull/54045/)
Appeared test-azure_msft-win10_vs2019-x64-2, test-rackspace-win2019_vs2019-x64-4, test-equinix-debian11_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60661/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60702/
Example
not ok 231 parallel/test-dns
  ---
  duration_ms: 225.99900
  severity: fail
  exitcode: 1
  stack: |-
    (node:6928) [DEP0118] DeprecationWarning: The provided hostname "" is not a valid hostname, and is supported in the dns module solely for compatibility.
    (Use `node --trace-deprecation ...` to show where the warning was created)
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
    + actual - expected ... Lines skipped
    
      [
        {
          address: '1.2.3.4',
    +     ttl: 3333333332,
    -     ttl: 3333333333,
          type: 'A'
        },
        {
          address: '::42',
    +     ttl: 3333333332,
    -     ttl: 3333333333,
          type: 'AAAA'
    ...


Reason parallel/test-performance-eventlooputil
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/54087/, https://github.com/nodejs/node/pull/54092/)
Appeared test-ibm-rhel8-x64-1, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/60706/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60753/
Example
not ok 2406 parallel/test-performance-eventlooputil
  ---
  duration_ms: 343.03400
  severity: fail
  exitcode: 1
  stack: |-
    
    node:internal/event_target:1090
      process.nextTick(() => { throw err; });
                               ^
    AssertionError [ERR_ASSERTION]: 49.8903431892395 >= 49.8903431892395
        at Timeout.r (/home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-performance-eventlooputil.js:52:10)
        at Timeout.r [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-linux/test/common/index.js:487:15)
        at listOnTimeout (node:internal/timers:601:17)
        at process.processTimers (node:internal/timers:539:7) {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: '=='
    }
    
    Node.js v23.0.0-pre
  ...


Reason parallel/test-stream-readable-unpipe-resume
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/54053/, https://github.com/nodejs/node/pull/54081/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-4, test-digitalocean-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60698/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60750/
Example
not ok 3695 parallel/test-stream-readable-unpipe-resume
  ---
  duration_ms: 120099.24600
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason pummel/test-hash-seed
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/54054/, https://github.com/nodejs/node/pull/54049/)
Appeared test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60661/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60673/
Example
not ok 3845 pummel/test-hash-seed
  ---
  duration_ms: 83567.44300
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/errors:983
      const err = new Error(message);
                  ^
    
    Error: Command failed: /home/iojs/build/workspace/node-test-commit-linux/out/Release/node --allow-natives-syntax /home/iojs/build/workspace/node-test-commit-linux/test/fixtures/guess-hash-seed.js
    /home/iojs/build/workspace/node-test-commit-linux/test/fixtures/guess-hash-seed.js:163
      throw new Error('no candidates remaining');
      ^
    
    Error: no candidates remaining
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux/test/fixtures/guess-hash-seed.js:163:9)
        at Module._compile (node:internal/modules/cjs/loader:1542:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1687:10)
        at Module.load (node:internal/modules/cjs/loader:1313:32)
        at Module._load (node:internal/modules/cjs/loader:1123:12)
        at TracingChannel.traceS...

Reason wpt/test-encoding
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/54076/, https://github.com/nodejs/node/pull/54092/)
Appeared test-rackspace-win2019_vs2019-x64-4, test-rackspace-win2019_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60729/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60756/
Example
not ok 1001 wpt/test-encoding
  ---
  duration_ms: 2926.83000
  severity: fail
  exitcode: 3221226356
  stack: |-
    [SKIPPED] idlharness-shadowrealm.window.js: ShadowRealm support is not enabled
    [SKIPPED] iso-2022-jp-decoder.any.js: iso-2022-jp decoder state handling bug: https://encoding.spec.whatwg.org/#iso-2022-jp-decoder
    [SKIPPED] legacy-mb-schinese\gb18030\gb18030-decoder.any.js: The gb18030 encoding is not supported
    [SKIPPED] legacy-mb-schinese\gbk\gbk-decoder.any.js: The gbk encoding is not supported
    [SKIPPED] replacement-encodings.any.js: decoding-helpers.js needs XMLHttpRequest
    [SKIPPED] single-byte-decoder.window.js?XMLHttpRequest: document is not defined
    [SKIPPED] single-byte-decoder.window.js?TextDecoder: document is not defined
    [SKIPPED] single-byte-decoder.window.js?document: document is not defined
    [SKIPPED] streams\invalid-realm.window.js: document is not defined
    [SKIPPED] streams\realms.window.js: window is not defined
    [SKIPPED] textdecoder-fatal-sing...

Jenkins Failure
Git Failure
Build Failure
Reason Error: getWindowSize EINVAL
Type BUILD_FAILURE
Failed PR 10 (https://github.com/nodejs/node/pull/54049/, https://github.com/nodejs/node/pull/54039/, https://github.com/nodejs/node/pull/54032/, https://github.com/nodejs/node/pull/54075/, https://github.com/nodejs/node/pull/54088/, https://github.com/nodejs/node/pull/54053/, https://github.com/nodejs/node/pull/54038/, https://github.com/nodejs/node/pull/54076/, https://github.com/nodejs/node/pull/48528/, https://github.com/nodejs/node/pull/53825/)
Appeared test-equinix_mnx-smartos20-x64-3, test-equinix_mnx-smartos20-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/60673/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60737/
Example
Error: getWindowSize EINVAL
outline =     at WriteStream._refreshSize (node:tty:137:24)
outline =     at process.refreshStderrOnSigWinch (node:internal/bootstrap/switches/is_main_thread:142:10)
outline =     at process.emit (node:events:532:35)
outline = Emitted 'error' event on WriteStream instance at:
outline =     at WriteStream._refreshSize (node:tty:137:10)

Reason Error: EBUSY: resource busy or locked, rmdir '\?\C:\workspace\node-test-binary-windows-js-suites\node\test.tmp.637'
Type BUILD_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/54087/, https://github.com/nodejs/node/pull/54070/, https://github.com/nodejs/node/pull/54045/, https://github.com/nodejs/node/pull/54076/, https://github.com/nodejs/node/pull/54092/, https://github.com/nodejs/node/pull/54104/, https://github.com/nodejs/node/pull/53825/, https://github.com/nodejs/node/pull/54049/)
Appeared test-rackspace-win2022_vs2022-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/60708/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60742/
Example
Error: EBUSY: resource busy or locked, rmdir '\\?\C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.637'
        at rmdirSync (node:fs:1222:10)
        at _rmdirSync (node:internal/fs/rimraf:235:5)
        at rimrafSync (node:internal/fs/rimraf:193:7)
        at Object.rmSync (node:fs:1271:10)
        at rmSync (C:\workspace\node-test-binary-windows-js-suites\node\test\common\tmpdir.js:9:6)

Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/53964/, https://github.com/nodejs/node/pull/54088/, https://github.com/nodejs/node/pull/54087/, https://github.com/nodejs/node/pull/54038/, https://github.com/nodejs/node/pull/54104/, https://github.com/nodejs/node/pull/54081/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-4, test-mnx-ubuntu2204-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60668/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60750/
Example
fatal: No rebase in progress?

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/54087/, https://github.com/nodejs/node/pull/54113/)
Appeared test-equinix-debian11_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-1, test-equinix-debian11_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60705/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60751/
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
[PostBuildScript] - [INFO] Executing post build scripts.
[node-test-binary-armv7l] $ /bin/bash -ex /tmp/jenkins12143899245155105724.sh
+ '[' -d .git ']'
+ git clean -fdx
Removing out/

Progress
  • parallel/test-http-get-pipeline-problem (8)
  • wasi/test-wasi (8)
  • parallel/test-crypto-authenticated (3)
  • parallel/test-http2-large-write-multiple-requests (3)
  • parallel/test-performance-function (3)
  • parallel/test-dns (2)
  • parallel/test-performance-eventlooputil (2)
  • parallel/test-stream-readable-unpipe-resume (2)
  • pummel/test-hash-seed (2)
  • wpt/test-encoding (2)
  • Error: getWindowSize EINVAL (10)
  • Error: EBUSY: resource busy or locked, rmdir '\\?\C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.637' (8)
  • fatal: No rebase in progress? (6)
  • ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the listed CI logs and reproduce the named failures: parallel/test-http-get-pipeline-problem, wasi/test-wasi, parallel/test-crypto-authenticated, parallel/test-http2-large-write-multiple-requests, parallel/test-performance-function, and parallel/test-dns. The issue does not identify source files or a specific fix; done requires determining which failures are genuine reliability problems and addressing or documenting each one.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, javascript, nodejs
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.