nodejs / nodejs/reliability

CI Reliability 2024-04-11

Open
#830 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/58158 to node-test-pull-request/58243 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-04-11 00:07 20 1 20 8 51 1.39%
Git Failure
Build Failure
Reason error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/52190/, https://github.com/nodejs/node/pull/52353/, https://github.com/nodejs/node/pull/52383/, https://github.com/nodejs/node/pull/52428/, https://github.com/nodejs/node/pull/52329/)
Appeared test-rackspace-win2022_vs2022-x64-6, test-rackspace-win2022_vs2022-x64-3, test-rackspace-win2022_vs2022-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/58167/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58243/
Example
error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
  typed-array-filter-tq-csa.cc
C:\workspace\node-compile-windows\node\deps\v8\src\codegen\interface-descriptors.h(544,1): fatal  error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
  typed-array-every-tq-csa.cc
C:\workspace\node-compile-windows\node\deps\v8\src\objects\tagged.h(502,1): fatal  error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]

Reason Failed to trigger node-test-commit
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs-private/node-private/pull/580/, https://github.com/nodejs-private/node-private/pull/579/, https://github.com/nodejs-private/node-private/pull/578/)
Appeared test-ibm-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58223/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58225/
Example
Failed to trigger node-test-commit

Reason sh: line 4: node: command not found
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52396/, https://github.com/nodejs/node/pull/52397/, https://github.com/nodejs/node/pull/52428/)
Appeared test-equinix-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/58170/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58240/
Example
sh: line 4: node: command not found

Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52381/, https://github.com/nodejs/node/pull/52108/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-ibm-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58172/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58178/
Example
fatal: No rebase in progress?

JSTest Failure
Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/52190/, https://github.com/nodejs/node/pull/52367/, https://github.com/nodejs/node/pull/52397/, https://github.com/nodejs/node/pull/52365/, https://github.com/nodejs/node/pull/52395/, https://github.com/nodejs/node/pull/52381/, https://github.com/nodejs/node/pull/52353/, https://github.com/nodejs/node/pull/52428/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-1, test-ibm-ubi81_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-digitalocean-alpine318_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58158/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58240/
Example
not ok 2893 parallel/test-http2-large-write-multiple-requests
  ---
  duration_ms: 120022.82200
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    server sends content 1
    server sends content 2
    server sends content 3
    server sends content 4
    server sends content 5
    server sends content 6
    server sends content 7
    server sends content 8
    server sends content 9
    server sends content 10
    server sends content 11
    server sends content 12
    server sends content 13
    server sends content 14
    server sends content 15
    server sends content 16
    server sends content 17
    server sends content 18
    server sends content 19
    server sends content 20
    server sends content 21
    server sends content 22
    server sends content 23
    server sends content 24
    server sends content 25
    server sends content 26
    server sends content 27
    server sends content 28
    server sends content 29
    server sends content 30
    server sends content 31
    server s...

Reason parallel/test-tls-dhe
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/52340/, https://github.com/nodejs/node/pull/52365/, https://github.com/nodejs/node/pull/52353/, https://github.com/nodejs/node/pull/52408/, https://github.com/nodejs/node/pull/52190/, https://github.com/nodejs/node/pull/52395/, https://github.com/nodejs/node/pull/52381/)
Appeared test-rackspace-win2016_vs2015-x64-1, test-azure_msft-win2016_vs2017-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/58174/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58198/
Example
not ok 762 parallel/test-tls-dhe
  ---
  duration_ms: 459.99500
  severity: fail
  exitcode: 1
  stack: |-
    node:events:496
          throw er; // Unhandled 'error' event
          ^
    
    Error: 4C200000:error:0A00041A:SSL routines:ssl3_read_bytes:tlsv1 alert decode error:C:\workspace\node-compile-windows\node\deps\openssl\openssl\ssl\record\rec_layer_s3.c:1590:SSL alert number 50
    
    Emitted 'error' event on TLSSocket instance at:
        at TLSSocket._emitTLSError (node:_tls_wrap:1041:10)
        at TLSWrap.onerror (node:_tls_wrap:482:11) {
      library: 'SSL routines',
      reason: 'tlsv1 alert decode error',
      code: 'ERR_SSL_TLSV1_ALERT_DECODE_ERROR'
    }
    
    Node.js v20.12.2-pre
  ...


Reason parallel/test-fs-read-stream-concurrent-reads
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/52408/, https://github.com/nodejs/node/pull/52190/, https://github.com/nodejs/node/pull/52397/, https://github.com/nodejs/node/pull/52353/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-3, test-macstadium-macos11.0-arm64-4, test-rackspace-win2022_vs2022-x64-4, test-rackspace-win2019_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/58182/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58203/
Example
not ok 1421 parallel/test-fs-read-stream-concurrent-reads
  ---
  duration_ms: 120047.13200
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason benchmark/test-benchmark-async-hooks
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs-private/node-private/pull/580/, https://github.com/nodejs-private/node-private/pull/579/, https://github.com/nodejs-private/node-private/pull/578/)
Appeared test-azure_msft-win10_vs2019-x64-4, test-azure_msft-win10_vs2019-x64-1, test-azure_msft-win11_vs2022-x64-1, test-azure_msft-win11_vs2022-x64-4, test-azure_msft-win11_vs2022-arm64-2, test-azure_msft-win11_vs2022-arm64-6, test-rackspace-win2016_vs2015-x64-2, test-azure_msft-win2016_vs2017-x64-2, test-azure_msft-win2016_vs2017-x64-1, test-rackspace-win2019_vs2019-x64-3, test-rackspace-win2019_vs2019-x64-4, test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2022_vs2022-x64-3, test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win11_vs2022-x64-2, test-rackspace-win2019_vs2019-x64-1, test-rackspace-win2022_vs2022-x64-6, test-azure_msft-win11_vs2022-arm64-4, test-azure_msft-win11_vs2022-x64-3, test-azure_msft-win11_vs2022-arm64-1, test-rackspace-win2016_vs2015-x64-1, test-rackspace-win2019_vs2019-x64-2, test-rackspace-win2022_vs2022-x64-2, test-azure_msft-win10_vs2019-x64-3, test-azure_msft-win11_vs2022-arm64-5, test-rackspace-win2022_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58220/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58222/
Example
not ok 170 benchmark/test-benchmark-async-hooks
  ---
  duration_ms: 1457.17000
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/child_process:414
        throw errnoException(err, 'spawn');
        ^
    
    Error: spawn EINVAL
        at ChildProcess.spawn (node:internal/child_process:414:11)
        at Object.spawn (node:child_process:761:9)
        at AutocannonBenchmarker.create (c:\workspace\node-test-binary-windows-native-suites\node\benchmark\_http-benchmarkers.js:34:33)
        at exports.run (c:\workspace\node-test-binary-windows-native-suites\node\benchmark\_http-benchmarkers.js:227:29)
        at Benchmark.http (c:\workspace\node-test-binary-windows-native-suites\node\benchmark\common.js:175:23)
        at Server.<anonymous> (c:\workspace\node-test-binary-windows-native-suites\node\benchmark\async_hooks\async-resource-vs-destroy.js:178:13)
        at Server.emit (node:events:529:35)
        at emitListeningNT (node:net:1851:10)
        at process.processTicksAndRejections (node:intern...

Reason benchmark/test-benchmark-http
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs-private/node-private/pull/580/, https://github.com/nodejs-private/node-private/pull/579/, https://github.com/nodejs-private/node-private/pull/578/)
Appeared test-azure_msft-win10_vs2019-x64-4, test-azure_msft-win10_vs2019-x64-1, test-azure_msft-win11_vs2022-x64-1, test-azure_msft-win11_vs2022-x64-4, test-azure_msft-win11_vs2022-arm64-2, test-azure_msft-win11_vs2022-arm64-6, test-rackspace-win2016_vs2015-x64-2, test-azure_msft-win2016_vs2017-x64-2, test-azure_msft-win2016_vs2017-x64-1, test-rackspace-win2019_vs2019-x64-3, test-rackspace-win2019_vs2019-x64-4, test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2022_vs2022-x64-3, test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win11_vs2022-x64-2, test-rackspace-win2019_vs2019-x64-1, test-rackspace-win2022_vs2022-x64-6, test-azure_msft-win11_vs2022-arm64-4, test-azure_msft-win11_vs2022-x64-3, test-azure_msft-win11_vs2022-arm64-1, test-rackspace-win2016_vs2015-x64-1, test-rackspace-win2019_vs2019-x64-2, test-rackspace-win2022_vs2022-x64-2, test-azure_msft-win10_vs2019-x64-3, test-azure_msft-win11_vs2022-arm64-5, test-rackspace-win2022_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58220/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58222/
Example
not ok 183 benchmark/test-benchmark-http
  ---
  duration_ms: 1124.03300
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/child_process:414
        throw errnoException(err, 'spawn');
        ^
    
    Error: spawn EINVAL
        at ChildProcess.spawn (node:internal/child_process:414:11)
        at Object.spawn (node:child_process:761:9)
        at AutocannonBenchmarker.create (c:\workspace\node-test-binary-windows-native-suites\node\benchmark\_http-benchmarkers.js:34:33)
        at exports.run (c:\workspace\node-test-binary-windows-native-suites\node\benchmark\_http-benchmarkers.js:227:29)
        at Benchmark.http (c:\workspace\node-test-binary-windows-native-suites\node\benchmark\common.js:175:23)
        at Server.<anonymous> (c:\workspace\node-test-binary-windows-native-suites\node\benchmark\http\chunked.js:36:11)
        at Object.onceWrapper (node:events:631:28)
        at Server.emit (node:events:529:35)
        at emitListeningNT (node:net:1851:10)
        at process.processTicksAndRejec...

Reason benchmark/test-benchmark-crypto
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52408/, https://github.com/nodejs/node/pull/52428/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-3, test-digitalocean-debian12-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58209/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58240/
Example
not ok 3991 benchmark/test-benchmark-crypto
  ---
  duration_ms: 2633.87300
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    1 !== 0
    
        at main (/home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/crypto/timingSafeEqual.js:21:10)
        at /home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/common.js:54:9
        at process.processTicksAndRejections (node:internal/process/task_queues:77:11) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 1,
      expected: 0,
      operator: 'strictEqual'
    }
    
    Node.js v22.0.0-pre
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    1 !== 0
    
        at ChildProcess.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux-containered/test/...

Reason benchmark/test-benchmark-http2
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52336/, https://github.com/nodejs-private/node-private/pull/578/)
Appeared test-azure_msft-win2016_vs2017-x64-2, test-azure_msft-win2016_vs2017-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58197/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58222/
Example
not ok 184 benchmark/test-benchmark-http2
  ---
  duration_ms: 1963.02100
  severity: fail
  exitcode: 1
  stack: |-
    Error: test-double-http2 failed with 3221226505.
        at ChildProcess.<anonymous> (C:\workspace\node-test-binary-windows-native-suites\node\benchmark\_http-benchmarkers.js:242:16)
        at Object.onceWrapper (node:events:632:26)
        at ChildProcess.emit (node:events:517:28)
        at maybeClose (node:internal/child_process:1098:16)
        at ChildProcess._handle.onexit (node:internal/child_process:303:5)
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    3221226505 !== 0
    
        at ChildProcess.<anonymous> (C:\workspace\node-test-binary-windows-native-suites\node\test\common\benchmark.js:28:12)
        at ChildProcess.emit (node:events:517:28)
        at ChildProcess._handle.onexit (node:internal/child_process:292:12) {
      generatedMessage: true,
      code: 'ERR_ASSERTIO...

Reason parallel/test-buffer-tostring-rangeerror
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52108/, https://github.com/nodejs/node/pull/52353/)
Appeared test-ibm-rhel8-x64-1, test-ibm-rhel8-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/58178/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58181/
Example
not ok 767 parallel/test-buffer-tostring-rangeerror
  ---
  duration_ms: 120103.71200
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    (node:1699942) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
    (Use `node --trace-deprecation ...` to show where the warning was created)
  ...


Reason parallel/test-file-write-stream4
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52408/, https://github.com/nodejs/node/pull/52383/)
Appeared test-equinix-rhel8_container-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58182/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58208/
Example
not ok 3845 parallel/test-file-write-stream4
  ---
  duration_ms: 360053.87200
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52353/, https://github.com/nodejs-private/node-private/pull/578/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58173/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58212/
Example
not ok 2286 parallel/test-performance-function
  ---
  duration_ms: 279.38500
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/errors:496
        ErrorCaptureStackTrace(err);
        ^
    
    RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be a safe integer greater than 0. Received 0
        at new NodeError (node:internal/errors:405:5)
        at RecordableHistogram.record (node:internal/histogram:290:13)
        at processComplete (node:internal/perf/timerify:40:15)
        at timerified m (node:internal/perf/timerify:87:5)
        at /home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-performance-function.js:98:5
        at runNextTicks (node:internal/process/task_queues:60:5)
        at listOnTimeout (node:internal/timers:538:9)
        at process.processTimers (node:internal/timers:512:7) {
      code: 'ERR_OUT_OF_RANGE'
    }
    
    Node.js v18.20.2
  ...


Reason parallel/test-worker-memory
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52340/, https://github.com/nodejs/node/pull/52408/)
Appeared test-azure_msft-win10_vs2019-x64-4, test-azure_msft-win11_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58174/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58182/
Example
not ok 893 parallel/test-worker-memory
  ---
  duration_ms: 1826.98200
  severity: fail
  exitcode: 3221226356
  stack: |-
    run() called with n=15 (numWorkers=4)
    run() called with n=15 (numWorkers=4)
    run() called with n=15 (numWorkers=4)
    run() called with n=15 (numWorkers=4)
    run() called with n=14 (numWorkers=4)
    run() called with n=14 (numWorkers=4)
    run() called with n=14 (numWorkers=4)
    run() called with n=14 (numWorkers=4)
    run() called with n=13 (numWorkers=4)
    run() called with n=13 (numWorkers=4)
    run() called with n=13 (numWorkers=4)
    run() called with n=13 (numWorkers=4)
    run() called with n=12 (numWorkers=4)
    run() called with n=12 (numWorkers=4)
    run() called with n=12 (numWorkers=4)
    run() called with n=12 (numWorkers=4)
    run() called with n=11 (numWorkers=4)
    run() called with n=11 (numWorkers=4)
    run() called with n=11 (numWorkers=4)
    run() called with n=11 (numWorkers=4)
    run() called with n=10 (numWorkers=4)
    run() called wi...

Progress
  • error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] (5)
  • Failed to trigger node-test-commit (3)
  • sh: line 4: node: command not found (3)
  • fatal: No rebase in progress? (2)
  • parallel/test-http2-large-write-multiple-requests (8)
  • parallel/test-tls-dhe (7)
  • parallel/test-fs-read-stream-concurrent-reads (4)
  • benchmark/test-benchmark-async-hooks (3)
  • benchmark/test-benchmark-http (3)
  • benchmark/test-benchmark-crypto (2)
  • benchmark/test-benchmark-http2 (2)
  • parallel/test-buffer-tostring-rangeerror (2)
  • parallel/test-file-write-stream4 (2)
  • parallel/test-performance-function (2)
  • parallel/test-worker-memory (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by inspecting the linked CI console logs for the listed BUILD_FAILURE and JS_TEST_FAILURE entries, especially the named parallel tests and Windows compiler error. Trace each recurring failure to its CI or test owner; done means the reported failures have confirmed resolutions and no longer recur in subsequent CI runs.

Written by the indexing model from the issue text.

Assessment

Tech stack
node.js, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.