nodejs / nodejs/reliability

CI Reliability 2024-04-22

Open
#841 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/58481 to node-test-pull-request/58578 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-04-22 00:08 0 6 15 7 72 6.45%
JSTest Failure
Reason parallel/test-error-serdes
Type JS_TEST_FAILURE
Failed PR 18 (https://github.com/nodejs/node/pull/51821/, https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52584/, https://github.com/nodejs/node/pull/52365/, https://github.com/nodejs/node/pull/52545/, https://github.com/nodejs/node/pull/52573/, https://github.com/nodejs/node/pull/49709/, https://github.com/nodejs/node/pull/52592/, https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/51050/, https://github.com/nodejs/node/pull/52611/, https://github.com/nodejs/node/pull/52435/, https://github.com/nodejs/node/pull/51340/, https://github.com/nodejs/node/pull/51657/, https://github.com/nodejs/node/pull/52624/, https://github.com/nodejs/node/pull/52616/, https://github.com/nodejs/node/pull/52465/, https://github.com/nodejs/node/pull/52625/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-digitalocean-alpine319_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-digitalocean-alpine318_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-8, test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-orka-macos11-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-9, test-ibm-ubuntu2204_sharedlibs_container-x64-4, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-ibm-ubi81_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-equinix-rhel8_container-arm64-1, test-equinix-ubuntu2004_container-arm64-2, test-orka-macos11-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-osuosl-ubuntu2004_sharedlibs_container-arm64-1, test-ibm-ubuntu2204-x64-1, test-ibm-alpine319_container-x64-1, test-rackspace-win2019_vs2019-x64-1, test-digitalocean-alpine319_container-x64-2, test-digitalocean-fedora37-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58481/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58578/
Example
not ok 1683 parallel/test-error-serdes
  ---
  duration_ms: 120121.49300
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-fs-read-stream-concurrent-reads
Type JS_TEST_FAILURE
Failed PR 9 (https://github.com/nodejs/node/pull/52104/, https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/51050/, https://github.com/nodejs/node/pull/49709/, https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/52611/, https://github.com/nodejs/node/pull/51340/, https://github.com/nodejs/node/pull/52624/, https://github.com/nodejs/node/pull/52593/)
Appeared test-equinix-debian11_container-armv7l-2, test-ibm-rhel8-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3, test-digitalocean-alpine319_container-x64-1, test-digitalocean-fedora38-x64-2, test-rackspace-win2022_vs2022-x64-3, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-rhel8-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58498/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58574/
Example
not ok 3808 parallel/test-fs-read-stream-concurrent-reads
  ---
  duration_ms: 360117.63300
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/51821/, https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52349/, https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/49709/, https://github.com/nodejs/node/pull/51192/)
Appeared test-digitalocean-rhel8-x64-1, test-rackspace-win2019_vs2019-x64-4, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-orka-macos11-x64-1, test-ibm-rhel8-x64-2, test-ibm-ubuntu2204_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/58481/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58567/
Example
not ok 2191 parallel/test-http2-large-write-multiple-requests
  ---
  duration_ms: 120052.65900
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    server sends content 1
    server sends content 2
    server sends content 3
    server sends content 4
    server sends content 5
    server sends content 6
    server sends content 7
    server sends content 8
    server sends content 9
    server sends content 10
    server sends content 11
    server sends content 12
    server sends content 13
    server sends content 14
    server sends content 15
    server sends content 16
    server sends content 17
    server sends content 18
    server sends content 19
    server sends content 20
    server sends content 21
    server sends content 22
    server sends content 23
    server sends content 24
    server sends content 25
    server sends content 26
    server sends content 27
    server sends content 28
    server sends content 29
    server sends content 30
    server sends content 31
    server s...

Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/52577/, https://github.com/nodejs/node/pull/52573/, https://github.com/nodejs/node/pull/52465/, https://github.com/nodejs/node/pull/51050/, https://github.com/nodejs/node/pull/52593/)
Appeared test-ibm-ubi81_container-x64-1, test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-digitalocean-fedora38-x64-2, test-ibm-alpine318_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58491/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58574/
Example
not ok 374 parallel/test-blob-file-backed
  ---
  duration_ms: 219.00700
  severity: fail
  exitcode: 1
  stack: |-
    
    node:internal/blob:291
              const error = lazyDOMException('The blob could not be read', 'NotReadableError');
                            ^
    DOMException [NotReadableError]: The blob could not be read
        at BlobReader.<anonymous> (node:internal/blob:291:25)
    
    Node.js v22.0.0-pre
  ...


Reason pummel/test-crypto-timing-safe-equal-benchmarks
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/52104/, https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52564/, https://github.com/nodejs/node/pull/52493/, https://github.com/nodejs/node/pull/52465/)
Appeared test-macstadium-macos11.0-arm64-4, test-rackspace-win2022_vs2022-x64-2, test-rackspace-win2019_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58482/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58572/
Example
not ok 3777 pummel/test-crypto-timing-safe-equal-benchmarks
  ---
  duration_ms: 1696.03000
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:408
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: timingSafeEqual should not leak information from its execution time (t=-7.77088616590294)
        at Object.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/test/pummel/test-crypto-timing-safe-equal-benchmarks.js:109:1)
        at Module._compile (node:internal/modules/cjs/loader:1476:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1555:10)
        at Module.load (node:internal/modules/cjs/loader:1288:32)
        at Module._load (node:internal/modules/cjs/loader:1104:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:191:14)
        at node:internal/main/run_main_module:28:49 {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: '=...

Reason parallel/test-buffer-tostring-rangeerror
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/51821/, https://github.com/nodejs/node/pull/52573/, https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52564/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-ibm-rhel8-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-8, test-ibm-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58481/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58493/
Example
not ok 732 parallel/test-buffer-tostring-rangeerror
  ---
  duration_ms: 120042.35700
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    (node:1454310) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead.
    (Use `node --trace-deprecation ...` to show where the warning was created)
  ...


Reason async-hooks/test-writewrap
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52104/, https://github.com/nodejs/node/pull/52564/, https://github.com/nodejs/node/pull/52465/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-4, test-digitalocean-ubuntu2204_sharedlibs_container-x64-8, test-ibm-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58488/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58521/
Example
not ok 3788 async-hooks/test-writewrap
  ---
  duration_ms: 120029.87400
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-file-write-stream4
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/51050/, https://github.com/nodejs/node/pull/52592/, https://github.com/nodejs/node/pull/51340/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7
First CI https://ci.nodejs.org/job/node-test-pull-request/58533/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58560/
Example
not ok 1408 parallel/test-file-write-stream4
  ---
  duration_ms: 120053.95900
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/51340/, https://github.com/nodejs/node/pull/52616/, https://github.com/nodejs/node/pull/52465/)
Appeared test-ibm-rhel8-x64-1, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/58552/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58572/
Example
not ok 2376 parallel/test-performance-function
  ---
  duration_ms: 245.76500
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/histogram:291
        validateInteger(val, 'val', 1);
        ^
    
    RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0
        at RecordableHistogram.record (node:internal/histogram:291:5)
        at processComplete (node:internal/perf/timerify:40:15)
        at timerified m (node:internal/perf/timerify:87:5)
        at /home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-performance-function.js:103:5 {
      code: 'ERR_OUT_OF_RANGE'
    }
    
    Node.js v22.0.0-pre
  ...


Reason benchmark/test-benchmark-crypto
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/51050/, https://github.com/nodejs/node/pull/51340/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-ibm-rhel9-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/58533/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58555/
Example
not ok 4009 benchmark/test-benchmark-crypto
  ---
  duration_ms: 2717.57200
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    1 !== 0
    
        at main (/home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/crypto/timingSafeEqual.js:21:10)
        at /home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/common.js:54:9
        at process.processTicksAndRejections (node:internal/process/task_queues:77:11) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 1,
      expected: 0,
      operator: 'strictEqual'
    }
    
    Node.js v22.0.0-pre
    node:assert:126
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    1 !== 0
    
        at ChildProcess.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux-containered/test/...

Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/52465/)
Appeared test-equinix-debian11_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-2, test-equinix-ubuntu2004_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/58530/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58577/
Example
not ok 3830 parallel/test-net-write-fully-async-buffer
  ---
  duration_ms: 360048.12600
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-stream-readable-unpipe-resume
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52611/, https://github.com/nodejs/node/pull/51340/)
Appeared test-ibm-ubi81_container-x64-1, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-digitalocean-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58547/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58560/
Example
not ok 3780 parallel/test-stream-readable-unpipe-resume
  ---
  duration_ms: 120070.30700
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Jenkins Failure
Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/52573/, https://github.com/nodejs/node/pull/51192/, https://github.com/nodejs/node/pull/52465/, https://github.com/nodejs/node/pull/52624/)
Appeared test-rackspace-fedora32-x64-1, test-digitalocean-debian12-x64-1, test-digitalocean-debian11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58557/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58573/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 119.9.51.79/119.9.51.79:52732' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at jdk.proxy2/jdk.proxy2.$Proxy164.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1212)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1204)

Build Failure
Reason error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
Type BUILD_FAILURE
Failed PR 12 (https://github.com/nodejs/node/pull/51821/, https://github.com/nodejs/node/pull/52552/, https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52349/, https://github.com/nodejs/node/pull/52104/, https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/49709/, https://github.com/nodejs/node/pull/52587/, https://github.com/nodejs/node/pull/51340/, https://github.com/nodejs/node/pull/51192/, https://github.com/nodejs/node/pull/51657/, https://github.com/nodejs/node/pull/52603/)
Appeared test-rackspace-win2022_vs2022-x64-3, test-rackspace-win2022_vs2022-x64-1, test-rackspace-win2022_vs2022-x64-4, test-rackspace-win2022_vs2022-x64-2, test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2022_vs2022-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/58481/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58575/
Example
error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
  promise-race-tq-csa.cc
C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.39.33519\include\tuple(452,1): fatal  error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
  promise-finally-tq-csa.cc
C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.39.33519\include\tuple(318,1): fatal  error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]

Reason fatal error: Killed signal terminated program cc1plus
Type BUILD_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/52573/, https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52365/, https://github.com/nodejs/node/pull/51657/, https://github.com/nodejs/node/pull/52465/, https://github.com/nodejs/node/pull/52593/)
Appeared test-rackspace-fedora32-x64-1, test-digitalocean-alpine318_container-x64-1, test-digitalocean-rhel8_arm_cross_container-x64-1, test-digitalocean-debian11-x64-1, test-digitalocean-rhel8_arm_cross_container-x64-2, test-softlayer-debian12-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58484/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58574/
Example
fatal error: Killed signal terminated program cc1plus

Reason ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/52293/, https://github.com/nodejs/node/pull/52573/, https://github.com/nodejs/node/pull/52616/, https://github.com/nodejs/node/pull/51192/, https://github.com/nodejs/node/pull/52465/)
Appeared test-softlayer-debian12-x64-1, test-rackspace-fedora32-x64-1, test-digitalocean-debian12-x64-1, test-digitalocean-debian11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58497/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58577/
Example
ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for node-test-commit-linux/nodes=debian12-x64 #57357
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

CCTest Failure
Progress
  • parallel/test-error-serdes (18)
  • parallel/test-fs-read-stream-concurrent-reads (9)
  • parallel/test-http2-large-write-multiple-requests (6)
  • parallel/test-blob-file-backed (5)
  • pummel/test-crypto-timing-safe-equal-benchmarks (5)
  • parallel/test-buffer-tostring-rangeerror (4)
  • async-hooks/test-writewrap (3)
  • parallel/test-file-write-stream4 (3)
  • parallel/test-performance-function (3)
  • benchmark/test-benchmark-crypto (2)
  • parallel/test-net-write-fully-async-buffer (2)
  • parallel/test-stream-readable-unpipe-resume (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (4)
  • error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] (12)
  • fatal error: Killed signal terminated program cc1plus (6)
  • ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for ... (5)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the linked CI console logs for parallel/test-error-serdes, parallel/test-fs-read-stream-concurrent-reads, and parallel/test-http2-large-write-multiple-requests, comparing their timeout output across environments. Review how ncu-ci generated the report and determine whether the repeated failures share a cause; done means the underlying CI failures are explained and the affected tests no longer fail repeatedly.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js, shell
Domain
ci-cd, observability, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.