nodejs / nodejs/reliability

CI Reliability 2023-07-23

Open
#621 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/52806 to node-test-pull-request/52897 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2023-07-23 00:15 0 0 35 2 63 0.00%
JSTest Failure
Reason wpt/test-structured-clone
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/48817/, https://github.com/nodejs/node/pull/48808/, https://github.com/nodejs/node/pull/48826/, https://github.com/nodejs/node/pull/48827/, https://github.com/nodejs/node/pull/48860/, https://github.com/nodejs/node/pull/48866/)
Appeared test-rackspace-win2012r2_vs2019-x64-2, test-azure_msft-win2016_vs2017-x64-1, test-azure_msft-win2016_vs2017-x64-4, test-azure_msft-win2016_vs2017-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/52818/
Last CI https://ci.nodejs.org/job/node-test-pull-request/52886/
Example
not ok 940 wpt/test-structured-clone
  ---
  duration_ms: 439.00200
  severity: fail
  exitcode: 1
  stack: |-
    [PASS] primitive undefined
    [PASS] primitive null
    [PASS] primitive true
    [PASS] primitive false
    [PASS] primitive string, empty string
    [PASS] primitive string, lone high surrogate
    [PASS] primitive string, lone low surrogate
    [PASS] primitive string, NUL
    [PASS] primitive string, astral character
    [PASS] primitive number, 0.2
    [PASS] primitive number, 0
    [PASS] primitive number, -0
    [PASS] primitive number, NaN
    [PASS] primitive number, Infinity
    [PASS] primitive number, -Infinity
    [PASS] primitive number, 9007199254740992
    [PASS] primitive number, -9007199254740992
    [PASS] primitive number, 9007199254740994
    [PASS] primitive number, -9007199254740994
    [PASS] primitive BigInt, 0n
    [PASS] primitive BigInt, -0n
    [PASS] primitive BigInt, -9007199254740994000n
    [PASS] primitive BigInt, -90071992547409940009007199254740994000900719925...

Reason parallel/test-tls-ticket-cluster
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/42387/, https://github.com/nodejs/node/pull/48694/, https://github.com/nodejs/node/pull/48802/, https://github.com/nodejs/node/pull/48836/)
Appeared test-azure_msft-win2022_vs2019-x64-2, test-azure_msft-win2016_vs2017-x64-3, test-azure_msft-win2016_vs2017-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/52813/
Last CI https://ci.nodejs.org/job/node-test-pull-request/52854/
Example
not ok 761 parallel/test-tls-ticket-cluster
  ---
  duration_ms: 530.00000
  severity: fail
  exitcode: 1
  stack: |-
    [primary] got "listening"
    [primary] connecting 54606 session? false
    [primary] got "listening"
    [primary] got "listening"
    [primary] connecting 54606 session? false
    [worker] connection reused? false
    [primary] got "not-reused"
    [primary] connecting 54606 session? true
    [worker] connection reused? true
    [primary] got "reused"
    [primary] connecting 54606 session? true
    [worker] connection reused? true
    [primary] got "reused"
    [primary] connecting 54606 session? true
    [worker] connection reused? true
    [primary] got "reused"
    [primary] connecting 54606 session? true
    [worker] connection reused? true
    [primary] got "reused"
    [primary] connecting 54606 session? true
    [worker] connection reused? true
    [primary] got "reused"
    [primary] connecting 54606 session? true
    [worker] connection reused? true
    [primary] got "reused"
 ...

Reason parallel/test-runner-inspect
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/48638/, https://github.com/nodejs/node/pull/48761/, https://github.com/nodejs/node/pull/48808/)
Appeared test-ibm-rhel8-s390x-4, test-osuosl-rhel8-ppc64_le-4
First CI https://ci.nodejs.org/job/node-test-pull-request/52842/
Last CI https://ci.nodejs.org/job/node-test-pull-request/52868/
Example
not ok 3189 parallel/test-runner-inspect
  ---
  duration_ms: 120087.56200
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] (node:832427) Warning: Using the inspector with --test forces running at a concurrency of 1. Use the inspectPort option to run with concurrency
    [err] (Use `node --trace-warnings ...` to show where the warning was created)
    [err] 
    [out] TAP version 13
    [out] 
    [err] Debugger listening on ws://127.0.0.1:35619/e6298576-ed5f-4dc7-97d3-4974cd3e08fe
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [err] Debugger attached.
    [err] 
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [out] # Debugger ending on ws://127.0.0.1:35619/e6298576-ed5f-4dc7-97d3-4974cd3e08fe
    [out] 
  ...


Reason pummel/test-net-pause
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/48796/, https://github.com/nodejs/node/pull/48878/, https://github.com/nodejs/node/pull/48828/)
Appeared test-ibm-rhel7-s390x-3
First CI https://ci.nodejs.org/job/node-test-pull-request/52893/
Last CI https://ci.nodejs.org/job/node-test-pull-request/52895/
Example
not ok 3347 pummel/test-net-pause
  ---
  duration_ms: 1.328
  severity: fail
  exitcode: 1
  stack: |-
    C
    pause at: 1
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at Timeout._onTimeout (/home/iojs/build/workspace/node-test-commit-linuxone/test/pummel/test-net-pause.js:56:12)
        at listOnTimeout (node:internal/timers:559:17)
        at processTimers (node:internal/timers:502:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
  ...


Reason parallel/test-fs-watch-recursive-update-file
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/48828/, https://github.com/nodejs/node/pull/48878/)
Appeared test-ibm-rhel8-s390x-4, test-ibm-rhel8-s390x-1
First CI https://ci.nodejs.org/job/node-test-pull-request/52891/
Last CI https://ci.nodejs.org/job/node-test-pull-request/52894/
Example
not ok 1377 parallel/test-fs-watch-recursive-update-file
  ---
  duration_ms: 120068.73800
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-inspector-break-when-eval
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/48638/, https://github.com/nodejs/node/pull/48834/)
Appeared test-ibm-rhel8-s390x-1, test-osuosl-rhel8-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/52842/
Last CI https://ci.nodejs.org/job/node-test-pull-request/52849/
Example
not ok 1829 parallel/test-inspector-break-when-eval
  ---
  duration_ms: 15363.62600
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:42691/99e8a7a3-13fc-4d61-acc9-617c6db605e9
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [test] Setting up a debugger
    [err] Debugger attached.
    [err] 
    Timed out waiting for matching notification (Initial pause)
    1
  ...


Reason parallel/test-inspector-open-dispose
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/48811/, https://github.com/nodejs/node/pull/48660/)
Appeared test-azure_msft-win2016_vs2017-x64-1, test-azure_msft-win2016_vs2017-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/52807/
Last CI https://ci.nodejs.org/job/node-test-pull-request/52880/
Example
not ok 486 parallel/test-inspector-open-dispose
  ---
  duration_ms: 386.00400
  severity: fail
  exitcode: 1
  stack: |-
    Debugger listening on ws://127.0.0.1:62425/13bf89a2-a4c4-49b4-84b4-8d411a31d98a
    For help, see: https://nodejs.org/en/docs/inspector
    node:assert:399
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: undefined == true
        at file:///C:/workspace/node-test-binary-windows-js-suites/node/test/parallel/test-inspector-open-dispose.mjs:38:7
        at Socket.<anonymous> (file:///C:/workspace/node-test-binary-windows-js-suites/node/test/parallel/test-inspector-open-dispose.mjs:58:28)
        at Socket.emit (node:events:514:28)
        at TCP.<anonymous> (node:net:337:12) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: undefined,
      expected: true,
      operator: '=='
    }
    
    Node.js v21.0.0-pre
  ...


Reason parallel/test-worker-memory
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/48660/, https://github.com/nodejs/node/pull/48838/)
Appeared test-rackspace-win2019_vs2019-x64-3, test-rackspace-win2022_vs2022-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/52837/
Last CI https://ci.nodejs.org/job/node-test-pull-request/52884/
Example
not ok 843 parallel/test-worker-memory
  ---
  duration_ms: 1500.01400
  severity: crashed
  exitcode: 3221225477
  stack: |-
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
  ...


Reason sequential/test-https-server-keep-alive-timeout
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/48808/, https://github.com/nodejs/node/pull/48694/)
Appeared test-ibm-rhel8-s390x-4, test-equinix-ubuntu2004_container-armv7l-1, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/52806/
Last CI https://ci.nodejs.org/job/node-test-pull-request/52816/
Example
not ok 3825 sequential/test-https-server-keep-alive-timeout
  ---
  duration_ms: 984.78900
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched <anonymous> function calls. Expected exactly 3, actual 1.
        at Proxy.mustCall (/home/iojs/build/workspace/node-test-commit-linuxone/test/common/index.js:410:10)
        at serverKeepAliveTimeoutWithPipeline (/home/iojs/build/workspace/node-test-commit-linuxone/test/sequential/test-https-server-keep-alive-timeout.js:34:12)
        at run (/home/iojs/build/workspace/node-test-commit-linuxone/test/sequential/test-https-server-keep-alive-timeout.js:28:11)
        at process.processTicksAndRejections (node:internal/process/task_queues:77:11)
  ...


Reason sequential/test-worker-prof
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/48838/, https://github.com/nodejs/node/pull/48828/)
Appeared test-azure_msft-win2022_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/52858/
Last CI https://ci.nodejs.org/job/node-test-pull-request/52876/
Example
not ok 936 sequential/test-worker-prof
  ---
  duration_ms: 30324.59000
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: child exited with signal: {
      error: Error: spawnSync C:\workspace\node-test-binary-windows-js-suites\node\Release\node.exe ETIMEDOUT
          at Object.spawnSync (node:internal/child_process:1124:20)
          at spawnSync (node:child_process:876:24)
          at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\sequential\test-worker-prof.js:53:23)
          at Module._compile (node:internal/modules/cjs/loader:1233:14)
          at Module._extensions..js (node:internal/modules/cjs/loader:1287:10)
          at Module.load (node:internal/modules/cjs/loader:1091:32)
          at Module._load (node:internal/modules/cjs/loader:938:12)
          at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:83:12)
          at node:internal/main/ru...

Jenkins Failure
Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 10 (https://github.com/nodejs/node/pull/48275/, https://github.com/nodejs/node/pull/48734/, https://github.com/nodejs/node/pull/48694/, https://github.com/nodejs/node/pull/48828/, https://github.com/nodejs/node/pull/48708/, https://github.com/nodejs/node/pull/48830/, https://github.com/nodejs/node/pull/42387/, https://github.com/nodejs/node/pull/48660/, https://github.com/nodejs/node/pull/45704/, https://github.com/nodejs/node/pull/48878/)
Appeared test-rackspace-fedora32-x64-1, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/52812/
Last CI https://ci.nodejs.org/job/node-test-pull-request/52894/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 119.9.51.79/119.9.51.79:42564' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at jdk.proxy2/jdk.proxy2.$Proxy116.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)

CCTest Failure
Git Failure
Build Failure
Reason fatal error: Killed signal terminated program cc1plus
Type BUILD_FAILURE
Failed PR 10 (https://github.com/nodejs/node/pull/48694/, https://github.com/nodejs/node/pull/42387/, https://github.com/nodejs/node/pull/48761/, https://github.com/nodejs/node/pull/48834/, https://github.com/nodejs/node/pull/48827/, https://github.com/nodejs/node/pull/46824/, https://github.com/nodejs/node/pull/48660/, https://github.com/nodejs/node/pull/48859/, https://github.com/nodejs/node/pull/48796/, https://github.com/nodejs/node/pull/48879/)
Appeared test-rackspace-fedora32-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/52811/
Last CI https://ci.nodejs.org/job/node-test-pull-request/52897/
Example
fatal error: Killed signal terminated program cc1plus

Progress
  • wpt/test-structured-clone (6)
  • parallel/test-tls-ticket-cluster (4)
  • parallel/test-runner-inspect (3)
  • pummel/test-net-pause (3)
  • parallel/test-fs-watch-recursive-update-file (2)
  • parallel/test-inspector-break-when-eval (2)
  • parallel/test-inspector-open-dispose (2)
  • parallel/test-worker-memory (2)
  • sequential/test-https-server-keep-alive-timeout (2)
  • sequential/test-worker-prof (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (10)
  • fatal error: Killed signal terminated program cc1plus (10)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the listed CI runs and reproduce the named failures, including wpt/test-structured-clone, parallel/test-tls-ticket-cluster, the inspector tests, and test/pummel/test-net-pause.js at line 56. Compare failures across the listed platforms and test logs; done means the identified intermittent failures are addressed and the affected CI jobs remain green across repeated runs.

Written by the indexing model from the issue text.

Assessment

Tech stack
node.js, shell
Domain
ci-cd, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.