nodejs / nodejs/reliability

CI Reliability 2023-01-20

Open
#489 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/48998 to node-test-pull-request/49093 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2023-01-20 00:14 1 4 31 2 62 4.12%
CCTest Failure
Reason [ RUN ] InspectorSocketTest.HostIPv6NonRoutable
Type CC_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/46225/, https://github.com/nodejs/node/pull/45796/, https://github.com/nodejs/node/pull/45770/, https://github.com/nodejs/node/pull/46237/)
Appeared test-rackspace-win2012r2_vs2019-x64-5, test-azure_msft-win10_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/49005/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49077/
Example
[ RUN      ] InspectorSocketTest.HostIPv6NonRoutable
C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected)
  Actual: true
Expected: false
[  FAILED  ] InspectorSocketTest.HostIPv6NonRoutable (5001 ms)

Jenkins Failure
Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/46227/, https://github.com/nodejs/node/pull/46242/, https://github.com/nodejs/node/pull/45942/)
Appeared test-softlayer-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/49009/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49048/
Example
Build timed out (after 60 minutes). Marking the build as failed.

Build Failure
Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 11 (https://github.com/nodejs/node/pull/45258/, https://github.com/nodejs/node/pull/46242/, https://github.com/nodejs/node/pull/46238/, https://github.com/nodejs/node/pull/45770/, https://github.com/nodejs/node/pull/45735/, https://github.com/nodejs/node/pull/46253/, https://github.com/nodejs/node/pull/46267/, https://github.com/nodejs/node/pull/45772/, https://github.com/nodejs/node/pull/45038/, https://github.com/nodejs/node/pull/46031/, https://github.com/nodejs/node/pull/46271/)
Appeared test-rackspace-fedora32-x64-1, test-osuosl-rhel8-ppc64_le-2, test-rackspace-centos7-x64-1, test-orka-macos10.15-x64-2, test-orka-macos11-x64-2, test-nearform-macos11.0-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/49019/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49088/
Example
fatal: No rebase in progress?

Reason Error: getWindowSize EINVAL
Type BUILD_FAILURE
Failed PR 10 (https://github.com/nodejs/node/pull/46226/, https://github.com/nodejs/node/pull/46209/, https://github.com/nodejs/node/pull/44943/, https://github.com/nodejs/node/pull/45258/, https://github.com/nodejs/node/pull/46251/, https://github.com/nodejs/node/pull/46250/, https://github.com/nodejs/node/pull/45772/, https://github.com/nodejs/node/pull/46253/, https://github.com/nodejs/node/pull/45936/, https://github.com/nodejs/node/pull/46031/)
Appeared test-equinix_mnx-smartos20-x64-4, test-equinix_mnx-smartos18-x64-4, test-equinix_mnx-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/48998/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49084/
Example
Error: getWindowSize EINVAL
outline =     at WriteStream._refreshSize (node:tty:132:31)
outline =     at process.refreshStderrOnSigWinch (node:internal/bootstrap/switches/is_main_thread:137:10)
outline =     at process.emit (node:events:525:35)
outline = Emitted 'error' event on WriteStream instance at:
outline =     at WriteStream._refreshSize (node:tty:132:10)

JSTest Failure
Reason pummel/test-fs-readfile-tostring-fail
Type JS_TEST_FAILURE
Failed PR 9 (https://github.com/nodejs/node/pull/46174/, https://github.com/nodejs/node/pull/46213/, https://github.com/nodejs/node/pull/45735/, https://github.com/nodejs/node/pull/45038/, https://github.com/nodejs/node/pull/46237/, https://github.com/nodejs/node/pull/46267/, https://github.com/nodejs/node/pull/46271/, https://github.com/nodejs/node/pull/44943/, https://github.com/nodejs/node/pull/46276/)
Appeared test-orka-macos11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/49063/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49090/
Example
not ok 3472 pummel/test-fs-readfile-tostring-fail
  ---
  duration_ms: 0.233
  severity: fail
  exitcode: 7
  stack: |-
    /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/pummel/test-fs-readfile-tostring-fail.js:73
      throw err;
      ^
    
    AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOSPC: no space left on device, write
        at Object.callback (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/pummel/test-fs-readfile-tostring-fail.js:31:37)
        at callback (node:internal/streams/writable:555:21)
        at onwriteError (node:internal/streams/writable:418:3)
        at onwrite (node:internal/streams/writable:460:7)
        at node:internal/fs/streams:439:14
        at FSReqCallback.wrapper [as oncomplete] (node:fs:938:5) {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: [Error: ENOSPC: no space left on device, write] {
        errno: -28,
        code: 'ENOSPC',
        syscall: 'write'
      },
      expe...

Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/46237/, https://github.com/nodejs/node/pull/46242/, https://github.com/nodejs/node/pull/46228/, https://github.com/nodejs/node/pull/45942/, https://github.com/nodejs/node/pull/46253/, https://github.com/nodejs/node/pull/45772/)
Appeared test-ibm-ubuntu1804-x64-2, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/49012/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49067/
Example
not ok 2230 parallel/test-performance-function
  ---
  duration_ms: 0.172
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/errors:490
        ErrorCaptureStackTrace(err);
        ^
    
    RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0
        at RecordableHistogram.record (node:internal/histogram:283:5)
        at processComplete (node:internal/perf/timerify:40:15)
        at timerified m (node:internal/perf/timerify:87:5)
        at /home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-performance-function.js:98:5
        at runNextTicks (node:internal/process/task_queues:60:5)
        at listOnTimeout (node:internal/timers:537:9)
        at process.processTimers (node:internal/timers:511:7) {
      code: 'ERR_OUT_OF_RANGE'
    }
    
    Node.js v20.0.0-pre
  ...


Reason sequential/test-worker-prof
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/46227/, https://github.com/nodejs/node/pull/46205/, https://github.com/nodejs/node/pull/45258/, https://github.com/nodejs/node/pull/46242/, https://github.com/nodejs/node/pull/46258/, https://github.com/nodejs/node/pull/46174/)
Appeared test-equinix-ubuntu2004_sharedlibs_container-arm64-5, test-azure_msft-win10_vs2019-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/49009/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49063/
Example
not ok 3869 sequential/test-worker-prof
  ---
  duration_ms: 1.431
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: child exited with an error:                      {
      status: null,
      signal: 'SIGTRAP',
      output: [
        null,
        '',
        '\n' +
          '\n' +
          '#\n' +
          '# Fatal error in ../deps/v8/src/libsampler/sampler.cc, line 584\n' +
          '# Debug check failed: IsActive().\n' +
          '#\n' +
          '#\n' +
          '#\n' +
          '#FailureMessage Object: 0xffff881cb508\n' +
          ' 1: 0xaaaabf391ca0 node::DumpBacktrace(_IO_FILE*) [/home/iojs/build/workspace/node-test-commit-arm-debug/out/Debug/node]\n' +
          ' 2: 0xaaaabf559f00  [/home/iojs/build/workspace/node-test-commit-arm-debug/out/Debug/node]\n' +
          ' 3: 0xaaaabf559f2c  [/home/iojs/build/workspace/node-test-commit-arm-debug/out/Debug/node]\n' +
          ' 4: 0xaaaac1129910 ...

Reason parallel/test-child-process-cwd
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/45258/, https://github.com/nodejs/node/pull/46242/, https://github.com/nodejs/node/pull/46258/, https://github.com/nodejs/node/pull/45966/)
Appeared test-nearform_arm-win10_vs2019-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/49019/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49078/
Example
not ok 98 parallel/test-child-process-cwd
  ---
  duration_ms: 0.341
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    + actual - expected
    
    + 'C:\\Windows'
    - 'C:\\WINDOWS'
            ^
        at ChildProcess.<anonymous> (c:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-child-process-cwd.js:56:26)
        at ChildProcess.<anonymous> (c:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:448:15)
        at ChildProcess.emit (node:events:519:28)
        at maybeClose (node:internal/child_process:1098:16)
        at Socket.<anonymous> (node:internal/child_process:456:11)
        at Socket.emit (node:events:519:28)
        at Pipe.<anonymous> (node:net:315:12) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 'C:\\Windows',
      expected: 'C:\\WINDOWS',
      operator: 'strictEqual'
    }
    
...

Reason parallel/test-child-process-exec-cwd
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/45258/, https://github.com/nodejs/node/pull/46242/, https://github.com/nodejs/node/pull/46258/, https://github.com/nodejs/node/pull/45966/)
Appeared test-nearform_arm-win10_vs2019-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/49019/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49078/
Example
not ok 100 parallel/test-child-process-exec-cwd
  ---
  duration_ms: 0.350
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:400
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value:
    
      assert(stdout.startsWith(dir))
    
        at c:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-child-process-exec-cwd.js:38:3
        at c:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:413:17
        at c:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:448:15
        at ChildProcess.exithandler (node:child_process:411:7)
        at ChildProcess.emit (node:events:519:28)
        at maybeClose (node:internal/child_process:1098:16)
        at ChildProcess._handle.onexit (node:internal/child_process:304:5) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: '=='
    }
    
    Node.js v20.0.0-pre
  ...


Reason pummel/test-net-throttle
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/46238/, https://github.com/nodejs/node/pull/46242/, https://github.com/nodejs/node/pull/46271/)
Appeared test-digitalocean-freebsd12-x64-1, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/49015/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49088/
Example
not ok 3500 pummel/test-net-throttle
  ---
  duration_ms: 0.579
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at process.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/pummel/test-net-throttle.js:87:10)
        at process.emit (node:events:530:35) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v20.0.0-pre
  ...


Reason parallel/test-heapsnapshot-near-heap-limit-by-api-in-worker
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46242/, https://github.com/nodejs/node/pull/46271/)
Appeared test-equinix_mnx-smartos20-x64-3, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/49020/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49091/
Example
not ok 960 parallel/test-heapsnapshot-near-heap-limit-by-api-in-worker
  ---
  duration_ms: 1.342
  severity: fail
  exitcode: 1
  stack: |-
    
    Invoked NearHeapLimitCallback, processing=false, current_limit=52428800, initial_limit=52428800
    max_young_gen_size=50331648, young_gen_size=0, old_gen_size=51437336, total_size=51437336
    Estimated available memory=3746627584, estimated overhead=50331648
    Start generating Heap.20230119.215642.305968.1.001.heapsnapshot...
    Invoked NearHeapLimitCallback, processing=true, current_limit=52428800, initial_limit=52428800
    max_young_gen_size=50331648, young_gen_size=0, old_gen_size=51437336, total_size=51437336
    Estimated available memory=3743412224, estimated overhead=50331648
    Not generating snapshots in nested callback. new_limit=102760448
    1/1 snapshots taken.
    Removing the near heap limit callbackWrote snapshot to /home/iojs/node-tmp/.tmp.959/Heap.20230119.215642.305968.1.001.heapsnapshot
    
    <--- Last few GCs --->
    
    [305968:...

Reason sequential/test-child-process-pass-fd
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/46237/, https://github.com/nodejs/node/pull/46271/)
Appeared test-macstadium-macos11.0-arm64-4, test-macstadium-macos11.0-arm64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/49074/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49082/
Example
not ok 3726 sequential/test-child-process-pass-fd
  ---
  duration_ms: 0.354
  severity: crashed
  exitcode: -10
  stack: |-
    node:events:496
          throw er; // Unhandled 'error' event
          ^
    
    Error [ERR_IPC_CHANNEL_CLOSED]: Channel closed
        at new NodeError (node:internal/errors:399:5)
        at target.send (node:internal/child_process:747:16)
        at Socket.socketConnected (/Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/test/sequential/test-child-process-pass-fd.js:62:15)
        at Object.onceWrapper (node:events:632:28)
        at Socket.emit (node:events:518:28)
        at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1479:10)
    Emitted 'error' event on process instance at:
        at node:internal/child_process:751:35
        at process.processTicksAndRejections (node:internal/process/task_queues:77:11) {
      code: 'ERR_IPC_CHANNEL_CLOSED'
    }
    
    Node.js v20.0.0-pre
    node:events:496
          throw er; // Unhandled 'error' event
    ...

Reason sequential/test-http-regr-gh-2928
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/44943/, https://github.com/nodejs/node/pull/46267/)
Appeared test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/49000/
Last CI https://ci.nodejs.org/job/node-test-pull-request/49073/
Example
not ok 3833 sequential/test-http-regr-gh-2928
  ---
  duration_ms: 120.21
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    .+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.
  ...


Progress
  • [ RUN ] InspectorSocketTest.HostIPv6NonRoutable (4)
  • Build timed out (after 60 minutes). Marking the build as failed. (3)
  • fatal: No rebase in progress? (11)
  • Error: getWindowSize EINVAL (10)
  • pummel/test-fs-readfile-tostring-fail (9)
  • parallel/test-performance-function (6)
  • sequential/test-worker-prof (6)
  • parallel/test-child-process-cwd (4)
  • parallel/test-child-process-exec-cwd (4)
  • pummel/test-net-throttle (3)
  • parallel/test-heapsnapshot-near-heap-limit-by-api-in-worker (2)
  • sequential/test-child-process-pass-fd (2)
  • sequential/test-http-regr-gh-2928 (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The report points to test/cctest/test_inspector_socket.cc, test/pummel/test-fs-readfile-tostring-fail.js, test/parallel/test-performance-function.js, and test/sequential/test-worker-prof, plus CI job logs. Start by selecting one repeated failure and running its named test while comparing the linked CI output; done requires a specific recurring failure to be explained and corrected without reproducing across the listed PR runs.

Written by the indexing model from the issue text.

Assessment

Tech stack
node.js, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.