nodejs / nodejs/reliability

CI Reliability 2023-10-02

Open
#681 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/54353 to node-test-pull-request/54449 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2023-10-02 00:13 2 22 10 1 65 22.68%
JSTest Failure
Reason pummel/test-heapdump-shadow-realm
Type JS_TEST_FAILURE
Failed PR 18 (https://github.com/nodejs/node/pull/49899/, https://github.com/nodejs/node/pull/49828/, https://github.com/nodejs/node/pull/48056/, https://github.com/nodejs/node/pull/49912/, https://github.com/nodejs/node/pull/42651/, https://github.com/nodejs/node/pull/49953/, https://github.com/nodejs/node/pull/49730/, https://github.com/nodejs/node/pull/49756/, https://github.com/nodejs/node/pull/48882/, https://github.com/nodejs/node/pull/49930/, https://github.com/nodejs/node/pull/49905/, https://github.com/nodejs/node/pull/49340/, https://github.com/nodejs/node/pull/49984/, https://github.com/nodejs/node/pull/49979/, https://github.com/nodejs/node/pull/49973/, https://github.com/nodejs/node/pull/49982/, https://github.com/nodejs/node/pull/49914/, https://github.com/nodejs/node/pull/49999/)
Appeared test-azure_msft-win2016_vs2017-x64-2, test-azure_msft-win2016_vs2017-x64-1, test-azure_msft-win2016_vs2017-x64-6, test-azure_msft-win2016_vs2017-x64-5, test-ibm-ubuntu1804-x64-2, test-azure_msft-win2016_vs2017-x64-4, test-azure_msft-win2016_vs2017-x64-3, test-digitalocean-fedora32-x64-1, test-rackspace-debian10-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/54361/
Last CI https://ci.nodejs.org/job/node-test-pull-request/54449/
Example
not ok 913 pummel/test-heapdump-shadow-realm
  ---
  duration_ms: 14031.92700
  severity: fail
  exitcode: 3221226505
  stack: |-
    (node:5944) internal/test/binding: These APIs are for internal testing only. Do not use them.
    (Use `node --trace-warnings ...` to show where the warning was created)
  ...


Reason sequential/test-http-regr-gh-2928
Type JS_TEST_FAILURE
Failed PR 10 (https://github.com/nodejs/node/pull/49899/, https://github.com/nodejs/node/pull/46608/, https://github.com/nodejs/node/pull/49912/, https://github.com/nodejs/node/pull/49953/, https://github.com/nodejs/node/pull/49340/, https://github.com/nodejs/node/pull/49905/, https://github.com/nodejs/node/pull/49980/, https://github.com/nodejs/node/pull/49982/, https://github.com/nodejs/node/pull/49979/, https://github.com/nodejs/node/pull/49987/)
Appeared test-azure_msft-win2016_vs2017-x64-3, test-azure_msft-win2016_vs2017-x64-6, test-azure_msft-win2016_vs2017-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/54353/
Last CI https://ci.nodejs.org/job/node-test-pull-request/54441/
Example
not ok 936 sequential/test-http-regr-gh-2928
  ---
  duration_ms: 360.02600
  severity: fail
  exitcode: 3221226505
  stack: |-
    .+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.
  ...


Reason es-module/test-wasm-web-api
Type JS_TEST_FAILURE
Failed PR 9 (https://github.com/nodejs/node/pull/49891/, https://github.com/nodejs/node/pull/49899/, https://github.com/nodejs/node/pull/49828/, https://github.com/nodejs/node/pull/49950/, https://github.com/nodejs/node/pull/48056/, https://github.com/nodejs/node/pull/49340/, https://github.com/nodejs/node/pull/49974/, https://github.com/nodejs/node/pull/49980/, https://github.com/nodejs/node/pull/49973/)
Appeared test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-equinix-ubuntu2004_sharedlibs_container-arm64-5, test-equinix-ubuntu2004_sharedlibs_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/54355/
Last CI https://ci.nodejs.org/job/node-test-pull-request/54417/
Example
not ok 3887 es-module/test-wasm-web-api
  ---
  duration_ms: 960096.77100
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason sequential/test-perf-hooks
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/47613/, https://github.com/nodejs/node/pull/48638/, https://github.com/nodejs/node/pull/46608/, https://github.com/nodejs/node/pull/49966/, https://github.com/nodejs/node/pull/49963/, https://github.com/nodejs/node/pull/49837/, https://github.com/nodejs/node/pull/49956/)
Appeared test-ibm-rhel7-s390x-1
First CI https://ci.nodejs.org/job/node-test-pull-request/54357/
Last CI https://ci.nodejs.org/job/node-test-pull-request/54401/
Example
not ok 3721 sequential/test-perf-hooks
  ---
  duration_ms: 0.636
  severity: fail
  exitcode: 1
  stack: |-
    {
      name: 'node',
      entryType: 'node',
      startTime: 0,
      duration: { around: 164.73612546920776 },
      nodeStart: { around: 0 },
      v8Start: { around: 0 },
      bootstrapComplete: { around: 164.71987533569336, delay: 2500 },
      environment: { around: 0 },
      loopStart: -1,
      loopExit: -1
    }
    node:assert:400
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: duration: 313.872624874115 >= 250
        at checkNodeTiming (/home/iojs/build/workspace/node-test-commit-linuxone/test/sequential/test-perf-hooks.js:31:7)
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-linuxone/test/sequential/test-perf-hooks.js:43:1)
        at Module._compile (node:internal/modules/cjs/loader:1198:14)
        at Object.Module._extensions..js (node:internal/modules/cjs/loader:1252:10)
        at Module.load (node:internal/modules/cjs/loader:10...

Reason parallel/test-tls-socket-close
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/49896/, https://github.com/nodejs/node/pull/46608/, https://github.com/nodejs/node/pull/49912/, https://github.com/nodejs/node/pull/49974/, https://github.com/nodejs/node/pull/49712/)
Appeared test-ibm-rhel8-s390x-3, test-nearform-macos11.0-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/54354/
Last CI https://ci.nodejs.org/job/node-test-pull-request/54421/
Example
not ok 2868 parallel/test-tls-socket-close
  ---
  duration_ms: 169.20500
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at Immediate._onImmediate (/home/iojs/build/workspace/node-test-commit-linuxone/test/parallel/test-tls-socket-close.js:49:18)
        at process.processImmediate (node:internal/timers:478:21) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v21.0.0-pre
  ...


Reason es-module/test-esm-loader-resolve-type
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/49982/, https://github.com/nodejs/node/pull/49979/)
Appeared test-nearform-macos11.0-arm64-1, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/54430/
Last CI https://ci.nodejs.org/job/node-test-pull-request/54435/
Example
not ok 3550 es-module/test-esm-loader-resolve-type
  ---
  duration_ms: 315.71100
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/process/esm_loader:40
          internalBinding('errors').triggerUncaughtException(
                                    ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
    + actual - expected
    
      {
        code: 0,
        signal: null,
        stderr: '',
    +   stdout: '{"before":{"importedESM":0,"importedCJS":0},"after":{"importedESM":0,"importedCJS":0}}\n'
    -   stdout: '{"before":{"importedESM":0,"importedCJS":0},"after":{"importedESM":1,"importedCJS":0}}\n'
      }
        at file:///Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/test/es-module/test-esm-loader-resolve-type.mjs:34:3 {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: {
        code: 0,
        signal: null,
        stderr: '',
        stdout: '{"before":{"importedESM":0,"importedCJS":0},"after":{"importedESM":0...

Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/49930/, https://github.com/nodejs/node/pull/49987/)
Appeared test-ibm-rhel8-s390x-1, test-digitalocean-alpine318_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/54404/
Last CI https://ci.nodejs.org/job/node-test-pull-request/54441/
Example
not ok 84 parallel/test-blob-file-backed
  ---
  duration_ms: 85.84600
  severity: fail
  exitcode: 1
  stack: |-
    
    node:internal/per_context/domexception:53
        ErrorCaptureStackTrace(this);
        ^
    DOMException [NotReadableError]: The blob could not be read
        at new DOMException (node:internal/per_context/domexception:53:5)
        at __node_internal_ (node:internal/util:698:10)
        at BlobReader.<anonymous> (node:internal/blob:291:25)
    
    Node.js v21.0.0-pre
  ...


Reason parallel/test-worker-memory
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/49340/, https://github.com/nodejs/node/pull/49992/)
Appeared test-rackspace-win2019_vs2019-x64-4, test-azure_msft-win2022_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/54385/
Last CI https://ci.nodejs.org/job/node-test-pull-request/54439/
Example
not ok 858 parallel/test-worker-memory
  ---
  duration_ms: 1430.01500
  severity: crashed
  exitcode: 3221225477
  stack: |-
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=7.5 (numWorkers=8)
    run() called with n=6.5 (numWorkers=8)
    run() called with n=6.5 (numWorkers=8)
    run() called with n=6.5 (numWorkers=8)
    run() called with n=6.5 (numWorkers=8)
    run() called with n=6.5 (numWorkers=8)
    run() called with n=6.5 (numWorkers=8)
    run() called with n=6.5 (numWorkers=8)
    run() called with n=6.5 (numWorkers=8)
    run() called with n=5.5 (numWorkers=8)
    run() called with n=5.5 (numWorkers=8)
    run() called with n=5.5 (numWorkers=8)
    run() called with n=5.5 (numWorkers=8)
    run() called with n=5.5 (numWorker...

Reason sequential/test-single-executable-application-snapshot-and-code-cache
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/49958/, https://github.com/nodejs/node/pull/42651/)
Appeared test-azure_msft-win2016_vs2017-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/54379/
Last CI https://ci.nodejs.org/job/node-test-pull-request/54384/
Example
not ok 945 sequential/test-single-executable-application-snapshot-and-code-cache
  ---
  duration_ms: 16434.31600
  severity: fail
  exitcode: 1
  stack: |-
    [process 8000]: --- stderr ---
    Aborted()
    
    [process 8000]: --- stdout ---
    Start injection of NODE_SEA_BLOB in C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.944\sea.exe...
    Error: Aborted(). Build with -sASSERTIONS for more info.
    
    [process 8000]: status = 1, signal = null
    C:\workspace\node-test-binary-windows-js-suites\node\test\common\child_process.js:86
        throw new Error(`${failures.join('\n')}`);
        ^
    
    Error: - process terminated with status 1, expected 0
        at logAndThrow (C:\workspace\node-test-binary-windows-js-suites\node\test\common\child_process.js:86:11)
        at expectSyncExit (C:\workspace\node-test-binary-windows-js-suites\node\test\common\child_process.js:91:5)
        at spawnSyncAndExitWithoutError (C:\workspace\node-test-binary-windows-js-suites\...

Jenkins Failure
Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/49930/, https://github.com/nodejs/node/pull/49956/, https://github.com/nodejs/node/pull/49980/)
Appeared test-rackspace-win2019_vs2019-x64-1, test-digitalocean-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/54404/
Last CI https://ci.nodejs.org/job/node-test-pull-request/54413/
Example
Build timed out (after 60 minutes). Marking the build as failed.

Git Failure
Build Failure
Reason fatal: '/home/iojs/.ccache/node.shared.reference' does not appear to be a git repository
Type BUILD_FAILURE
Failed PR 10 (https://github.com/nodejs/node/pull/48638/, https://github.com/nodejs/node/pull/49828/, https://github.com/nodejs/node/pull/49837/, https://github.com/nodejs/node/pull/49756/, https://github.com/nodejs/node/pull/49974/, https://github.com/nodejs/node/pull/49980/, https://github.com/nodejs/node/pull/49962/, https://github.com/nodejs/node/pull/49979/, https://github.com/nodejs/node/pull/49996/, https://github.com/nodejs/node/pull/49999/)
Appeared test-equinix-ubuntu2004_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/54365/
Last CI https://ci.nodejs.org/job/node-test-pull-request/54449/
Example
fatal: '/home/iojs/.ccache/node.shared.reference' does not appear to be a git repository
fatal: Could not read from remote repository.
fatal: failed to run repack

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/49720/, https://github.com/nodejs/node/pull/49928/)
Appeared test-equinix-ubuntu2004_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/54358/
Last CI https://ci.nodejs.org/job/node-test-pull-request/54395/
Example
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
[PostBuildScript] - [INFO] Executing post build scripts.
[node-test-binary-armv7l] $ /bin/bash -ex /tmp/jenkins7988188718491008992.sh
+ '[' -d .git ']'
+ git clean -fdx

Progress
  • pummel/test-heapdump-shadow-realm (18)
  • sequential/test-http-regr-gh-2928 (10)
  • es-module/test-wasm-web-api (9)
  • sequential/test-perf-hooks (7)
  • parallel/test-tls-socket-close (5)
  • es-module/test-esm-loader-resolve-type (2)
  • parallel/test-blob-file-backed (2)
  • parallel/test-worker-memory (2)
  • sequential/test-single-executable-application-snapshot-and-code-cache (2)
  • Build timed out (after 60 minutes). Marking the build as failed. (3)
  • fatal: '/home/iojs/.ccache/node.shared.reference' does not appear to be a git repository (10)
  • ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the linked CI jobs and the named failing tests, including test/sequential/test-perf-hooks.js and test/parallel/test-tls-socket-close.js, then compare the provided failure logs across platforms. Done would require addressing the reported reliability failures so the affected CI runs no longer fail, but the report does not define a specific fix or scope.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, nodejs, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.