CI Reliability 2022-03-09

Open
#215 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
25/100
Issue type
Bug
Clarity
Needs clarification
Activity status
Stale
Tech stack
node.js, shell

Research direction

Start with the generated ncu-ci report and its linked CI console runs, then inspect the named test entry points, including test/parallel/test-child-process-fork-closed-channel-segfault.js. Reproduce the reported timeouts, assertion failure, and EPIPE output on the affected platforms. Done means the recurring failures are resolved and the relevant CI jobs pass.

Written by the indexing model from the issue text.

Description

Failures in node-test-pull-request/42819 to node-test-pull-request/42916 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2022-03-09 00:12 1 24 15 7 53 26.09%
JSTest Failure
Reason parallel/test-crypto-key-objects
Type JS_TEST_FAILURE
Failed PR 10 (https://github.com/nodejs/node/pull/42056/, https://github.com/nodejs/node/pull/42204/, https://github.com/nodejs/node/pull/42212/, https://github.com/nodejs/node/pull/42131/, https://github.com/nodejs/node/pull/42062/, https://github.com/nodejs/node/pull/42234/, https://github.com/nodejs/node/pull/42236/, https://github.com/nodejs/node/pull/41513/, https://github.com/nodejs/node/pull/42246/, https://github.com/nodejs/node/pull/42252/)
Appeared test-equinix-centos7_container-arm64-2, test-softlayer-debian10-x64-1, test-rackspace-fedora32-x64-1, test-equinix-ubuntu1804_container-arm64-2, test-softlayer-alpine311_container-x64-1, test-equinix-ubuntu2004_container-arm64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-5, test-softlayer-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-8
First CI https://ci.nodejs.org/job/node-test-pull-request/42828/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42916/
Example
not ok 3239 parallel/test-crypto-key-objects
  ---
  duration_ms: 240.88
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-module-readonly
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/42203/, https://github.com/nodejs/node/pull/42204/, https://github.com/nodejs/node/pull/41513/, https://github.com/nodejs/node/pull/42190/, https://github.com/nodejs/node/pull/42246/, https://github.com/nodejs/node/pull/42177/)
Appeared test-nearform_arm-win10_vs2019-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/42849/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42909/
Example
not ok 465 parallel/test-module-readonly
  ---
  duration_ms: 1.88
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:991
        throw newErr;
        ^
    
    AssertionError [ERR_ASSERTION]: ifError got unwanted exception: Cannot find module '..\.tmp.456\readOnlyMod'
    Require stack:
    - c:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-module-readonly.js
        at Object.<anonymous> (c:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-module-readonly.js:48:8)
        at Function.Module._resolveFilename (node:internal/modules/cjs/loader:933:15)
        at Function.Module._load (node:internal/modules/cjs/loader:778:27)
        at Module.require (node:internal/modules/cjs/loader:999:19)
        at require (node:internal/modules/cjs/helpers:102:18)
        at Object.<anonymous> (c:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-module-readonly.js:36:3)
        at Module._compile (node:internal/modules/cjs/loader:1097:14)
        at ...

Reason node-api/test_threadsafe_function/test
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/42163/, https://github.com/nodejs/node/pull/42112/, https://github.com/nodejs/node/pull/42131/, https://github.com/nodejs/node/pull/42159/)
Appeared test-equinix-ubuntu2004_container-arm64-2, test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-equinix-centos7_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/42846/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42883/
Example
not ok 3370 node-api/test_threadsafe_function/test
  ---
  duration_ms: 240.17
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-crypto-classes
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/42161/, https://github.com/nodejs/node/pull/42247/, https://github.com/nodejs/node/pull/42109/, https://github.com/nodejs/node/pull/42177/)
Appeared test-requireio_mcollina-debian10-armv7l_pi2-1, test-requireio_williamkapke-debian10-arm64_pi3-2, test-requireio_svincent-debian10-armv7l_pi2-2, test-requireio_joeyvandijk-debian10-armv7l_pi2-2
First CI https://ci.nodejs.org/job/node-test-pull-request/42829/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42901/
Example
not ok 197 parallel/test-crypto-classes
  ---
  duration_ms: 240.121
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-crypto-dh-constructor
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/42203/, https://github.com/nodejs/node/pull/42196/, https://github.com/nodejs/node/pull/42177/)
Appeared test-requireio_svincent-debian10-armv7l_pi2-3, test-requireio_mininodes-debian10-armv7l_pi2-1, test-requireio_svincent-debian10-armv7l_pi2-2
First CI https://ci.nodejs.org/job/node-test-pull-request/42849/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42901/
Example
not ok 169 parallel/test-crypto-dh-constructor
  ---
  duration_ms: 240.115
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-child-process-fork-closed-channel-segfault
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/42155/, https://github.com/nodejs/node/pull/42211/)
Appeared test-requireio_davglass-debian10-arm64_pi3-1, test-requireio_securogroup-debian10-arm64_pi3-2, test-requireio_joeyvandijk-debian10-armv7l_pi2-2
First CI https://ci.nodejs.org/job/node-test-pull-request/42825/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42914/
Example
not ok 105 parallel/test-child-process-fork-closed-channel-segfault
  ---
  duration_ms: 3.655
  severity: fail
  exitcode: 1
  stack: |-
    /home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-child-process-fork-closed-channel-segfault.js:83
                throw err;
                ^
    
    Error: write EPIPE
        at ChildProcess.target._send (node:internal/child_process:864:20)
        at ChildProcess.<anonymous> (node:internal/child_process:667:16)
        at ChildProcess.emit (node:events:539:35)
        at emit (node:internal/child_process:936:14)
        at processTicksAndRejections (node:internal/process/task_queues:83:21) {
      errno: -32,
      code: 'EPIPE',
      syscall: 'write'
    }
    
    Node.js v18.0.0-pre
  ...


Reason parallel/test-crypto-dh
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/42056/, https://github.com/nodejs/node/pull/42212/)
Appeared test-requireio_williamkapke-debian10-arm64_pi3-1, test-requireio_williamkapke-debian10-arm64_pi3-2
First CI https://ci.nodejs.org/job/node-test-pull-request/42828/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42872/
Example
not ok 293 parallel/test-crypto-dh
  ---
  duration_ms: 240.145
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-crypto-dh-odd-key
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/42204/, https://github.com/nodejs/node/pull/42177/)
Appeared test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-requireio_svincent-debian10-armv7l_pi2-3
First CI https://ci.nodejs.org/job/node-test-pull-request/42852/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42907/
Example
not ok 199 parallel/test-crypto-dh-odd-key
  ---
  duration_ms: 240.64
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-http-header-overflow
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/42177/, https://github.com/nodejs/node/pull/42190/)
Appeared test-rackspace-win2012r2_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/42863/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42873/
Example
not ok 313 parallel/test-http-header-overflow
  ---
  duration_ms: 0.218
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:635
          throw err;
          ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal:
    + actual - expected ... Lines skipped
    
      Comparison {
    +   bytesParsed: 10642,
    -   bytesParsed: 16402,
        code: 'HPE_HEADER_OVERFLOW',
        message: 'Parse Error: Header overflow',
        name: 'Error',
    +   rawPacket: Buffer(10645) [Uint8Array] [
    ...


Reason parallel/test-net-connect-memleak
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/42203/, https://github.com/nodejs/node/pull/42246/)
Appeared test-rackspace-win2012r2_vs2017-x64-4, test-rackspace-win2012r2_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/42849/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42899/
Example
not ok 465 parallel/test-net-connect-memleak
  ---
  duration_ms: 0.243
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched noop function calls. Expected exactly 1, actual 0.
        at Proxy.mustCall (C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:369:10)
        at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-net-connect-memleak.js:33:40)
        at Module._compile (node:internal/modules/cjs/loader:1099:14)
        at Object.Module._extensions..js (node:internal/modules/cjs/loader:1153:10)
        at Module.load (node:internal/modules/cjs/loader:975:32)
        at Function.Module._load (node:internal/modules/cjs/loader:822:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:77:12)
        at node:internal/main/run_main_module:17:47
  ...


Reason sequential/test-worker-prof
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/42204/, https://github.com/nodejs/node/pull/42177/)
Appeared test-azure_msft-win10_vs2019-x64-1, test-azure_msft-win10_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/42852/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42909/
Example
not ok 850 sequential/test-worker-prof
  ---
  duration_ms: 4.51
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:123
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: child exited with non-zero status:                      {
      status: 3221226505,
      signal: null,
      output: [ null, '', '' ],
      pid: 6000,
      stdout: '',
      stderr: ''
    }
        at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\sequential\test-worker-prof.js:61:10)
        at Module._compile (node:internal/modules/cjs/loader:1099:14)
        at Object.Module._extensions..js (node:internal/modules/cjs/loader:1153:10)
        at Module.load (node:internal/modules/cjs/loader:975:32)
        at Function.Module._load (node:internal/modules/cjs/loader:822:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:77:12)
        at node:internal/main/run_main_module:17:47 {
      generatedMessage: false,
      code: 'ERR...

Reason wpt/test-webcrypto
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/42155/, https://github.com/nodejs/node/pull/42248/)
Appeared test-requireio_svincent-debian10-armv7l_pi2-3, test-joyent-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/42824/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42905/
Example
not ok 863 wpt/test-webcrypto
  ---
  duration_ms: 240.173
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    [EXPECTED_FAILURE][UNCAUGHT] evaluation in WPTRunner.runJsTests()
    location is not defined
    location is not defined
    /home/iojs/build/workspace/node-test-binary-arm/test/fixtures/wpt/common/subset-tests.js:5
      if (location.search) {
      ^
    
    ReferenceError: location is not defined
        at /home/iojs/build/workspace/node-test-binary-arm/test/fixtures/wpt/common/subset-tests.js:5:3
        at /home/iojs/build/workspace/node-test-binary-arm/test/fixtures/wpt/common/subset-tests.js:60:3
        at Script.runInThisContext (node:vm:129:12)
        at runInThisContext (node:vm:305:38)
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-binary-arm/test/common/wpt/worker.js:52:3)
        at Module._compile (node:internal/modules/cjs/loader:1099:14)
        at Object.Module._extensions..js (node:internal/modules/cjs/loader:1153:10)
        at Module.load (node:i...

Jenkins Failure
Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/42135/, https://github.com/nodejs/node/pull/42176/)
Appeared test-equinix-ubuntu2004_container-armv7l-1, test-ibm-rhel7-s390x-2, test-ibm-rhel7-s390x-4
First CI https://ci.nodejs.org/job/node-test-pull-request/42819/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42875/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 145.40.81.219/145.40.81.219:39920' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
	at com.sun.proxy.$Proxy79.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1213)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1205)

Git Failure
Build Failure
Reason ERROR: Step ?Publish JUnit test result report? failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/42109/, https://github.com/nodejs/node/pull/42177/)
Appeared test-joyent-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/42900/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42901/
Example
ERROR: Step ?Publish JUnit test result report? failed: no workspace for node-test-commit-smartos/nodes=smartos20-64 #42400
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

Reason fatal error: ld terminated with signal 9 [Killed]
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/39412/, https://github.com/nodejs/node/pull/42254/)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/42871/
Last CI https://ci.nodejs.org/job/node-test-pull-request/42911/
Example
fatal error: ld terminated with signal 9 [Killed]

Progress
  • parallel/test-crypto-key-objects (10)
  • parallel/test-module-readonly (6)
  • node-api/test_threadsafe_function/test (4)
  • parallel/test-crypto-classes (4)
  • parallel/test-crypto-dh-constructor (3)
  • parallel/test-child-process-fork-closed-channel-segfault (2)
  • parallel/test-crypto-dh (2)
  • parallel/test-crypto-dh-odd-key (2)
  • parallel/test-http-header-overflow (2)
  • parallel/test-net-connect-memleak (2)
  • sequential/test-worker-prof (2)
  • wpt/test-webcrypto (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (2)
  • ERROR: Step ?Publish JUnit test result report? failed: no workspace for ... (2)
  • fatal error: ld terminated with signal 9 [Killed] (2)
Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from nodejs/reliability

All issues in nodejs/reliability

Similar issues

More Shell/Bash issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.