nodejs / nodejs/reliability

CI Reliability 2020-08-03

Open
#32 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/32505 to node-test-pull-request/32603 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2020-08-03 00:34 1 31 0 22 46 40.26%
JSTest Failure
Reason parallel/test-fs-symlink
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/34540/, https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34568/, https://github.com/nodejs/node/pull/34342/, https://github.com/nodejs/node/pull/34558/)
Appeared test-joyent-alpine312_container-x64-1, test-osuosl-centos7-ppc64_le-2, undefined, test-digitalocean-ubi81_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-digitalocean-alpine311_container-x64-1, test-rackspace-centos7-x64-1, test-digitalocean-debian9-x64-1, test-rackspace-fedora27-x64-1, test-digitalocean-fedora30-x64-2, test-digitalocean-ubuntu1804-x64-1, test-azure_msft-win10_vcbt2015-x64-3, test-rackspace-win2012r2_vs2017-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32524/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32586/
Example
not ok 698 parallel/test-fs-symlink
  ---
  duration_ms: 0.120
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:885
        throw newErr;
        ^
    
    AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOENT: no such file or directory, lstat '/home/iojs/node-tmp/.tmp.696/symlink1.js'
        at /home/iojs/build/workspace/node-test-commit-linux/nodes/alpine-latest-x64/test/parallel/test-fs-symlink.js:46:12
        at /home/iojs/build/workspace/node-test-commit-linux/nodes/alpine-latest-x64/test/common/index.js:365:15
        at FSReqCallback.oncomplete (fs.js:176:21)
     {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: [Error: ENOENT: no such file or directory, lstat '/home/iojs/node-tmp/.tmp.696/symlink1.js'] {
        errno: -2,
        code: 'ENOENT',
        syscall: 'lstat',
        path: '/home/iojs/node-tmp/.tmp.696/symlink1.js'
      },
      expected: null,
      operator: 'ifError'
    }
  ...


Reason parallel/test-net-dns-error
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34336/, https://github.com/nodejs/node/pull/34540/, https://github.com/nodejs/node/pull/34542/)
Appeared test-azure_msft-win10_vcbt2015-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32512/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32532/
Example
not ok 335 parallel/test-net-dns-error
  ---
  duration_ms: 0.264
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:84
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Input A expected to strictly equal input B:
    + expected - actual
    
    - 'EAI_FAIL'
    + 'ENOTFOUND'
        at Socket.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-net-dns-error.js:37:10)
        at Socket.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:379:15)
        at Socket.emit (events.js:198:13)
        at GetAddrInfoReqWrap.emitLookup [as callback] (net.js:1005:12)
        at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:56:17)
  ...


Reason parallel/test-policy-integrity
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34372/, https://github.com/nodejs/node/pull/34375/, https://github.com/nodejs/node/pull/34404/)
Appeared test-digitalocean-freebsd11-x64-1, test-rackspace-fedora27-x64-1, test-digitalocean-ubuntu1804-x64-1, test-joyent-smartos18-x64-3, test-packetnet-centos7-arm64-2, test-requireio_svincent-debian10-armv7l_pi2-3, test-requireio_williamkapke-debian10-arm64_pi3-1, test-digitalocean-freebsd11-x64-2, test-softlayer-centos7-x64-1, test-joyent-smartos18-x64-4, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-requireio_pivotalagency-debian10-arm64_pi3-2, test-azure_msft-win10_vcbt2015-x64-4, test-rackspace-win2012r2_vs2017-x64-4, test-digitalocean-debian9-x64-1, test-azure_msft-win10_vs2019-x64-4, test-rackspace-win2012r2_vs2013-x64-1, test-requireio_svincent-debian10-armv7l_pi2-1, test-requireio_piccoloaiutante-debian10-arm64_pi3-1, test-azure_msft-win10_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32544/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32580/
Example
not ok 1747 parallel/test-policy-integrity
  ---
  duration_ms: 120.278
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason benchmark/test-benchmark-napi
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34542/, https://github.com/nodejs/node/pull/28237/)
Appeared test-digitalocean-freebsd11-x64-2, test-joyent-alpine311_container-x64-1, test-joyent-alpine312_container-x64-1, test-softlayer-centos7-x64-1, test-digitalocean-debian9-x64-1, test-rackspace-fedora27-x64-1, test-digitalocean-fedora30-x64-2, test-rackspace-ubuntu1604-x64-2, test-digitalocean-ubuntu1804-x64-1, test-orka-macos10.14-x64-2, test-nearform-macos10.15-x64-3, test-osuosl-centos7-ppc64_le-1, test-joyent-smartos18-x64-4, test-digitalocean-ubi81_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-10, test-digitalocean-ubuntu1804_sharedlibs_container-x64-6, test-joyent-ubuntu1804_sharedlibs_container-x64-1, test-packetnet-centos7-arm64-2, test-ibm-rhel7-s390x-1, test-ibm-aix71-ppc64_be-2, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-requireio_williamkapke-debian10-arm64_pi3-1, test-digitalocean-freebsd11-x64-1, test-digitalocean-alpine311_container-x64-1, test-softlayer-alpine312_container-x64-1, test-rackspace-centos7-x64-1, test-orka-macos10.14-x64-1, test-nearform-macos10.15-x64-2, test-joyent-smartos18-x64-3, test-softlayer-ubuntu1804_sharedlibs_container-x64-4, test-softlayer-ubuntu1804_sharedlibs_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-packetnet-centos7-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32529/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32530/
Example
not ok 2906 benchmark/test-benchmark-napi
  ---
  duration_ms: 1.793
  severity: fail
  exitcode: 1
  stack: |-
    internal/modules/cjs/loader.js:1102
      throw err;
      ^
    
    Error: Cannot find module '/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/benchmark/napi/type-tag'
        at Function.Module._resolveFilename (internal/modules/cjs/loader.js:1099:15)
        at Function.Module._load (internal/modules/cjs/loader.js:942:27)
        at Function.executeUserEntryPoint [as runMain] (internal/modules/run_main.js:60:12)
        at internal/main/run_main_module.js:17:47 {
      code: 'MODULE_NOT_FOUND',
      requireStack: []
    }
    assert.js:103
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    1 !== 0
    
        at ChildProcess.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/common/benchmark.js:30:12)
        at ChildProcess.emit (events.j...

Reason parallel/test-http-parser-timeout-reset
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34602/, https://github.com/nodejs/node/pull/34531/)
Appeared test-digitalocean-freebsd11-x64-2, test-ibm-aix71-ppc64_be-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32602/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32603/
Example
not ok 1132 parallel/test-http-parser-timeout-reset
  ---
  duration_ms: 1.371
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched noop function calls. Expected exactly 3, actual 6.
        at Proxy.mustCall (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/common/index.js:331:10)
        at Server.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/parallel/test-http-parser-timeout-reset.js:37:42)
        at Object.onceWrapper (events.js:420:28)
        at Server.emit (events.js:314:20)
        at emitListeningNT (net.js:1322:10)
        at processTicksAndRejections (internal/process/task_queues.js:79:21)
  ...


Reason parallel/test-worker-stdio
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34548/)
Appeared test-requireio_sambthompson-debian10-armv7l_pi2-1, test-requireio_svincent-debian10-armv7l_pi2-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32538/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32573/
Example
not ok 685 parallel/test-worker-stdio
  ---
  duration_ms: 244.773
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason sequential/test-inspector-stop-profile-after-done
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34558/)
Appeared test-osuosl-centos7-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32566/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32585/
Example
not ok 3046 sequential/test-inspector-stop-profile-after-done
  ---
  duration_ms: 0.343
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:41330/f6277107-ba93-4b98-ad7e-3c28d837b718
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [err] Debugger attached.
    [err] 
    [out] {}
    [out] 
    [out] {}
    [out] 
    [out] {}
    [out] 
    Mismatched noop function calls. Expected exactly 1, actual 0.
        at Proxy.mustCall (/home/iojs/build/workspace/node-test-commit-plinux/nodes/centos7-ppcle/test/common/index.js:331:10)
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-plinux/nodes/centos7-ppcle/test/sequential/test-inspector-stop-profile-after-done.js:30:24)
        at Module._compile (internal/modules/cjs/loader.js:1270:30)
        at Object.Module._extensions..js (internal/modules/cjs/loader.js:1291:10)
        at Module.load (interna...

Jenkins Failure
Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/34336/, https://github.com/nodejs/node/pull/34542/, https://github.com/nodejs/node/pull/34342/, https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34569/)
Appeared test-orka-macos10.15-x64-2, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-orka-macos10.14-x64-2, test-orka-macos10.14-x64-3, test-orka-macos10.14-x64-1, test-requireio_piccoloaiutante-debian10-arm64_pi3-1, test-requireio_svincent-debian10-armv7l_pi2-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32511/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32599/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 199.7.167.99/199.7.167.99:10671' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at com.sun.proxy.$Proxy71.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1147)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1139)

Reason Build timed out (after 120 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34375/, https://github.com/nodejs/node/pull/34542/)
Appeared test-digitalocean-fedora27-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32505/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32532/
Example
Build timed out (after 120 minutes). Marking the build as failed.

Build Failure
Reason fatal error: ld terminated with signal 9 [Killed]
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/34498/, https://github.com/nodejs/node/pull/34541/, https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34548/)
Appeared test-softlayer-ubuntu1804_sharedlibs_container-x64-3, test-joyent-ubuntu1804_sharedlibs_container-x64-3, test-joyent-ubuntu1804_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/32516/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32590/
Example
fatal error: ld terminated with signal 9 [Killed]

Reason Failed to trigger node-test-commit
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34372/, https://github.com/nodejs/node/pull/34578/, https://github.com/nodejs/node/pull/34404/)
Appeared test-ibm-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32540/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32575/
Example
Failed to trigger node-test-commit

Reason ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34542/, https://github.com/nodejs/node/pull/34569/)
Appeared test-orka-macos10.14-x64-2, test-osuosl-centos7-ppc64_le-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32529/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32599/
Example
ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for node-test-commit-osx/nodes=osx1014 #35547
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

undefined
Git Failure
Progress
  • parallel/test-fs-symlink (5)
  • parallel/test-net-dns-error (3)
  • parallel/test-policy-integrity (3)
  • benchmark/test-benchmark-napi (2)
  • parallel/test-http-parser-timeout-reset (2)
  • parallel/test-worker-stdio (2)
  • sequential/test-inspector-stop-profile-after-done (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (5)
  • Build timed out (after 120 minutes). Marking the build as failed. (2)
  • fatal error: ld terminated with signal 9 [Killed] (4)
  • Failed to trigger node-test-commit (3)
  • ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for ... (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the ncu-ci report and the listed CI jobs, then inspect test/parallel/test-fs-symlink.js, test/parallel/test-net-dns-error.js, test/parallel/test-policy-integrity.js, and benchmark/test-benchmark-napi. Reproduce the reported failures across the mentioned environments; completion would require identifying and resolving the underlying CI reliability problems.

Written by the indexing model from the issue text.

Assessment

Tech stack
node.js, shell
Domain
ci-cd, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.