nodejs / nodejs/reliability

CI Reliability 2020-08-04

Open
#33 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/32520 to node-test-pull-request/32616 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2020-08-04 00:34 1 28 0 19 52 35.00%
JSTest Failure
Reason parallel/test-http-parser-timeout-reset
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/34602/, https://github.com/nodejs/node/pull/34531/, https://github.com/nodejs/node/pull/34582/, https://github.com/nodejs/node/pull/34572/, https://github.com/nodejs/node/pull/34416/, https://github.com/nodejs/node/pull/34558/)
Appeared test-digitalocean-freebsd11-x64-2, test-ibm-aix71-ppc64_be-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32602/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32610/
Example
not ok 1137 parallel/test-http-parser-timeout-reset
  ---
  duration_ms: 1.312
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched noop function calls. Expected exactly 3, actual 6.
        at Proxy.mustCall (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/common/index.js:331:10)
        at Server.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/parallel/test-http-parser-timeout-reset.js:37:42)
        at Object.onceWrapper (events.js:420:28)
        at Server.emit (events.js:314:20)
        at emitListeningNT (net.js:1322:10)
        at processTicksAndRejections (internal/process/task_queues.js:79:21)
  ...


Reason parallel/test-fs-symlink
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/34540/, https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34568/, https://github.com/nodejs/node/pull/34342/, https://github.com/nodejs/node/pull/34558/)
Appeared test-joyent-alpine312_container-x64-1, test-osuosl-centos7-ppc64_le-2, undefined, test-digitalocean-ubi81_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-digitalocean-alpine311_container-x64-1, test-rackspace-centos7-x64-1, test-digitalocean-debian9-x64-1, test-rackspace-fedora27-x64-1, test-digitalocean-fedora30-x64-2, test-digitalocean-ubuntu1804-x64-1, test-azure_msft-win10_vcbt2015-x64-3, test-rackspace-win2012r2_vs2017-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32524/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32586/
Example
not ok 698 parallel/test-fs-symlink
  ---
  duration_ms: 0.120
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:885
        throw newErr;
        ^
    
    AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOENT: no such file or directory, lstat '/home/iojs/node-tmp/.tmp.696/symlink1.js'
        at /home/iojs/build/workspace/node-test-commit-linux/nodes/alpine-latest-x64/test/parallel/test-fs-symlink.js:46:12
        at /home/iojs/build/workspace/node-test-commit-linux/nodes/alpine-latest-x64/test/common/index.js:365:15
        at FSReqCallback.oncomplete (fs.js:176:21)
     {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: [Error: ENOENT: no such file or directory, lstat '/home/iojs/node-tmp/.tmp.696/symlink1.js'] {
        errno: -2,
        code: 'ENOENT',
        syscall: 'lstat',
        path: '/home/iojs/node-tmp/.tmp.696/symlink1.js'
      },
      expected: null,
      operator: 'ifError'
    }
  ...


Reason parallel/test-policy-integrity
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34372/, https://github.com/nodejs/node/pull/34375/, https://github.com/nodejs/node/pull/34404/)
Appeared test-digitalocean-freebsd11-x64-1, test-rackspace-fedora27-x64-1, test-digitalocean-ubuntu1804-x64-1, test-joyent-smartos18-x64-3, test-packetnet-centos7-arm64-2, test-requireio_svincent-debian10-armv7l_pi2-3, test-requireio_williamkapke-debian10-arm64_pi3-1, test-digitalocean-freebsd11-x64-2, test-softlayer-centos7-x64-1, test-joyent-smartos18-x64-4, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-requireio_pivotalagency-debian10-arm64_pi3-2, test-azure_msft-win10_vcbt2015-x64-4, test-rackspace-win2012r2_vs2017-x64-4, test-digitalocean-debian9-x64-1, test-azure_msft-win10_vs2019-x64-4, test-rackspace-win2012r2_vs2013-x64-1, test-requireio_svincent-debian10-armv7l_pi2-1, test-requireio_piccoloaiutante-debian10-arm64_pi3-1, test-azure_msft-win10_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32544/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32580/
Example
not ok 1747 parallel/test-policy-integrity
  ---
  duration_ms: 120.278
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason benchmark/test-benchmark-napi
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34542/, https://github.com/nodejs/node/pull/28237/)
Appeared test-digitalocean-freebsd11-x64-2, test-joyent-alpine311_container-x64-1, test-joyent-alpine312_container-x64-1, test-softlayer-centos7-x64-1, test-digitalocean-debian9-x64-1, test-rackspace-fedora27-x64-1, test-digitalocean-fedora30-x64-2, test-rackspace-ubuntu1604-x64-2, test-digitalocean-ubuntu1804-x64-1, test-orka-macos10.14-x64-2, test-nearform-macos10.15-x64-3, test-osuosl-centos7-ppc64_le-1, test-joyent-smartos18-x64-4, test-digitalocean-ubi81_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-10, test-digitalocean-ubuntu1804_sharedlibs_container-x64-6, test-joyent-ubuntu1804_sharedlibs_container-x64-1, test-packetnet-centos7-arm64-2, test-ibm-rhel7-s390x-1, test-ibm-aix71-ppc64_be-2, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-requireio_williamkapke-debian10-arm64_pi3-1, test-digitalocean-freebsd11-x64-1, test-digitalocean-alpine311_container-x64-1, test-softlayer-alpine312_container-x64-1, test-rackspace-centos7-x64-1, test-orka-macos10.14-x64-1, test-nearform-macos10.15-x64-2, test-joyent-smartos18-x64-3, test-softlayer-ubuntu1804_sharedlibs_container-x64-4, test-softlayer-ubuntu1804_sharedlibs_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-packetnet-centos7-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32529/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32530/
Example
not ok 2906 benchmark/test-benchmark-napi
  ---
  duration_ms: 1.793
  severity: fail
  exitcode: 1
  stack: |-
    internal/modules/cjs/loader.js:1102
      throw err;
      ^
    
    Error: Cannot find module '/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/benchmark/napi/type-tag'
        at Function.Module._resolveFilename (internal/modules/cjs/loader.js:1099:15)
        at Function.Module._load (internal/modules/cjs/loader.js:942:27)
        at Function.executeUserEntryPoint [as runMain] (internal/modules/run_main.js:60:12)
        at internal/main/run_main_module.js:17:47 {
      code: 'MODULE_NOT_FOUND',
      requireStack: []
    }
    assert.js:103
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    1 !== 0
    
        at ChildProcess.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/common/benchmark.js:30:12)
        at ChildProcess.emit (events.j...

Reason parallel/test-fs-utimes
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34375/, https://github.com/nodejs/node/pull/34618/)
Appeared test-requireio_ceejbot-debian10-armv7l_pi2-1, test-requireio_svincent-debian10-armv7l_pi2-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32577/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32616/
Example
not ok 212 parallel/test-fs-utimes
  ---
  duration_ms: 12.473
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:385
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: FAILED: expect_ok [Arguments] {
      '0': 'utimesSync',
      '1': '/home/iojs/tmp/.tmp.213',
      '2': undefined,
      '3': '123456',
      '4': -1
    }
         check_mtime: 3.638000011444092
        at expect_ok (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-fs-utimes.js:64:3)
        at syncTests (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-fs-utimes.js:133:5)
        at /home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-fs-utimes.js:120:11
        at /home/iojs/build/workspace/node-test-binary-arm/test/common/index.js:365:15
        at FSReqCallback.oncomplete (fs.js:164:23) {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: undefined,
      expected: true,
      operator: '=='
    }
  ...


Reason parallel/test-net-dns-error
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34540/, https://github.com/nodejs/node/pull/34542/)
Appeared test-azure_msft-win10_vcbt2015-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32524/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32532/
Example
not ok 335 parallel/test-net-dns-error
  ---
  duration_ms: 0.264
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:84
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Input A expected to strictly equal input B:
    + expected - actual
    
    - 'EAI_FAIL'
    + 'ENOTFOUND'
        at Socket.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-net-dns-error.js:37:10)
        at Socket.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:379:15)
        at Socket.emit (events.js:198:13)
        at GetAddrInfoReqWrap.emitLookup [as callback] (net.js:1005:12)
        at GetAddrInfoReqWrap.onlookup [as oncomplete] (dns.js:56:17)
  ...


Reason parallel/test-worker-stdio
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34548/)
Appeared test-requireio_sambthompson-debian10-armv7l_pi2-1, test-requireio_svincent-debian10-armv7l_pi2-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32538/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32573/
Example
not ok 685 parallel/test-worker-stdio
  ---
  duration_ms: 244.773
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason sequential/test-inspector-stop-profile-after-done
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34558/)
Appeared test-osuosl-centos7-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32566/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32585/
Example
not ok 3046 sequential/test-inspector-stop-profile-after-done
  ---
  duration_ms: 0.343
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:41330/f6277107-ba93-4b98-ad7e-3c28d837b718
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [err] Debugger attached.
    [err] 
    [out] {}
    [out] 
    [out] {}
    [out] 
    [out] {}
    [out] 
    Mismatched noop function calls. Expected exactly 1, actual 0.
        at Proxy.mustCall (/home/iojs/build/workspace/node-test-commit-plinux/nodes/centos7-ppcle/test/common/index.js:331:10)
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-plinux/nodes/centos7-ppcle/test/sequential/test-inspector-stop-profile-after-done.js:30:24)
        at Module._compile (internal/modules/cjs/loader.js:1270:30)
        at Object.Module._extensions..js (internal/modules/cjs/loader.js:1291:10)
        at Module.load (interna...

Reason wasi/test-wasi
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34531/, https://github.com/nodejs/node/pull/34558/)
Appeared test-digitalocean-freebsd11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32604/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32608/
Example
not ok 2 wasi/test-wasi
  ---
  duration_ms: 2.767
  severity: fail
  exitcode: 1
  stack: |-
    executing cant_dotdot
    (node:76568) ExperimentalWarning: WASI is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69720)
    fd_prestat_dir_name(3, 131088, 9)
    fd_prestat_get(4, 69720)
    fd_prestat_dir_name(4, 131152, 5)
    fd_prestat_get(5, 69720)
    environ_sizes_get(69724, 69720)
    environ_get(134464, 131168)
    fd_fdstat_get(3, 69672)
    path_open(3, 1, 1033, 14, 0, 264240830, 268435455, 0, 69668)
    
    executing clock_getres
    (node:76569) ExperimentalWarning: WASI is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69688)
    fd_prestat_dir_name(3, 131088, 9)
    fd_prestat_get(4, 69688)
    fd_prestat_dir_name(4, 131152, 5)
    fd_prestat_get(5, 69688)
    environ_siz...

Jenkins Failure
Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/34542/, https://github.com/nodejs/node/pull/34342/, https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34589/, https://github.com/nodejs/node/pull/34569/, https://github.com/nodejs/node/pull/34416/)
Appeared test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-orka-macos10.15-x64-2, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-orka-macos10.14-x64-2, test-orka-macos10.14-x64-3, test-orka-macos10.14-x64-1, test-requireio_piccoloaiutante-debian10-arm64_pi3-1, test-requireio_svincent-debian10-armv7l_pi2-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32543/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32609/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 203.217.18.114/203.217.18.114:46156' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at com.sun.proxy.$Proxy71.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1147)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1139)

Build Failure
Reason Failed to trigger node-test-commit
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34372/, https://github.com/nodejs/node/pull/34578/, https://github.com/nodejs/node/pull/34404/)
Appeared test-ibm-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32540/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32575/
Example
Failed to trigger node-test-commit

Reason fatal error: ld terminated with signal 9 [Killed]
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34541/, https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34548/)
Appeared test-softlayer-ubuntu1804_sharedlibs_container-x64-3, test-joyent-ubuntu1804_sharedlibs_container-x64-3, test-joyent-ubuntu1804_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/32525/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32590/
Example
fatal error: ld terminated with signal 9 [Killed]

Reason ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34542/, https://github.com/nodejs/node/pull/34569/)
Appeared test-orka-macos10.14-x64-2, test-osuosl-centos7-ppc64_le-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32529/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32599/
Example
ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for node-test-commit-osx/nodes=osx1014 #35547
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

undefined
Git Failure
Progress
  • parallel/test-http-parser-timeout-reset (6)
  • parallel/test-fs-symlink (5)
  • parallel/test-policy-integrity (3)
  • benchmark/test-benchmark-napi (2)
  • parallel/test-fs-utimes (2)
  • parallel/test-net-dns-error (2)
  • parallel/test-worker-stdio (2)
  • sequential/test-inspector-stop-profile-after-done (2)
  • wasi/test-wasi (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (6)
  • Failed to trigger node-test-commit (3)
  • fatal error: ld terminated with signal 9 [Killed] (3)
  • ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for ... (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Review the reported CI jobs and the listed test files, including test/parallel/test-http-parser-timeout-reset.js, test/parallel/test-fs-symlink.js, and test/parallel/test-policy-integrity.js. Start with the linked failure logs and compare the affected platforms and first/last CI runs. Done means the reported failures are understood and no longer recur in the relevant CI runs.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, nodejs, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.