CI Reliability 2020-08-05

Open
#34 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
5/5
Estimated time
Over a week
Newbie friendliness
20/100
Issue type
Bug
Clarity
Needs clarification
Activity status
Stale
Tech stack
shell

Research direction

Start by running the reported ncu-ci walk pr --stats=true --markdown ... workflow and review the linked CI logs. Reproduce the failures in the named tests, including test/parallel/test-http-parser-timeout-reset.js, test-fs-symlink.js, test-fs-utimes.js, test-policy-integrity.js, test-worker-stdio.js, and test-policy-parse-integrity.js; done means the recurring CI failures are understood and the affected checks are reliable.

Written by the indexing model from the issue text.

Description

Failures in node-test-pull-request/32532 to node-test-pull-request/32627 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2020-08-05 00:33 0 32 1 17 50 38.55%
JSTest Failure
Reason parallel/test-http-parser-timeout-reset
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/34602/, https://github.com/nodejs/node/pull/34531/, https://github.com/nodejs/node/pull/34582/, https://github.com/nodejs/node/pull/34572/, https://github.com/nodejs/node/pull/34416/, https://github.com/nodejs/node/pull/34558/)
Appeared test-digitalocean-freebsd11-x64-2, test-ibm-aix71-ppc64_be-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32602/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32610/
Example
not ok 1137 parallel/test-http-parser-timeout-reset
  ---
  duration_ms: 1.312
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched noop function calls. Expected exactly 3, actual 6.
        at Proxy.mustCall (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/common/index.js:331:10)
        at Server.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/parallel/test-http-parser-timeout-reset.js:37:42)
        at Object.onceWrapper (events.js:420:28)
        at Server.emit (events.js:314:20)
        at emitListeningNT (net.js:1322:10)
        at processTicksAndRejections (internal/process/task_queues.js:79:21)
  ...


Reason parallel/test-fs-symlink
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34568/, https://github.com/nodejs/node/pull/34342/, https://github.com/nodejs/node/pull/34558/)
Appeared test-joyent-alpine312_container-x64-1, test-osuosl-centos7-ppc64_le-2, undefined, test-digitalocean-ubi81_container-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32561/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32586/
Example
not ok 698 parallel/test-fs-symlink
  ---
  duration_ms: 0.120
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:885
        throw newErr;
        ^
    
    AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOENT: no such file or directory, lstat '/home/iojs/node-tmp/.tmp.696/symlink1.js'
        at /home/iojs/build/workspace/node-test-commit-linux/nodes/alpine-latest-x64/test/parallel/test-fs-symlink.js:46:12
        at /home/iojs/build/workspace/node-test-commit-linux/nodes/alpine-latest-x64/test/common/index.js:365:15
        at FSReqCallback.oncomplete (fs.js:176:21)
     {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: [Error: ENOENT: no such file or directory, lstat '/home/iojs/node-tmp/.tmp.696/symlink1.js'] {
        errno: -2,
        code: 'ENOENT',
        syscall: 'lstat',
        path: '/home/iojs/node-tmp/.tmp.696/symlink1.js'
      },
      expected: null,
      operator: 'ifError'
    }
  ...


Reason parallel/test-fs-utimes
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34375/, https://github.com/nodejs/node/pull/34618/, https://github.com/nodejs/node/pull/34461/)
Appeared test-requireio_svincent-debian10-armv7l_pi2-1, test-requireio_ceejbot-debian10-armv7l_pi2-1, test-requireio_svincent-debian10-armv7l_pi2-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32577/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32626/
Example
not ok 210 parallel/test-fs-utimes
  ---
  duration_ms: 15.583
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:385
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: FAILED: expect_ok [Arguments] {
      '0': 'lutimes',
      '1': '/home/iojs/tmp/.tmp.210/symlink',
      '2': null,
      '3': '123456',
      '4': -1,
      '5': [Function: lstatSync]
    }
         check_mtime: 2.5410001277923584
        at expect_ok (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-fs-utimes.js:64:3)
        at /home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-fs-utimes.js:105:7
        at /home/iojs/build/workspace/node-test-binary-arm/test/common/index.js:363:15
        at FSReqCallback.oncomplete (fs.js:164:23) {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: null,
      expected: true,
      operator: '=='
    }
  ...


Reason parallel/test-policy-integrity
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34372/, https://github.com/nodejs/node/pull/34375/, https://github.com/nodejs/node/pull/34404/)
Appeared test-digitalocean-freebsd11-x64-2, test-softlayer-centos7-x64-1, test-joyent-smartos18-x64-4, test-packetnet-centos7-arm64-2, test-requireio_svincent-debian10-armv7l_pi2-2, test-requireio_pivotalagency-debian10-arm64_pi3-2, test-digitalocean-freebsd11-x64-1, test-rackspace-fedora27-x64-1, test-digitalocean-ubuntu1804-x64-1, test-joyent-smartos18-x64-3, test-requireio_svincent-debian10-armv7l_pi2-3, test-requireio_williamkapke-debian10-arm64_pi3-1, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-azure_msft-win10_vcbt2015-x64-4, test-rackspace-win2012r2_vs2017-x64-4, test-digitalocean-debian9-x64-1, test-azure_msft-win10_vs2019-x64-4, test-rackspace-win2012r2_vs2013-x64-1, test-requireio_svincent-debian10-armv7l_pi2-1, test-requireio_piccoloaiutante-debian10-arm64_pi3-1, test-azure_msft-win10_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32544/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32625/
Example
not ok 1766 parallel/test-policy-integrity
  ---
  duration_ms: 120.510
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-worker-stdio
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34548/, https://github.com/nodejs/node/pull/34616/)
Appeared test-requireio_pivotalagency-debian10-arm64_pi3-2, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-requireio_svincent-debian10-armv7l_pi2-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32538/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32620/
Example
not ok 676 parallel/test-worker-stdio
  ---
  duration_ms: 18.34
  severity: fail
  exitcode: 1
  stack: |-
    internal/buffer.js:950
    class FastBuffer extends Uint8Array {}
    ^
    
    RangeError: Array buffer allocation failed
        at new ArrayBuffer (<anonymous>)
        at new Uint8Array (<anonymous>)
        at new FastBuffer (internal/buffer.js:950:1)
        at createUnsafeBuffer (internal/buffer.js:1031:12)
        at allocate (buffer.js:403:10)
        at Function.allocUnsafe (buffer.js:368:10)
        at Function.concat (buffer.js:548:25)
        at BufferingWritable.get buffer [as buffer] (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-worker-stdio.js:21:19)
        at BufferingWritable.<anonymous> (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-worker-stdio.js:36:55)
        at BufferingWritable.<anonymous> (/home/iojs/build/workspace/node-test-binary-arm/test/common/index.js:365:15)
  ...


Reason parallel/test-policy-parse-integrity
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34616/)
Appeared test-requireio_pivotalagency-debian10-arm64_pi3-2, test-azure_msft-win10_vs2019-x64-1, test-rackspace-win2012r2_vs2019-x64-2, test-azure_msft-win10_vcbt2015-x64-3, test-rackspace-win2012r2_vs2017-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32566/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32620/
Example
not ok 442 parallel/test-policy-parse-integrity
  ---
  duration_ms: 268.825
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-tls-ticket-cluster
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34617/)
Appeared test-nearform-macos10.15-x64-2, test-nearform-macos10.15-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32581/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32621/
Example
not ok 2243 parallel/test-tls-ticket-cluster
  ---
  duration_ms: 0.362
  severity: fail
  exitcode: 1
  stack: |-
    [master] got "listening"
    [master] connecting 59252 session? false
    [master] got "listening"
    [worker] connection reused? false
    [master] got "not-reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] go...

Reason sequential/test-inspector-stop-profile-after-done
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34558/)
Appeared test-osuosl-centos7-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32566/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32585/
Example
not ok 3046 sequential/test-inspector-stop-profile-after-done
  ---
  duration_ms: 0.343
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:41330/f6277107-ba93-4b98-ad7e-3c28d837b718
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [err] Debugger attached.
    [err] 
    [out] {}
    [out] 
    [out] {}
    [out] 
    [out] {}
    [out] 
    Mismatched noop function calls. Expected exactly 1, actual 0.
        at Proxy.mustCall (/home/iojs/build/workspace/node-test-commit-plinux/nodes/centos7-ppcle/test/common/index.js:331:10)
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-plinux/nodes/centos7-ppcle/test/sequential/test-inspector-stop-profile-after-done.js:30:24)
        at Module._compile (internal/modules/cjs/loader.js:1270:30)
        at Object.Module._extensions..js (internal/modules/cjs/loader.js:1291:10)
        at Module.load (interna...

Reason wasi/test-wasi
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34531/, https://github.com/nodejs/node/pull/34558/)
Appeared test-digitalocean-freebsd11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32604/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32608/
Example
not ok 2 wasi/test-wasi
  ---
  duration_ms: 2.767
  severity: fail
  exitcode: 1
  stack: |-
    executing cant_dotdot
    (node:76568) ExperimentalWarning: WASI is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69720)
    fd_prestat_dir_name(3, 131088, 9)
    fd_prestat_get(4, 69720)
    fd_prestat_dir_name(4, 131152, 5)
    fd_prestat_get(5, 69720)
    environ_sizes_get(69724, 69720)
    environ_get(134464, 131168)
    fd_fdstat_get(3, 69672)
    path_open(3, 1, 1033, 14, 0, 264240830, 268435455, 0, 69668)
    
    executing clock_getres
    (node:76569) ExperimentalWarning: WASI is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69688)
    fd_prestat_dir_name(3, 131088, 9)
    fd_prestat_get(4, 69688)
    fd_prestat_dir_name(4, 131152, 5)
    fd_prestat_get(5, 69688)
    environ_siz...

Jenkins Failure
Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/34542/, https://github.com/nodejs/node/pull/34342/, https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34589/, https://github.com/nodejs/node/pull/34569/, https://github.com/nodejs/node/pull/34416/)
Appeared test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-orka-macos10.15-x64-2, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-orka-macos10.14-x64-2, test-orka-macos10.14-x64-3, test-orka-macos10.14-x64-1, test-requireio_piccoloaiutante-debian10-arm64_pi3-1, test-requireio_svincent-debian10-armv7l_pi2-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32543/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32609/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 203.217.18.114/203.217.18.114:46156' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at com.sun.proxy.$Proxy71.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1147)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1139)

Build Failure
Reason fatal error: ld terminated with signal 9 [Killed]
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34548/, https://github.com/nodejs/node/pull/34461/, https://github.com/nodejs/node/pull/34482/)
Appeared test-joyent-ubuntu1804_sharedlibs_container-x64-3, test-joyent-ubuntu1804_sharedlibs_container-x64-4, test-softlayer-ubuntu1804_sharedlibs_container-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32589/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32627/
Example
fatal error: ld terminated with signal 9 [Killed]

Reason Failed to trigger node-test-commit
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34372/, https://github.com/nodejs/node/pull/34578/, https://github.com/nodejs/node/pull/34404/)
Appeared test-ibm-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32540/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32575/
Example
Failed to trigger node-test-commit

Git Failure
Progress
  • parallel/test-http-parser-timeout-reset (6)
  • parallel/test-fs-symlink (4)
  • parallel/test-fs-utimes (3)
  • parallel/test-policy-integrity (3)
  • parallel/test-worker-stdio (3)
  • parallel/test-policy-parse-integrity (2)
  • parallel/test-tls-ticket-cluster (2)
  • sequential/test-inspector-stop-profile-after-done (2)
  • wasi/test-wasi (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (6)
  • fatal error: ld terminated with signal 9 [Killed] (4)
  • Failed to trigger node-test-commit (3)
Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from nodejs/reliability

All issues in nodejs/reliability

Similar issues

More Shell/Bash issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.