nodejs / nodejs/reliability

CI Reliability 2020-08-07

Open
#36 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/32561 to node-test-pull-request/32658 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2020-08-07 00:34 2 33 1 10 54 37.50%
JSTest Failure
Reason parallel/test-http-parser-timeout-reset
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/34602/, https://github.com/nodejs/node/pull/34531/, https://github.com/nodejs/node/pull/34582/, https://github.com/nodejs/node/pull/34572/, https://github.com/nodejs/node/pull/34416/, https://github.com/nodejs/node/pull/34558/)
Appeared test-digitalocean-freebsd11-x64-2, test-ibm-aix71-ppc64_be-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32602/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32610/
Example
not ok 1137 parallel/test-http-parser-timeout-reset
  ---
  duration_ms: 1.312
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched noop function calls. Expected exactly 3, actual 6.
        at Proxy.mustCall (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/common/index.js:331:10)
        at Server.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/parallel/test-http-parser-timeout-reset.js:37:42)
        at Object.onceWrapper (events.js:420:28)
        at Server.emit (events.js:314:20)
        at emitListeningNT (net.js:1322:10)
        at processTicksAndRejections (internal/process/task_queues.js:79:21)
  ...


Reason parallel/test-fs-symlink
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34568/, https://github.com/nodejs/node/pull/34342/, https://github.com/nodejs/node/pull/34558/)
Appeared test-joyent-alpine312_container-x64-1, test-osuosl-centos7-ppc64_le-2, undefined, test-digitalocean-ubi81_container-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32561/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32586/
Example
not ok 698 parallel/test-fs-symlink
  ---
  duration_ms: 0.120
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:885
        throw newErr;
        ^
    
    AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOENT: no such file or directory, lstat '/home/iojs/node-tmp/.tmp.696/symlink1.js'
        at /home/iojs/build/workspace/node-test-commit-linux/nodes/alpine-latest-x64/test/parallel/test-fs-symlink.js:46:12
        at /home/iojs/build/workspace/node-test-commit-linux/nodes/alpine-latest-x64/test/common/index.js:365:15
        at FSReqCallback.oncomplete (fs.js:176:21)
     {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: [Error: ENOENT: no such file or directory, lstat '/home/iojs/node-tmp/.tmp.696/symlink1.js'] {
        errno: -2,
        code: 'ENOENT',
        syscall: 'lstat',
        path: '/home/iojs/node-tmp/.tmp.696/symlink1.js'
      },
      expected: null,
      operator: 'ifError'
    }
  ...


Reason wasi/test-wasi
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/34531/, https://github.com/nodejs/node/pull/34558/, https://github.com/nodejs/node/pull/34622/, https://github.com/nodejs/node/pull/33929/)
Appeared test-digitalocean-freebsd11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32604/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32644/
Example
not ok 8 wasi/test-wasi
  ---
  duration_ms: 2.927
  severity: fail
  exitcode: 1
  stack: |-
    executing cant_dotdot
    (node:90112) ExperimentalWarning: WASI is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69720)
    fd_prestat_dir_name(3, 131088, 9)
    fd_prestat_get(4, 69720)
    fd_prestat_dir_name(4, 131152, 5)
    fd_prestat_get(5, 69720)
    environ_sizes_get(69724, 69720)
    environ_get(134464, 131168)
    fd_fdstat_get(3, 69672)
    path_open(3, 1, 1033, 14, 0, 264240830, 268435455, 0, 69668)
    
    executing clock_getres
    (node:90113) ExperimentalWarning: WASI is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69688)
    fd_prestat_dir_name(3, 131088, 9)
    fd_prestat_get(4, 69688)
    fd_prestat_dir_name(4, 131152, 5)
    fd_prestat_get(5, 69688)
    environ_siz...

Reason parallel/test-fs-utimes
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34375/, https://github.com/nodejs/node/pull/34618/, https://github.com/nodejs/node/pull/34461/)
Appeared test-requireio_svincent-debian10-armv7l_pi2-1, test-requireio_ceejbot-debian10-armv7l_pi2-1, test-requireio_svincent-debian10-armv7l_pi2-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32577/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32626/
Example
not ok 210 parallel/test-fs-utimes
  ---
  duration_ms: 15.583
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:385
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: FAILED: expect_ok [Arguments] {
      '0': 'lutimes',
      '1': '/home/iojs/tmp/.tmp.210/symlink',
      '2': null,
      '3': '123456',
      '4': -1,
      '5': [Function: lstatSync]
    }
         check_mtime: 2.5410001277923584
        at expect_ok (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-fs-utimes.js:64:3)
        at /home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-fs-utimes.js:105:7
        at /home/iojs/build/workspace/node-test-binary-arm/test/common/index.js:363:15
        at FSReqCallback.oncomplete (fs.js:164:23) {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: null,
      expected: true,
      operator: '=='
    }
  ...


Reason parallel/test-http-destroyed-socket-write2
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34416/, https://github.com/nodejs/node/pull/34629/)
Appeared test-orka-macos10.14-x64-2, test-orka-macos10.15-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32609/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32634/
Example
not ok 1742 parallel/test-http-destroyed-socket-write2
  ---
  duration_ms: 120.61
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-policy-integrity
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34375/, https://github.com/nodejs/node/pull/34404/)
Appeared test-digitalocean-freebsd11-x64-2, test-softlayer-centos7-x64-1, test-joyent-smartos18-x64-4, test-packetnet-centos7-arm64-2, test-requireio_svincent-debian10-armv7l_pi2-2, test-requireio_pivotalagency-debian10-arm64_pi3-2, test-digitalocean-freebsd11-x64-1, test-rackspace-fedora27-x64-1, test-digitalocean-ubuntu1804-x64-1, test-joyent-smartos18-x64-3, test-requireio_svincent-debian10-armv7l_pi2-3, test-requireio_williamkapke-debian10-arm64_pi3-1, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-azure_msft-win10_vcbt2015-x64-4, test-rackspace-win2012r2_vs2017-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/32577/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32625/
Example
not ok 1766 parallel/test-policy-integrity
  ---
  duration_ms: 120.510
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-policy-parse-integrity
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34616/)
Appeared test-requireio_pivotalagency-debian10-arm64_pi3-2, test-azure_msft-win10_vs2019-x64-1, test-rackspace-win2012r2_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32566/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32620/
Example
not ok 442 parallel/test-policy-parse-integrity
  ---
  duration_ms: 268.825
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-repl
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34648/, https://github.com/nodejs/node/pull/34582/)
Appeared test-requireio_piccoloaiutante-debian10-arm64_pi3-1, test-joyent-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32646/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32655/
Example
not ok 490 parallel/test-repl
  ---
  duration_ms: 7.143
  severity: fail
  exitcode: 1
  stack: |-
    out: ""
    in: ""
    out: "message"
    in: "'Read, Eval, Print Loop'"
    out: "invoke_me(987)"
    in: "'invoked 987'"
    out: "a = 12345"
    in: "12345"
    out: "{a:1}"
    in: "{ a: 1 }"
    out: "throw new Error('test error');"
    in: "Uncaught Error: test error"
    out: "throw { foo: 'bar' };"
    in: "Uncaught { foo: 'bar' }"
    out: "function test_func() {"
    in: "... "
    out: ".break"
    in: ""
    out: "eval(\"function test_func() {\")"
    in: "Uncaught SyntaxError: Unexpected end of input"
    out: "`io.js"
    in: "... "
    out: ".break"
    in: ""
    out: "`io.js ${\"1.0\""
    in: "... "
    out: "+ \".2\"}`"
    in: "'io.js 1.0.2'"
    out: "`io.js ${"
    in: "... "
    out: "\"1.0\" + \".2\"}`"
    in: "'io.js 1.0.2'"
    out: "(\"a\""
    in: "... "
    out: ".charAt(0))"
    in: "'a'"
    out: ".1234"
    in: "0.1234"
    out: ".1+.1"
    in: "0.2"
    out: "JSON.parse('{\...

Reason parallel/test-tls-ticket-cluster
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34617/)
Appeared test-nearform-macos10.15-x64-2, test-nearform-macos10.15-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32581/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32621/
Example
not ok 2243 parallel/test-tls-ticket-cluster
  ---
  duration_ms: 0.362
  severity: fail
  exitcode: 1
  stack: |-
    [master] got "listening"
    [master] connecting 59252 session? false
    [master] got "listening"
    [worker] connection reused? false
    [master] got "not-reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] go...

Reason parallel/test-worker-stdio
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34548/, https://github.com/nodejs/node/pull/34616/)
Appeared test-requireio_pivotalagency-debian10-arm64_pi3-2, test-requireio_sambthompson-debian10-armv7l_pi2-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32573/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32620/
Example
not ok 676 parallel/test-worker-stdio
  ---
  duration_ms: 18.34
  severity: fail
  exitcode: 1
  stack: |-
    internal/buffer.js:950
    class FastBuffer extends Uint8Array {}
    ^
    
    RangeError: Array buffer allocation failed
        at new ArrayBuffer (<anonymous>)
        at new Uint8Array (<anonymous>)
        at new FastBuffer (internal/buffer.js:950:1)
        at createUnsafeBuffer (internal/buffer.js:1031:12)
        at allocate (buffer.js:403:10)
        at Function.allocUnsafe (buffer.js:368:10)
        at Function.concat (buffer.js:548:25)
        at BufferingWritable.get buffer [as buffer] (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-worker-stdio.js:21:19)
        at BufferingWritable.<anonymous> (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-worker-stdio.js:36:55)
        at BufferingWritable.<anonymous> (/home/iojs/build/workspace/node-test-binary-arm/test/common/index.js:365:15)
  ...


Reason sequential/test-inspector-stop-profile-after-done
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34558/)
Appeared test-osuosl-centos7-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32566/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32585/
Example
not ok 3046 sequential/test-inspector-stop-profile-after-done
  ---
  duration_ms: 0.343
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:41330/f6277107-ba93-4b98-ad7e-3c28d837b718
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [err] Debugger attached.
    [err] 
    [out] {}
    [out] 
    [out] {}
    [out] 
    [out] {}
    [out] 
    Mismatched noop function calls. Expected exactly 1, actual 0.
        at Proxy.mustCall (/home/iojs/build/workspace/node-test-commit-plinux/nodes/centos7-ppcle/test/common/index.js:331:10)
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-plinux/nodes/centos7-ppcle/test/sequential/test-inspector-stop-profile-after-done.js:30:24)
        at Module._compile (internal/modules/cjs/loader.js:1270:30)
        at Object.Module._extensions..js (internal/modules/cjs/loader.js:1291:10)
        at Module.load (interna...

Jenkins Failure
Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/34342/, https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34589/, https://github.com/nodejs/node/pull/34569/, https://github.com/nodejs/node/pull/34416/)
Appeared test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-orka-macos10.15-x64-2, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-orka-macos10.14-x64-2, test-orka-macos10.14-x64-3, test-orka-macos10.14-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32567/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32609/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 203.217.18.114/203.217.18.114:46156' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at com.sun.proxy.$Proxy71.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1147)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1139)

Build Failure
Reason fatal error: ld terminated with signal 9 [Killed]
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34548/, https://github.com/nodejs/node/pull/34461/, https://github.com/nodejs/node/pull/34482/)
Appeared test-joyent-ubuntu1804_sharedlibs_container-x64-3, test-joyent-ubuntu1804_sharedlibs_container-x64-4, test-softlayer-ubuntu1804_sharedlibs_container-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32589/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32627/
Example
fatal error: ld terminated with signal 9 [Killed]

Reason Failed to trigger node-test-commit
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34578/, https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34629/)
Appeared test-ibm-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32574/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32633/
Example
Failed to trigger node-test-commit

Reason Error: Not supported
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34625/, https://github.com/nodejs/node/pull/34643/)
Appeared test-joyent-smartos18-x64-3, test-rackspace-centos7-x64-1, test-softlayer-debian9-x64-1, test-rackspace-fedora27-x64-1, test-rackspace-ubuntu1604-x64-1, test-joyent-ubuntu1804_sharedlibs_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32639/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32642/
Example
Error: Not supported
    at vm:module(0):1:1
    at SourceTextModule.evaluate (internal/vm/module.js:224:23)
    at embedder_main_6.js:1:328
    at processTicksAndRejections (internal/process/task_queues.js:93:5)
(node:705115) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). To terminate the node process on unhandled promise rejection, use the CLI flag `--unhandled-rejections=strict` (see https://nodejs.org/api/cli.html#cli_unhandled_rejections_mode). (rejection id: 1)

Git Failure
Progress
  • parallel/test-http-parser-timeout-reset (6)
  • parallel/test-fs-symlink (4)
  • wasi/test-wasi (4)
  • parallel/test-fs-utimes (3)
  • parallel/test-http-destroyed-socket-write2 (2)
  • parallel/test-policy-integrity (2)
  • parallel/test-policy-parse-integrity (2)
  • parallel/test-repl (2)
  • parallel/test-tls-ticket-cluster (2)
  • parallel/test-worker-stdio (2)
  • sequential/test-inspector-stop-profile-after-done (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (5)
  • fatal error: ld terminated with signal 9 [Killed] (4)
  • Failed to trigger node-test-commit (3)
  • Error: Not supported (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the generated ncu-ci report and the linked CI console examples, focusing on the named tests such as test-http-parser-timeout-reset.js, test-fs-symlink.js, test-wasi, and test-fs-utimes.js. Compare their failures across the listed platforms and determine which recurring CI failures need follow-up. Done means the reported reliability failures have been addressed and the affected tests no longer fail repeatedly.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.