nodejs / nodejs/reliability

CI Reliability 2020-08-08

Open
#37 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/32581 to node-test-pull-request/32679 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2020-08-08 00:34 0 39 1 5 55 41.05%
JSTest Failure
Reason parallel/test-http-parser-timeout-reset
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/34602/, https://github.com/nodejs/node/pull/34531/, https://github.com/nodejs/node/pull/34582/, https://github.com/nodejs/node/pull/34572/, https://github.com/nodejs/node/pull/34416/, https://github.com/nodejs/node/pull/34558/)
Appeared test-digitalocean-freebsd11-x64-2, test-ibm-aix71-ppc64_be-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32602/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32610/
Example
not ok 1137 parallel/test-http-parser-timeout-reset
  ---
  duration_ms: 1.312
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched noop function calls. Expected exactly 3, actual 6.
        at Proxy.mustCall (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/common/index.js:331:10)
        at Server.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/parallel/test-http-parser-timeout-reset.js:37:42)
        at Object.onceWrapper (events.js:420:28)
        at Server.emit (events.js:314:20)
        at emitListeningNT (net.js:1322:10)
        at processTicksAndRejections (internal/process/task_queues.js:79:21)
  ...


Reason wasi/test-wasi
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/34531/, https://github.com/nodejs/node/pull/34558/, https://github.com/nodejs/node/pull/34622/, https://github.com/nodejs/node/pull/33929/)
Appeared test-digitalocean-freebsd11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32604/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32644/
Example
not ok 8 wasi/test-wasi
  ---
  duration_ms: 2.927
  severity: fail
  exitcode: 1
  stack: |-
    executing cant_dotdot
    (node:90112) ExperimentalWarning: WASI is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69720)
    fd_prestat_dir_name(3, 131088, 9)
    fd_prestat_get(4, 69720)
    fd_prestat_dir_name(4, 131152, 5)
    fd_prestat_get(5, 69720)
    environ_sizes_get(69724, 69720)
    environ_get(134464, 131168)
    fd_fdstat_get(3, 69672)
    path_open(3, 1, 1033, 14, 0, 264240830, 268435455, 0, 69668)
    
    executing clock_getres
    (node:90113) ExperimentalWarning: WASI is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69688)
    fd_prestat_dir_name(3, 131088, 9)
    fd_prestat_get(4, 69688)
    fd_prestat_dir_name(4, 131152, 5)
    fd_prestat_get(5, 69688)
    environ_siz...

Reason parallel/test-http-destroyed-socket-write2
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34416/, https://github.com/nodejs/node/pull/34629/, https://github.com/nodejs/node/pull/34662/)
Appeared test-orka-macos10.14-x64-2, test-orka-macos10.15-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32609/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32666/
Example
not ok 1760 parallel/test-http-destroyed-socket-write2
  ---
  duration_ms: 120.103
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-repl
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34648/, https://github.com/nodejs/node/pull/34582/, https://github.com/nodejs/node/pull/34664/)
Appeared test-requireio_piccoloaiutante-debian10-arm64_pi3-1, test-joyent-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32646/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32671/
Example
not ok 493 parallel/test-repl
  ---
  duration_ms: 7.769
  severity: fail
  exitcode: 1
  stack: |-
    out: ""
    in: ""
    out: "message"
    in: "'Read, Eval, Print Loop'"
    out: "invoke_me(987)"
    in: "'invoked 987'"
    out: "a = 12345"
    in: "12345"
    out: "{a:1}"
    in: "{ a: 1 }"
    out: "throw new Error('test error');"
    in: "Uncaught Error: test error"
    out: "throw { foo: 'bar' };"
    in: "Uncaught { foo: 'bar' }"
    out: "function test_func() {"
    in: "... "
    out: ".break"
    in: ""
    out: "eval(\"function test_func() {\")"
    in: "Uncaught SyntaxError: Unexpected end of input"
    out: "`io.js"
    in: "... "
    out: ".break"
    in: ""
    out: "`io.js ${\"1.0\""
    in: "... "
    out: "+ \".2\"}`"
    in: "'io.js 1.0.2'"
    out: "`io.js ${"
    in: "... "
    out: "\"1.0\" + \".2\"}`"
    in: "'io.js 1.0.2'"
    out: "(\"a\""
    in: "... "
    out: ".charAt(0))"
    in: "'a'"
    out: ".1234"
    in: "0.1234"
    out: ".1+.1"
    in: "0.2"
    out: "JSON.parse('{\...

Reason node-api/test_worker_terminate_finalization/test
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34625/, https://github.com/nodejs/node/pull/33013/)
Appeared test-requireio_sambthompson-debian10-armv7l_pi2-1, test-requireio_pivotalagency-debian10-arm64_pi3-1, test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-requireio_piccoloaiutante-debian10-arm64_pi3-1, test-requireio_pivotalagency-debian10-arm64_pi3-2, test-requireio_kahwee-debian10-arm64_pi3-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32673/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32674/
Example
not ok 116 node-api/test_worker_terminate_finalization/test
  ---
  duration_ms: 2.144
  severity: fail
  exitcode: 1
  stack: |-
    events.js:312
          throw er; // Unhandled 'error' event
          ^
    
    AssertionError [ERR_ASSERTION]: function should not have been called at /home/iojs/build/workspace/node-test-binary-arm/test/node-api/test_worker_terminate_finalization/test.js:7
    called with arguments: [Error: Invalid argument]
        at Worker.mustNotCall (/home/iojs/build/workspace/node-test-binary-arm/test/common/index.js:425:12)
        at Worker.emit (events.js:343:20)
        at Worker.[kOnErrorMessage] (internal/worker.js:241:10)
        at Worker.[kOnMessage] (internal/worker.js:251:37)
        at MessagePort.<anonymous> (internal/worker.js:167:57)
        at MessagePort.[nodejs.internal.kHybridDispatch] (internal/event_target.js:352:41)
        at MessagePort.exports.emitMessage (internal/per_context/messageport.js:18:26)
    Emitted 'error' event on process instance at:
        at e...

Reason parallel/test-async-hooks-http-parser-destroy
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34664/, https://github.com/nodejs/node/pull/34662/)
Appeared test-rackspace-win2012r2_vs2017-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/32663/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32666/
Example
not ok 745 parallel/test-async-hooks-http-parser-destroy
  ---
  duration_ms: 120.152
  severity: fail
  exitcode: 1
  stack: |-
    timeout
  ...


Reason parallel/test-fs-utimes
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34618/, https://github.com/nodejs/node/pull/34461/)
Appeared test-requireio_svincent-debian10-armv7l_pi2-1, test-requireio_ceejbot-debian10-armv7l_pi2-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32616/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32626/
Example
not ok 210 parallel/test-fs-utimes
  ---
  duration_ms: 15.583
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:385
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: FAILED: expect_ok [Arguments] {
      '0': 'lutimes',
      '1': '/home/iojs/tmp/.tmp.210/symlink',
      '2': null,
      '3': '123456',
      '4': -1,
      '5': [Function: lstatSync]
    }
         check_mtime: 2.5410001277923584
        at expect_ok (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-fs-utimes.js:64:3)
        at /home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-fs-utimes.js:105:7
        at /home/iojs/build/workspace/node-test-binary-arm/test/common/index.js:363:15
        at FSReqCallback.oncomplete (fs.js:164:23) {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: null,
      expected: true,
      operator: '=='
    }
  ...


Reason parallel/test-tls-ticket-cluster
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34617/)
Appeared test-nearform-macos10.15-x64-2, test-nearform-macos10.15-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32581/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32621/
Example
not ok 2243 parallel/test-tls-ticket-cluster
  ---
  duration_ms: 0.362
  severity: fail
  exitcode: 1
  stack: |-
    [master] got "listening"
    [master] connecting 59252 session? false
    [master] got "listening"
    [worker] connection reused? false
    [master] got "not-reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] go...

Reason parallel/test-worker-init-failure
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34625/, https://github.com/nodejs/node/pull/34672/)
Appeared test-nearform-macos10.15-x64-1, test-orka-macos10.15-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32673/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32679/
Example
not ok 2469 parallel/test-worker-init-failure
  ---
  duration_ms: 2.469
  severity: fail
  exitcode: 1
  stack: |-
    child stdout: 
    
    child stderr: events.js:291
          throw er; // Unhandled 'error' event
          ^
    
    AssertionError [ERR_ASSERTION]: The input did not match the regular expression /EMFILE/. Input:
    
    'ENOENT: no such file or directory, uv_cwd'
    
        at Worker.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/parallel/test-worker-init-failure.js:38:14)
        at Worker.emit (events.js:314:20)
        at Worker.[kOnErrorMessage] (internal/worker.js:241:10)
        at Worker.[kOnMessage] (internal/worker.js:251:37)
        at MessagePort.<anonymous> (internal/worker.js:167:57)
        at MessagePort.[nodejs.internal.kHybridDispatch] (internal/event_target.js:352:41)
        at MessagePort.exports.emitMessage (internal/per_context/messageport.js:18:26)
        at Worker.[kOnExit] (internal/worker.js:223:5)
        at Worker.<compute...

Jenkins Failure
Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34589/, https://github.com/nodejs/node/pull/34569/, https://github.com/nodejs/node/pull/34416/)
Appeared test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-orka-macos10.15-x64-2, test-requireio_sambthompson-debian10-armv7l_pi2-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32596/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32609/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 203.217.18.114/203.217.18.114:46156' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at com.sun.proxy.$Proxy71.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1147)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1139)

Git Failure
Build Failure
Reason fatal error: ld terminated with signal 9 [Killed]
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34548/, https://github.com/nodejs/node/pull/34461/, https://github.com/nodejs/node/pull/34482/, https://github.com/nodejs/node/pull/34659/)
Appeared test-joyent-ubuntu1804_sharedlibs_container-x64-3, test-joyent-ubuntu1804_sharedlibs_container-x64-4, test-softlayer-ubuntu1804_sharedlibs_container-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32589/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32667/
Example
fatal error: ld terminated with signal 9 [Killed]

Reason Error: Not supported
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34625/, https://github.com/nodejs/node/pull/34643/)
Appeared test-joyent-smartos18-x64-3, test-rackspace-centos7-x64-1, test-softlayer-debian9-x64-1, test-rackspace-fedora27-x64-1, test-rackspace-ubuntu1604-x64-1, test-joyent-ubuntu1804_sharedlibs_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32639/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32642/
Example
Error: Not supported
    at vm:module(0):1:1
    at SourceTextModule.evaluate (internal/vm/module.js:224:23)
    at embedder_main_6.js:1:328
    at processTicksAndRejections (internal/process/task_queues.js:93:5)
(node:705115) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). To terminate the node process on unhandled promise rejection, use the CLI flag `--unhandled-rejections=strict` (see https://nodejs.org/api/cli.html#cli_unhandled_rejections_mode). (rejection id: 1)

Progress
  • parallel/test-http-parser-timeout-reset (6)
  • wasi/test-wasi (4)
  • parallel/test-http-destroyed-socket-write2 (3)
  • parallel/test-repl (3)
  • node-api/test_worker_terminate_finalization/test (2)
  • parallel/test-async-hooks-http-parser-destroy (2)
  • parallel/test-fs-utimes (2)
  • parallel/test-tls-ticket-cluster (2)
  • parallel/test-worker-init-failure (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (3)
  • fatal error: ld terminated with signal 9 [Killed] (5)
  • Error: Not supported (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Review the generated report from ncu-ci walk pr --stats=true --markdown and the linked CI console examples, starting with the named tests such as parallel/test-http-parser-timeout-reset and wasi/test-wasi. Compare failures across the listed platforms and runs; done means the reported recurring CI failures have been investigated and reliability is restored.

Written by the indexing model from the issue text.

Assessment

Tech stack
node.js, shell
Domain
ci-cd, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.