nodejs / nodejs/reliability

CI Reliability 2020-08-06

Open
#35 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/32540 to node-test-pull-request/32634 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2020-08-06 00:33 1 33 1 16 49 39.76%
JSTest Failure
Reason parallel/test-http-parser-timeout-reset
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/34602/, https://github.com/nodejs/node/pull/34531/, https://github.com/nodejs/node/pull/34582/, https://github.com/nodejs/node/pull/34572/, https://github.com/nodejs/node/pull/34416/, https://github.com/nodejs/node/pull/34558/)
Appeared test-digitalocean-freebsd11-x64-2, test-ibm-aix71-ppc64_be-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32602/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32610/
Example
not ok 1137 parallel/test-http-parser-timeout-reset
  ---
  duration_ms: 1.312
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched noop function calls. Expected exactly 3, actual 6.
        at Proxy.mustCall (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/common/index.js:331:10)
        at Server.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd11-x64/test/parallel/test-http-parser-timeout-reset.js:37:42)
        at Object.onceWrapper (events.js:420:28)
        at Server.emit (events.js:314:20)
        at emitListeningNT (net.js:1322:10)
        at processTicksAndRejections (internal/process/task_queues.js:79:21)
  ...


Reason parallel/test-fs-symlink
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34568/, https://github.com/nodejs/node/pull/34342/, https://github.com/nodejs/node/pull/34558/)
Appeared test-joyent-alpine312_container-x64-1, test-osuosl-centos7-ppc64_le-2, undefined, test-digitalocean-ubi81_container-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32561/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32586/
Example
not ok 698 parallel/test-fs-symlink
  ---
  duration_ms: 0.120
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:885
        throw newErr;
        ^
    
    AssertionError [ERR_ASSERTION]: ifError got unwanted exception: ENOENT: no such file or directory, lstat '/home/iojs/node-tmp/.tmp.696/symlink1.js'
        at /home/iojs/build/workspace/node-test-commit-linux/nodes/alpine-latest-x64/test/parallel/test-fs-symlink.js:46:12
        at /home/iojs/build/workspace/node-test-commit-linux/nodes/alpine-latest-x64/test/common/index.js:365:15
        at FSReqCallback.oncomplete (fs.js:176:21)
     {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: [Error: ENOENT: no such file or directory, lstat '/home/iojs/node-tmp/.tmp.696/symlink1.js'] {
        errno: -2,
        code: 'ENOENT',
        syscall: 'lstat',
        path: '/home/iojs/node-tmp/.tmp.696/symlink1.js'
      },
      expected: null,
      operator: 'ifError'
    }
  ...


Reason parallel/test-fs-utimes
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34375/, https://github.com/nodejs/node/pull/34618/, https://github.com/nodejs/node/pull/34461/)
Appeared test-requireio_svincent-debian10-armv7l_pi2-1, test-requireio_ceejbot-debian10-armv7l_pi2-1, test-requireio_svincent-debian10-armv7l_pi2-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32577/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32626/
Example
not ok 210 parallel/test-fs-utimes
  ---
  duration_ms: 15.583
  severity: fail
  exitcode: 1
  stack: |-
    assert.js:385
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: FAILED: expect_ok [Arguments] {
      '0': 'lutimes',
      '1': '/home/iojs/tmp/.tmp.210/symlink',
      '2': null,
      '3': '123456',
      '4': -1,
      '5': [Function: lstatSync]
    }
         check_mtime: 2.5410001277923584
        at expect_ok (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-fs-utimes.js:64:3)
        at /home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-fs-utimes.js:105:7
        at /home/iojs/build/workspace/node-test-binary-arm/test/common/index.js:363:15
        at FSReqCallback.oncomplete (fs.js:164:23) {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: null,
      expected: true,
      operator: '=='
    }
  ...


Reason parallel/test-policy-integrity
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34372/, https://github.com/nodejs/node/pull/34375/, https://github.com/nodejs/node/pull/34404/)
Appeared test-digitalocean-freebsd11-x64-2, test-softlayer-centos7-x64-1, test-joyent-smartos18-x64-4, test-packetnet-centos7-arm64-2, test-requireio_svincent-debian10-armv7l_pi2-2, test-requireio_pivotalagency-debian10-arm64_pi3-2, test-digitalocean-freebsd11-x64-1, test-rackspace-fedora27-x64-1, test-digitalocean-ubuntu1804-x64-1, test-joyent-smartos18-x64-3, test-requireio_svincent-debian10-armv7l_pi2-3, test-requireio_williamkapke-debian10-arm64_pi3-1, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-azure_msft-win10_vcbt2015-x64-4, test-rackspace-win2012r2_vs2017-x64-4, test-digitalocean-debian9-x64-1, test-azure_msft-win10_vs2019-x64-4, test-rackspace-win2012r2_vs2013-x64-1, test-requireio_svincent-debian10-armv7l_pi2-1, test-requireio_piccoloaiutante-debian10-arm64_pi3-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32544/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32625/
Example
not ok 1766 parallel/test-policy-integrity
  ---
  duration_ms: 120.510
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason wasi/test-wasi
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/34531/, https://github.com/nodejs/node/pull/34558/, https://github.com/nodejs/node/pull/34622/)
Appeared test-digitalocean-freebsd11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32604/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32632/
Example
not ok 8 wasi/test-wasi
  ---
  duration_ms: 2.955
  severity: fail
  exitcode: 1
  stack: |-
    executing cant_dotdot
    (node:64592) ExperimentalWarning: WASI is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69720)
    fd_prestat_dir_name(3, 131088, 9)
    fd_prestat_get(4, 69720)
    fd_prestat_dir_name(4, 131152, 5)
    fd_prestat_get(5, 69720)
    environ_sizes_get(69724, 69720)
    environ_get(134464, 131168)
    fd_fdstat_get(3, 69672)
    path_open(3, 1, 1033, 14, 0, 264240830, 268435455, 0, 69668)
    
    executing clock_getres
    (node:64594) ExperimentalWarning: WASI is an experimental feature. This feature could change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    fd_prestat_get(3, 69688)
    fd_prestat_dir_name(3, 131088, 9)
    fd_prestat_get(4, 69688)
    fd_prestat_dir_name(4, 131152, 5)
    fd_prestat_get(5, 69688)
    environ_siz...

Reason parallel/test-http-destroyed-socket-write2
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34416/, https://github.com/nodejs/node/pull/34629/)
Appeared test-orka-macos10.14-x64-2, test-orka-macos10.15-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32609/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32634/
Example
not ok 1742 parallel/test-http-destroyed-socket-write2
  ---
  duration_ms: 120.61
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-policy-parse-integrity
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34616/)
Appeared test-requireio_pivotalagency-debian10-arm64_pi3-2, test-azure_msft-win10_vs2019-x64-1, test-rackspace-win2012r2_vs2019-x64-2, test-azure_msft-win10_vcbt2015-x64-3, test-rackspace-win2012r2_vs2017-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32566/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32620/
Example
not ok 442 parallel/test-policy-parse-integrity
  ---
  duration_ms: 268.825
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Reason parallel/test-tls-ticket-cluster
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34617/)
Appeared test-nearform-macos10.15-x64-2, test-nearform-macos10.15-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32581/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32621/
Example
not ok 2243 parallel/test-tls-ticket-cluster
  ---
  duration_ms: 0.362
  severity: fail
  exitcode: 1
  stack: |-
    [master] got "listening"
    [master] connecting 59252 session? false
    [master] got "listening"
    [worker] connection reused? false
    [master] got "not-reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] got "reused"
    [master] connecting 59252 session? true
    [worker] connection reused? true
    [master] go...

Reason parallel/test-worker-stdio
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34548/, https://github.com/nodejs/node/pull/34616/)
Appeared test-requireio_pivotalagency-debian10-arm64_pi3-2, test-requireio_sambthompson-debian10-armv7l_pi2-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32573/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32620/
Example
not ok 676 parallel/test-worker-stdio
  ---
  duration_ms: 18.34
  severity: fail
  exitcode: 1
  stack: |-
    internal/buffer.js:950
    class FastBuffer extends Uint8Array {}
    ^
    
    RangeError: Array buffer allocation failed
        at new ArrayBuffer (<anonymous>)
        at new Uint8Array (<anonymous>)
        at new FastBuffer (internal/buffer.js:950:1)
        at createUnsafeBuffer (internal/buffer.js:1031:12)
        at allocate (buffer.js:403:10)
        at Function.allocUnsafe (buffer.js:368:10)
        at Function.concat (buffer.js:548:25)
        at BufferingWritable.get buffer [as buffer] (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-worker-stdio.js:21:19)
        at BufferingWritable.<anonymous> (/home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-worker-stdio.js:36:55)
        at BufferingWritable.<anonymous> (/home/iojs/build/workspace/node-test-binary-arm/test/common/index.js:365:15)
  ...


Reason sequential/test-inspector-stop-profile-after-done
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34558/)
Appeared test-osuosl-centos7-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/32566/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32585/
Example
not ok 3046 sequential/test-inspector-stop-profile-after-done
  ---
  duration_ms: 0.343
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:41330/f6277107-ba93-4b98-ad7e-3c28d837b718
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [err] Debugger attached.
    [err] 
    [out] {}
    [out] 
    [out] {}
    [out] 
    [out] {}
    [out] 
    Mismatched noop function calls. Expected exactly 1, actual 0.
        at Proxy.mustCall (/home/iojs/build/workspace/node-test-commit-plinux/nodes/centos7-ppcle/test/common/index.js:331:10)
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-plinux/nodes/centos7-ppcle/test/sequential/test-inspector-stop-profile-after-done.js:30:24)
        at Module._compile (internal/modules/cjs/loader.js:1270:30)
        at Object.Module._extensions..js (internal/modules/cjs/loader.js:1291:10)
        at Module.load (interna...

Jenkins Failure
Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/34542/, https://github.com/nodejs/node/pull/34342/, https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34589/, https://github.com/nodejs/node/pull/34569/, https://github.com/nodejs/node/pull/34416/)
Appeared test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-orka-macos10.15-x64-2, test-requireio_sambthompson-debian10-armv7l_pi2-1, test-orka-macos10.14-x64-2, test-orka-macos10.14-x64-3, test-orka-macos10.14-x64-1, test-requireio_piccoloaiutante-debian10-arm64_pi3-1, test-requireio_svincent-debian10-armv7l_pi2-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32543/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32609/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 203.217.18.114/203.217.18.114:46156' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
	at com.sun.proxy.$Proxy71.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1147)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1139)

Build Failure
Reason Failed to trigger node-test-commit
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/34372/, https://github.com/nodejs/node/pull/34578/, https://github.com/nodejs/node/pull/34404/, https://github.com/nodejs/node/pull/34629/)
Appeared test-ibm-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/32540/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32633/
Example
Failed to trigger node-test-commit

Reason fatal error: ld terminated with signal 9 [Killed]
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/34530/, https://github.com/nodejs/node/pull/34548/, https://github.com/nodejs/node/pull/34461/, https://github.com/nodejs/node/pull/34482/)
Appeared test-joyent-ubuntu1804_sharedlibs_container-x64-3, test-joyent-ubuntu1804_sharedlibs_container-x64-4, test-softlayer-ubuntu1804_sharedlibs_container-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/32589/
Last CI https://ci.nodejs.org/job/node-test-pull-request/32627/
Example
fatal error: ld terminated with signal 9 [Killed]

Git Failure
Progress
  • parallel/test-http-parser-timeout-reset (6)
  • parallel/test-fs-symlink (4)
  • parallel/test-fs-utimes (3)
  • parallel/test-policy-integrity (3)
  • wasi/test-wasi (3)
  • parallel/test-http-destroyed-socket-write2 (2)
  • parallel/test-policy-parse-integrity (2)
  • parallel/test-tls-ticket-cluster (2)
  • parallel/test-worker-stdio (2)
  • sequential/test-inspector-stop-profile-after-done (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (6)
  • Failed to trigger node-test-commit (4)
  • fatal error: ld terminated with signal 9 [Killed] (4)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the listed failures in test/parallel/test-http-parser-timeout-reset.js, test/parallel/test-fs-symlink.js, test/parallel/test-fs-utimes.js, test/parallel/test-policy-integrity.js, and wasi/test-wasi, using the linked CI logs to reproduce platform-specific behavior. Done means identifying and fixing the reported reliability failures so the affected tests pass across the failing CI environments.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.