nodejs / nodejs/reliability

CI Reliability 2021-09-25

Open
#68 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
57
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Failures in node-test-pull-request/39956 to node-test-pull-request/40054 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2021-09-25 00:04 0 9 27 7 57 9.68%
JSTest Failure
Reason wpt/test-user-timing
Type JS_TEST_FAILURE
Failed PR 13 (https://github.com/nodejs/node/pull/40117/, https://github.com/nodejs/node/pull/40063/, https://github.com/nodejs/node/pull/39945/, https://github.com/nodejs/node/pull/40135/, https://github.com/nodejs/node/pull/40167/, https://github.com/nodejs/node/pull/40169/, https://github.com/nodejs/node/pull/38512/, https://github.com/nodejs/node/pull/40145/, https://github.com/nodejs/node/pull/40121/, https://github.com/nodejs/node/pull/37727/, https://github.com/nodejs/node/pull/40178/, https://github.com/nodejs/node/pull/40151/, https://github.com/nodejs/node/pull/40188/)
Appeared test-requireio_davglass-debian10-arm64_pi3-1, test-requireio_ceejbot-debian10-armv7l_pi2-1, test-orka-macos10.15-x64-2, test-orka-macos10.14-x64-2, test-requireio_mininodes-debian10-armv7l_pi2-1, test-requireio_securogroup-debian10-arm64_pi3-2, test-rackspace-fedora32-x64-1, test-rackspace-win2012r2_vs2015-x64-2, test-requireio_piccoloaiutante-debian10-arm64_pi3-1
First CI https://ci.nodejs.org/job/node-test-pull-request/39956/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40053/
Example
not ok 840 wpt/test-user-timing
  ---
  duration_ms: 6.71
  severity: fail
  exitcode: 1
  stack: |-
    ---- idlharness.any.js ----
    [SKIPPED] idlharness cannot recognize Node.js environment
    ---- invoke_with_timing_attributes.worker.js ----
    [SKIPPED] importScripts not supported
    ---- performance-measure-invalid.worker.js ----
    [SKIPPED] importScripts not supported
    ---- buffered-flag.any.js ----
    [PASS] PerformanceObserver with buffered flag sees previous marks
    ---- buffered-flag.any.js ----
    [PASS] PerformanceObserver with buffered flag sees previous measures
    ---- case-sensitivity.any.js ----
    [PASS] getEntriesByType values are case sensitive
    ---- clear_all_marks.any.js ----
    [PASS] Clearing all marks remove all of them.
    ---- clear_all_measures.any.js ----
    [PASS] Clearing all marks remove all of them.
    ---- clear_non_existent_mark.any.js ----
    [PASS] Clearing a non-existent mark doesn't affect existing marks
    ---- clear_one_mark.any.js ----
    [P...

Reason parallel/test-http2-pipe-named-pipe
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/40150/, https://github.com/nodejs/node/pull/38512/, https://github.com/nodejs/node/pull/40178/, https://github.com/nodejs/node/pull/40180/, https://github.com/nodejs/node/pull/40181/, https://github.com/nodejs/node/pull/39774/, https://github.com/nodejs/node/pull/40188/)
Appeared test-nearform-macos11.0-arm64-1, test-digitalocean-freebsd11-x64-1, test-macstadium-macos11.0-arm64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/39998/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40053/
Example
not ok 1318 parallel/test-http2-pipe-named-pipe
  ---
  duration_ms: 0.60
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:123
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    139837 !== 139244
    
        at WriteStream.<anonymous> (/Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/test/parallel/test-http2-pipe-named-pipe.js:26:12)
        at WriteStream.emit (node:events:402:35)
        at finish (node:internal/streams/writable:751:10)
        at processTicksAndRejections (node:internal/process/task_queues:83:21) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 139837,
      expected: 139244,
      operator: 'strictEqual'
    }
    
    Node.js v17.0.0-pre
  ...


Reason parallel/test-http2-cancel-while-client-reading
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/40131/, https://github.com/nodejs/node/pull/40090/, https://github.com/nodejs/node/pull/40167/, https://github.com/nodejs/node/pull/40121/)
Appeared test-orka-macos10.14-x64-3, test-orka-macos10.14-x64-2, test-nearform-macos10.15-x64-3, test-orka-macos10.15-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/39960/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40012/
Example
not ok 1186 parallel/test-http2-cancel-while-client-reading
  ---
  duration_ms: 0.406
  severity: fail
  exitcode: 1
  stack: |-
    node:events:368
          throw er; // Unhandled 'error' event
          ^
    
    Error: read ECONNRESET
        at TLSWrap.onStreamRead (node:internal/stream_base_commons:220:20)
    Emitted 'error' event on ServerHttp2Stream instance at:
        at emitErrorNT (node:internal/streams/destroy:164:8)
        at emitErrorCloseNT (node:internal/streams/destroy:129:3)
        at processTicksAndRejections (node:internal/process/task_queues:83:21) {
      errno: -54,
      code: 'ECONNRESET',
      syscall: 'read'
    }
    
    Node.js v17.0.0-pre
  ...


Reason parallel/test-repl-sigint-nested-eval
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/40022/, https://github.com/nodejs/node/pull/40157/, https://github.com/nodejs/node/pull/40175/, https://github.com/nodejs/node/pull/40084/)
Appeared test-softlayer-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-4, test-orka-macos10.14-x64-2, test-osuosl-centos7-ppc64_le-4, test-softlayer-ubuntu1804_sharedlibs_container-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/39967/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40051/
Example
not ok 2136 parallel/test-repl-sigint-nested-eval
  ---
  duration_ms: 0.414
  severity: fail
  exitcode: 1
  stack: |-
    Stacktrace:
       ptr1=0x146c20f41d49
        ptr2=(nil)
        ptr3=(nil)
        ptr4=(nil)
        failure_message_object=0x7ffcddac0d90
    
    ==== JS stack trace =========================================
    
        0: ExitFrame [pc: 0x556f88a6beb9]
        1: StubFrame [pc: 0x556f88aeeb4a]
    Security context: 0x03611d6ab041 <JSGlobalObject>
        2: _fatalException [0x3611d688819] [node:internal/process/execution:151] [bytecode=0x3048e3ce52d1 offset=13](this=0x03611d682d29 <process map = 0xd7949df5781>,0x146c20f41d49 <Odd Oddball: termination_exception>,0x146c20f41769 <false>)
        3: InternalFrame [pc: 0x556f889fd6fb]
        4: EntryFrame [pc: 0x556f889fd483]
        5: builtin exit frame: evaluate(this=0x32babd967541 <ModuleWrap map = 0x652e5f8d4d9>,0x32babd967541 <ModuleWrap map = 0x652e5f8d4d9>,-1,0x146c20f41769 <false>)
    
        6: getESMFacade [0x2a75150585a1...

Reason parallel/test-child-process-fork-closed-channel-segfault
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/40063/, https://github.com/nodejs/node/pull/40145/, https://github.com/nodejs/node/pull/40180/)
Appeared test-requireio_williamkapke-debian10-arm64_pi3-2, test-requireio_rvagg-debian10-armv7l_pi2-1
First CI https://ci.nodejs.org/job/node-test-pull-request/39978/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40032/
Example
not ok 98 parallel/test-child-process-fork-closed-channel-segfault
  ---
  duration_ms: 2.972
  severity: fail
  exitcode: 1
  stack: |-
    /home/iojs/build/workspace/node-test-binary-arm/test/parallel/test-child-process-fork-closed-channel-segfault.js:83
                throw err;
                ^
    
    Error: write EPIPE
        at ChildProcess.target._send (node:internal/child_process:844:20)
        at ChildProcess.<anonymous> (node:internal/child_process:665:16)
        at ChildProcess.emit (node:events:402:35)
        at emit (node:internal/child_process:915:12)
        at processTicksAndRejections (node:internal/process/task_queues:84:21) {
      errno: -32,
      code: 'EPIPE',
      syscall: 'write'
    }
    
    Node.js v17.0.0-pre
  ...


Reason pummel/test-fs-watch-non-recursive
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/40063/, https://github.com/nodejs/node/pull/40084/)
Appeared test-nearform-macos11.0-arm64-1, test-equinix-ubuntu2004_sharedlibs_container-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/39974/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40051/
Example
not ok 3132 pummel/test-fs-watch-non-recursive
  ---
  duration_ms: 0.815
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:171
      throw err;
      ^
    
    AssertionError [ERR_ASSERTION]: function should not have been called at /Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/test/pummel/test-fs-watch-non-recursive.js:43
    called with arguments: 'rename', 'testsubdir'
        at FSWatcher.mustNotCall (/Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/test/common/index.js:479:12)
        at FSWatcher.emit (node:events:390:28)
        at FSEvent.FSWatcher._handle.onchange (node:internal/fs/watchers:212:12) {
      generatedMessage: false,
      code: 'ERR_ASSERTION',
      actual: undefined,
      expected: undefined,
      operator: 'fail'
    }
    
    Node.js v17.0.0-pre
  ...


Reason sequential/test-cpu-prof-exit
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/40131/, https://github.com/nodejs/node/pull/40188/)
Appeared test-requireio_pivotalagency-debian10-arm64_pi3-2, test-osuosl-aix72-ppc64_be-3
First CI https://ci.nodejs.org/job/node-test-pull-request/39984/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40050/
Example
not ok 805 sequential/test-cpu-prof-exit
  ---
  duration_ms: 2.250
  severity: fail
  exitcode: 1
  stack: |-
    Dispatching message { "id": 1, "method": "Profiler.enable" }
    Receive CPU profile message
    {"id":1,"result":{}}
    Dispatching message { "id": 2, "method": "Profiler.start" }
    Receive CPU profile message
    {"id":2,"result":{}}
    Dispatching message { "id": 3, "method": "Profiler.setSamplingInterval", "params": { "interval": 50 } }
    Receive CPU profile message
    {"id":3,"error":{"code":-32000,"message":"Cannot change sampling interval when profiling."}}
    
    node:assert:123
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    null !== 55
    
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-binary-arm/test/sequential/test-cpu-prof-exit.js:35:10)
        at Module._compile (node:internal/modules/cjs/loader:1095:14)
        at Object.Module._extensions..js (node:internal/modules/...

Reason sequential/test-debugger-restart-message
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/40131/, https://github.com/nodejs/node/pull/40082/)
Appeared test-requireio_joeyvandijk-debian10-armv7l_pi2-2, test-osuosl-aix72-ppc64_be-3
First CI https://ci.nodejs.org/job/node-test-pull-request/39984/
Last CI https://ci.nodejs.org/job/node-test-pull-request/39993/
Example
not ok 812 sequential/test-debugger-restart-message
  ---
  duration_ms: 21.359
  severity: fail
  exitcode: 1
  stack: |-
    /home/iojs/build/workspace/node-test-binary-arm/test/common/debugger.js:84
              reject(new Error([
                     ^
    
    Error: Timeout (10000) while waiting for /(?:assert|break|break on start|debugCommand|exception|other|promiseRejection) in/i; found: < Debugger ending on ws://127.0.0.1:9229/0161d4a8-8f01-4590-b7e9-18412e6e9a13
    < For help, see: https://nodejs.org/en/docs/inspector
    < 
    debug> 
    
    < Debugger listening on ws://127.0.0.1:9229/f8ab1b5e-afa3-4a18-8975-1d76592e7ade
    < For help, see: https://nodejs.org/en/docs/inspector
    < 
    
    debug> 
    
    connecting to 127.0.0.1:9229 ...
     ok
    
    debug> 
    
    < Debugger attached.
    < 
    debug> 
        at Timeout.<anonymous> (/home/iojs/build/workspace/node-test-binary-arm/test/common/debugger.js:84:18)
        at listOnTimeout (node:internal/timers:557:17)
        at proc...

Reason sequential/test-diagnostic-dir-cpu-prof
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/40131/, https://github.com/nodejs/node/pull/40145/)
Appeared test-nearform-macos10.15-x64-3, test-osuosl-aix72-ppc64_be-3
First CI https://ci.nodejs.org/job/node-test-pull-request/39984/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40021/
Example
not ok 3415 sequential/test-diagnostic-dir-cpu-prof
  ---
  duration_ms: 0.326
  severity: fail
  exitcode: 1
  stack: |-
    Dispatching message { "id": 1, "method": "Profiler.enable" }
    Receive CPU profile message
    {"id":1,"result":{}}
    Dispatching message { "id": 2, "method": "Profiler.start" }
    Receive CPU profile message
    {"id":2,"result":{}}
    Dispatching message { "id": 3, "method": "Profiler.setSamplingInterval", "params": { "interval": 50 } }
    Receive CPU profile message
    {"id":3,"error":{"code":-32000,"message":"Cannot change sampling interval when profiling."}}
    EndStartedProfilers
    V8CpuProfilerConnection::End(), ending = false
    Dispatching message { "id": 4, "method": "Profiler.stop" }
    Receive CPU profile message
    Writing profile response (id = 4)
    Written result to /Users/iojs/node-tmp/.tmp.3414/prof/CPU.20210921.171725.31055.0.001.cpuprofile
    
    [
      {
        id: 1,
        callFrame: {
          functionName: '(root)',
          scriptId: '0',...

Reason sequential/test-heap-prof
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/40131/, https://github.com/nodejs/node/pull/40150/)
Appeared test-requireio_williamkapke-debian10-arm64_pi3-2, test-osuosl-aix72-ppc64_be-3
First CI https://ci.nodejs.org/job/node-test-pull-request/39984/
Last CI https://ci.nodejs.org/job/node-test-pull-request/39998/
Example
not ok 816 sequential/test-heap-prof
  ---
  duration_ms: 240.213
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...


Jenkins Failure
Reason Build timed out (after 5 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/40042/, https://github.com/nodejs/node/pull/40063/, https://github.com/nodejs/node/pull/40084/, https://github.com/nodejs/node/pull/40145/, https://github.com/nodejs/node/pull/40121/, https://github.com/nodejs/node/pull/40180/, https://github.com/nodejs/node/pull/40181/, https://github.com/nodejs/node/pull/39774/)
Appeared test-ibm-rhel7-s390x-1, test-ibm-rhel7-s390x-2, test-ibm-rhel7-s390x-3
First CI https://ci.nodejs.org/job/node-test-pull-request/39973/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40045/
Example
Build timed out (after 5 minutes). Marking the build as failed.

Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/39945/, https://github.com/nodejs/node/pull/40145/, https://github.com/nodejs/node/pull/40121/, https://github.com/nodejs/node/pull/40175/, https://github.com/nodejs/node/pull/39774/, https://github.com/nodejs/node/pull/40188/)
Appeared test-azure_msft-win10_vs2019-x64-1, test-ibm-rhel7-s390x-4, test-rackspace-fedora32-x64-1, test-digitalocean-fedora32-x64-1, test-osuosl-aix72-ppc64_be-4, test-osuosl-aix72-ppc64_be-2, test-osuosl-aix72-ppc64_be-3
First CI https://ci.nodejs.org/job/node-test-pull-request/39982/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40049/
Example
java.io.IOException: Backing channel 'JNLP4-connect connection from 137.116.94.125/137.116.94.125:3074' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
	at com.sun.proxy.$Proxy98.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1211)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1203)

Build Failure
Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/39945/, https://github.com/nodejs/node/pull/40175/, https://github.com/nodejs/node/pull/40178/)
Appeared test-orka-macos10.14-x64-2, test-rackspace-debian10-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/39982/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40027/
Example
fatal: No rebase in progress?

Reason ERROR: Step ?Publish JUnit test result report? failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/39945/, https://github.com/nodejs/node/pull/38512/)
Appeared test-osuosl-aix72-ppc64_be-2, test-osuosl-aix72-ppc64_be-3
First CI https://ci.nodejs.org/job/node-test-pull-request/39982/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40010/
Example
ERROR: Step ?Publish JUnit test result report? failed: no workspace for node-test-commit-aix/nodes=aix72-ppc64 #38356
Sending e-mails to: michael_dawson@ca.ibm.com vieuxtech@gmail.com ashley.cripps@ibm.com
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

Reason Failed to trigger sub builds
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/39392/, https://github.com/nodejs/node/pull/40180/)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/40003/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40039/
Example
Failed to trigger sub builds

Reason fatal error: ld terminated with signal 9 [Killed]
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/40121/, https://github.com/nodejs/node/pull/40145/)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-8
First CI https://ci.nodejs.org/job/node-test-pull-request/40020/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40023/
Example
fatal error: ld terminated with signal 9 [Killed]

undefined
Reason Unknown
Type undefined
Failed PR 2 (https://github.com/nodejs/node/pull/40169/, https://github.com/nodejs/node/pull/40188/)
Appeared test-msft-win10-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/40009/
Last CI https://ci.nodejs.org/job/node-test-pull-request/40053/
Example
Unknown

Progress
  • wpt/test-user-timing (13)
  • parallel/test-http2-pipe-named-pipe (7)
  • parallel/test-http2-cancel-while-client-reading (4)
  • parallel/test-repl-sigint-nested-eval (4)
  • parallel/test-child-process-fork-closed-channel-segfault (3)
  • pummel/test-fs-watch-non-recursive (2)
  • sequential/test-cpu-prof-exit (2)
  • sequential/test-debugger-restart-message (2)
  • sequential/test-diagnostic-dir-cpu-prof (2)
  • sequential/test-heap-prof (2)
  • Build timed out (after 5 minutes). Marking the build as failed. (8)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (6)
  • fatal: No rebase in progress? (3)
  • ERROR: Step ?Publish JUnit test result report? failed: no workspace for ... (2)
  • Failed to trigger sub builds (2)
  • fatal error: ld terminated with signal 9 [Killed] (2)
  • Unknown (2)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the linked CI console examples and the listed failing tests, including test/parallel/test-http2-pipe-named-pipe.js and test/parallel/test-child-process-fork-closed-channel-segfault.js. Compare their failures across the referenced platforms and CI runs. Done means the recurring failures have confirmed causes and no longer appear in the affected pull-request runs.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, node.js, shell
Domain
ci-cd, devops, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.