owncloud / owncloud/ocis

CI tests have become increasingly flaky

Open
#12,764 0 comments 0 reactions 1 assignee Claimed by @ishabaral View on GitHub
QA:team
Dominant language
Go
Stars
2.1k
Forks
274
Avg merge
2d 1h
Merged PRs (30d)
103

Description

# OCISDEV-1248

CI test failures have become noticeably more frequent, even when there are no functional changes related to the failing tests.

### Flaky tests reported so far
- [ ] Acceptance tests
- [x] e2e-part-3: @PrajwolAmatya https://github.com/owncloud/ocis/pull/12778 https://github.com/owncloud/ocis/pull/12780
- https://github.com/owncloud/ocis/actions/runs/31181336444/job/92876977134
- https://github.com/owncloud/ocis/actions/runs/31172883837/job/92851002292?pr=12616
- https://github.com/owncloud/ocis/actions/runs/31385587283/job/93448606386?pr=12768
- [x] apiCollaboration: @nabim777 -> https://github.com/owncloud/ocis/pull/12785
- https://github.com/owncloud/ocis/actions/runs/31172883837/job/92851003020?pr=12616
- [x] coreApiShareManagementBasicToShares,coreApiShareManagementToShares @anon-pradip -> https://github.com/owncloud/ocis/pull/12786
- https://github.com/owncloud/ocis/actions/runs/31172955664/job/92851549893
- https://github.com/owncloud/ocis/actions/runs/31563331507/job/94012570667?pr=12600
- [ ] apiActivities: @nabim777 https://github.com/owncloud/ocis/pull/12781
- https://github.com/owncloud/ocis/actions/runs/31172955664/job/92851550652
- Recent: https://github.com/owncloud/ocis/actions/runs/34595582900/job/103254262860
- [ ] e2e-app-provider: @ishabaral --> https://github.com/owncloud/ocis/pull/12880
- https://github.com/owncloud/ocis/actions/runs/33478388908/job/99766111561?pr=12849
- https://github.com/owncloud/ocis/actions/runs/33066258291/job/98500940419?pr=12741#step:15:3070
- https://github.com/owncloud/ocis/actions/runs/33499998843/job/99832631625?pr=12853
- https://github.com/owncloud/ocis/actions/runs/33623872657/job/100231554379?pr=12870
- [x] e2e-part-4: @anon-pradip -> https://github.com/owncloud/ocis/pull/12809
- https://github.com/owncloud/ocis/actions/runs/31666365485/job/94342918724
- https://github.com/owncloud/ocis/actions/runs/31774447775/job/94689271697?pr=12781
- [new] https://github.com/owncloud/ocis/actions/runs/33362179832/job/99396702975?pr=12854
- [ ] apiAntivirus
- https://github.com/owncloud/ocis/actions/runs/33490583021/job/99802658116?pr=12849
- https://github.com/owncloud/ocis/actions/runs/32099082062/job/95598481276#step:10:1944
- https://github.com/owncloud/ocis/actions/runs/32020129354/job/95359437151?pr=12804
- https://github.com/owncloud/ocis/actions/runs/32219786125/job/95969184723
- https://github.com/owncloud/ocis/actions/runs/34217749085/job/102334969806?pr=12904
- [x] apiVault @PrajwolAmatya https://github.com/owncloud/ocis/pull/12826 https://github.com/owncloud/ocis/pull/12854
- https://github.com/owncloud/ocis/actions/runs/32334026110/job/96322172678?pr=12809
- https://github.com/owncloud/ocis/actions/runs/32020129354/job/95359436990?pr=12804
- https://github.com/owncloud/ocis/actions/runs/33048993374/job/98442724502?pr=12828
- [ ] cliCommands,apiServiceAvailability @anon-pradip
- https://github.com/owncloud/ocis/actions/runs/33478388908/job/99766111239?pr=12849
- https://github.com/owncloud/ocis/actions/runs/33490583021/job/99802656962?pr=12849
- https://github.com/owncloud/ocis/actions/runs/33499998843/job/99832631150?pr=12853
- https://github.com/owncloud/ocis/actions/runs/33605748190/job/100171786337?pr=12871
- [ ] apiSearch2
- https://github.com/owncloud/ocis/actions/runs/33499998843/job/99832632652?pr=12853

### Expected behavior
CI tests should produce consistent and deterministic results for the same code.

### Actual behavior
Some test suites fail intermittently without any related code changes, requiring workflow reruns to obtain a successful result.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.