openshift / openshift/hypershift

Flaky CI: codecov/project

Open
#8,384 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

lifecycle/rotten
Dominant language
Go
Stars
541
Forks
567
Avg merge
5d 13h
Merged PRs (30d)
136

Description

Which jobs are flaking?

codecov/project

Detected in PR #8365, commit f8635c2.

Which tests are flaking?

codecov/project

Since when has it been flaking?

2026-04-30

Reason for failure (if possible)

The codecov/project check is failing because overall project coverage dropped by 3.92% (from 36.42% to 32.50%) due to 85 files with indirect coverage changes. The Codecov report itself confirms that "All modified and coverable lines are covered by tests." The coverage decrease is caused by shifts in the base comparison across unrelated files (85 files with indirect changes vs. 6 files in the diff), not by any missing test coverage in the changed code. This is a known pattern where codecov's project-level coverage gate triggers on base-branch coverage drift.

Anything else we need to know?

Automatically created by oompa.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the codecov/project check and Codecov report for PR #8365, especially the comparison involving 85 indirectly changed files versus 6 files in the diff. No source file or test is named; done means the project-level coverage gate no longer fails because of unrelated base-branch coverage drift while the changed lines remain covered.

Written by the indexing model from the issue text.

Assessment

Domain
ci-cd, testing-qa
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.