Project-MONAI / Project-MONAI/MONAI
Codecov Results Discrepancy
Open
Nobody has claimed this yet.
bug
- Dominant language
- Python
- Stars
- 8.7k
- Forks
- 1.6k
- Avg merge
- 5d 1h
- Merged PRs (30d)
- 20
Description
Describe the bug
The coverage data is inaccurate, as all tests have been executed but the results are not being properly included in the coverage report.
Randomly select one test log:
[2025-04-07T13:56:11.741Z] Starting test: test_task_init (tests.handlers.test_handler_clearml_image.TestHandlerClearMLImageHandler)...
[2025-04-07T13:56:11.741Z] .Finished test: test_task_init (tests.handlers.test_handler_clearml_image.TestHandlerClearMLImageHandler) (0.0435s)
....
[2025-04-07T14:51:03.366Z] ----------------------------------------------------------------------
[2025-04-07T14:51:03.366Z] Ran 16251 tests in 3882.484s
[2025-04-07T14:51:03.366Z]
[2025-04-07T14:51:03.366Z] OK (skipped=388)
Result reported:
https://app.codecov.io/gh/Project-MONAI/MONAI/blob/dev/tests%2Fhandlers%2Ftest_handler_clearml_image.py
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with tests/handlers/test_handler_clearml_image.py and compare its executed tests with the linked Codecov result. Reproduce the full test run shown in the log, then trace why the executed coverage is not included in the report. Done means the Codecov report reflects coverage from the completed test suite.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100