Project-MONAI / Project-MONAI/model-zoo
using the original labels, instead of inverted transformed labels for evaluation
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 338
- Forks
- 106
- PR merge metrics
- No merged PRs in 30d
Description
Currently quite a few bundles use
the inverted version of preprocessed original labels as the reference during evaluation:
which is different from the approach taken in the tutorial using the original label directly during evaluation (https://github.com/Project-MONAI/tutorials/blob/main/3d_segmentation/spleen_segmentation_3d.ipynb)
would be great to consider the standard method used in the tutorial for bundle evaluate.json
cc @holgerroth @dongyang0122
(this needs an update as well) https://github.com/Project-MONAI/tutorials/tree/main/bundle/spleen_segmentation)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Compare the model-zoo spleen_ct_segmentation/configs/evaluate.json reference at the linked revision with the 3d_segmentation/spleen_segmentation_3d.ipynb tutorial. Review the related tutorials/bundle/spleen_segmentation directory and identify bundles using inverted preprocessed labels. Done means the affected evaluate.json files use the tutorial's original-label evaluation approach and the linked bundle tutorial is updated as needed.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100