Project-MONAI / Project-MONAI/MONAILabel
0.5 threshold used in multi-label deepedit
Open
@danieltudosiu is already working on this.
Since Jan 23, 2023.
backlog
- Dominant language
- Python
- Stars
- 891
- Forks
- 269
- Avg merge
- 15h 41m
- Merged PRs (30d)
- 1
Description
Describe the bug
In the codebase (here, here and here) the threshold of 0.5 is used disregarding the number of labels.
Expected behavior
The threshold should be 1/(len(labels)-1). Such that for a 3-class problem (besides background) the threshold is 0.33.
At the moment we are asking the models to be extra sure of the labels before considering them right. This might be useful but is not explicitly implemented and is worse and worse the more classes there are.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.