Project-MONAI / Project-MONAI/model-zoo
Bundles should handle zero validation input
@yiheng-wang-nv is already working on this.
Since May 13, 2023.
- Dominant language
- Python
- Stars
- 338
- Forks
- 106
- PR merge metrics
- No merged PRs in 30d
Description
Is your feature request related to a problem? Please describe.
For both single gpu and multi-gpu training, if the validation input is empty or not enough (in case of multi-gpu distribution) currently it throws an error. However it should allow and skip the Evaluation step if there is no enough data for validation. (example spleen bundle currently fails)
Describe the solution you'd like
Many times, user has little data to finetune and existing model. And he/she doesn't have validate split or wants to skip.
Additional context
Such situations normally happen during Active Learning iterations. Where annotators add small set of labels per iteration in the beginnning.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.