Project-MONAI / Project-MONAI/MONAILabel
New model deepgrow_v2: with multi-head inference
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 891
- Forks
- 269
- Avg merge
- 15h 41m
- Merged PRs (30d)
- 1
Description
Is your feature request related to a problem? Please describe.
Need to be able to train a unet like model (segresnet,etc) as it exist today Plus in addition add a second head to produce 2 outputs. forground and background which would work as deepgrow mode
This network would be trained in 2 modes:
- Main network mode. train segresnet as is with normal 10 labels head
- Deep grow mode. we need to freeze all or segresnet layer. only allow to train the new second head taking from the encoding / decoding and have a new FC layer with 2 outputs
This feature request is related to the following bugs:
- Finetune new model by freezing all layers except FC
- Deepedit has low resolution and non responsive to new clicks
Describe the solution you'd like
Provide new network architecture with 2 heads. This would allow us to train the same core encoding and decoding layer or the network
Allow for 2 modes of training:
- train all label
- train deepgrow
Allow 2 modes to run infer: - Run infer as normal segmentation
- Run deep grow
Describe alternatives you've considered
checkptPath = "/rootpath/train_01/train_model.pt"
checkpoint = torch.load(checkptPath)
model_state_dict = checkpoint.get(self.model_state_dict, checkpoint)
self.network.load_state_dict(model_state_dict, strict=False)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing related issues #1298 and #1299, then trace the existing SegResNet and DeepGrow training and inference entry points referenced by this request. The requested result must support shared encoding and decoding with separate segmentation and DeepGrow heads, selectable training modes, and selectable inference modes.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- computer-vision, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100