Project-MONAI / Project-MONAI/MONAILabel

New model deepgrow_v2: with multi-head inference

Open
#1,328 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
891
Forks
269
Avg merge
15h 41m
Merged PRs (30d)
1

Description

Is your feature request related to a problem? Please describe.

Need to be able to train a unet like model (segresnet,etc) as it exist today Plus in addition add a second head to produce 2 outputs. forground and background which would work as deepgrow mode

This network would be trained in 2 modes:

  • Main network mode. train segresnet as is with normal 10 labels head
  • Deep grow mode. we need to freeze all or segresnet layer. only allow to train the new second head taking from the encoding / decoding and have a new FC layer with 2 outputs

This feature request is related to the following bugs:

Describe the solution you'd like
Provide new network architecture with 2 heads. This would allow us to train the same core encoding and decoding layer or the network

Allow for 2 modes of training:

  • train all label
  • train deepgrow
    Allow 2 modes to run infer:
  • Run infer as normal segmentation
  • Run deep grow

Describe alternatives you've considered

checkptPath = "/rootpath/train_01/train_model.pt"
checkpoint = torch.load(checkptPath)
model_state_dict = checkpoint.get(self.model_state_dict, checkpoint)
self.network.load_state_dict(model_state_dict, strict=False)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing related issues #1298 and #1299, then trace the existing SegResNet and DeepGrow training and inference entry points referenced by this request. The requested result must support shared encoding and decoding with separate segmentation and DeepGrow heads, selectable training modes, and selectable inference modes.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.