Project-MONAI / Project-MONAI/monai-deploy-app-sdk

Provide a mechanism to verify functionality of an Operator

Open
#10 0 comments 0 reactions 2 assignees View on GitHub

@mocsharp is already working on this.

Since Jul 20, 2021.

user story
Dominant language
Python
Stars
138
Forks
70
PR merge metrics
No merged PRs in 30d

Description

User Story
As an application developer I would like to verify that an Operator produces functionally correct output given a golden input and a similarity metric measure so that I can assess the correctness of the Operator

Background
It is important that there is a standardized way to verify the functional correctness of an Operator before an application is published to an orchestration environment.

Success Criteria
Operator Provides the following outputs at a minimum:

  • there is a mechanism to provide gold input dataset(s) to the operator
  • there is a mechanism to provide gold output dataset(s) to the operator
  • there is a mechanism to provide a similarity metric measure
  • during execution in verification mode, operator's inputs and outputs are compared using the similarity metric measure and the result of comparison is published

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.