Project-MONAI / Project-MONAI/monai-deploy-app-sdk
Provide a mechanism to verify functionality of an Operator
Open
@mocsharp is already working on this.
Since Jul 20, 2021.
user story
- Dominant language
- Python
- Stars
- 138
- Forks
- 70
- PR merge metrics
- No merged PRs in 30d
Description
User Story
As an application developer I would like to verify that an Operator produces functionally correct output given a golden input and a similarity metric measure so that I can assess the correctness of the Operator
Background
It is important that there is a standardized way to verify the functional correctness of an Operator before an application is published to an orchestration environment.
Success Criteria
Operator Provides the following outputs at a minimum:
- there is a mechanism to provide gold input dataset(s) to the operator
- there is a mechanism to provide gold output dataset(s) to the operator
- there is a mechanism to provide a similarity metric measure
- during execution in verification mode, operator's inputs and outputs are compared using the similarity metric measure and the result of comparison is published
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.