Project-MONAI / Project-MONAI/monai-deploy-app-sdk
Create a Model Moniter [FEA]
@MMelQin is already working on this.
Since Oct 31, 2022.
- Dominant language
- Python
- Stars
- 138
- Forks
- 70
- PR merge metrics
- No merged PRs in 30d
Description
Is your feature request related to a problem? Please describe.
Often we would like to know how the model is performing on the data over a period of time and maintain overall statistics of the model performance. These statistics can be further granularized to specific centers and demographics. If several models are deployed we can use this performance to track the performance of each separate model.
Describe the solution you'd like
A web-based dashboard where the model performance can be displayed. Something like Tensorboard.
Describe alternatives you've considered
None so far.
Additional context
These statistics can be further used for design model updating rules in a continuous fashion.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.