aslotte / aslotte/MLOps.NET

Add support to get best run and metrics that are zero-optimized

Open
#77 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C#
Stars
81
Forks
28
PR merge metrics
No merged PRs in 30d

Description

**Is your feature request related to a problem? Please describe.**
Our current `IsBestRun` method tries to find the best run for a given metric by finding the largest value. This works well for 99% or so of cases but e.g. log loss entropy should be closer to zero to be a good value.

**Describe the solution you'd like**
Add ability to define what a good run looks like for a given metric

**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.

**Additional context**
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.