dotnet / dotnet/machinelearning

CrossValidation and TrainTest for AnomalyDetection

Open
#2,686 2 comments 0 reactions 0 assignees View on GitHub
api-suggestion area-Core enhancement Priority:2
Dominant language
C#
Stars
9.4k
Forks
2k
Avg merge
2d 20h
Merged PRs (30d)
11

Description

There are two extensions for training, `TrainTestSplit` and `CrossValidation`, that are not clearly suited for `AnomalyDetection` as written.

`TrainTestSplit` is available in `AnomalyDetection` as it's in the `TrainerCatalogBase`, but anomaly detection scenarios often have structured data (e.g. time series) that we don't handle. Do we disable `TrainTestSplit` for `AnomalyDetection`? Do we add support for some sorts of structured data different than we have now? Do we assume that all structural problems can be solved with a `SamplingKeyColumn`?

`CrossValidation` is not supported, but could be supported, should we solve the `TrainTestSplit` issue.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.