cleanlab / cleanlab/examples

Examples: can remove cross-validation from outlier detection

Open
#24 0 comments 0 reactions 0 assignees View on GitHub
good first issue help wanted
Dominant language
Jupyter Notebook
Stars
136
Forks
28
PR merge metrics
No merged PRs in 30d

Description

This example: https://github.com/cleanlab/examples/tree/master/outlier_detection_cifar10
could become much more straightforward without cross-validation now that we've seen it doesn't help too much in the train/test OOD settings.

But to truly assess the utility of cross-validation, we should first include an additional benchmark setting where we evaluate OOD detection on a training dataset with some outliers included (during training not just during testing). Cross-validation may still help in this setting.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.