deepchecks / deepchecks/deepchecks

[FEAT][CV] Label Ambiguity

Open
#1,438 1 comment 0 reactions 0 assignees View on GitHub
feature vision
Dominant language
Python
Stars
4.1k
Forks
303
PR merge metrics
No merged PRs in 30d

Description

Add Label Ambiguity check, based on Similar Image logic -
Meaning, similar images with conflicting labels.
Think of how this should be applied for object detection - probably comparing bboxes?

Reuse as much code as possible with SimilarImageLeakage and LabelAmbiguity (tabular) if possible

Contributor guide

Open the contributing guide

Research direction

Start by reading the existing SimilarImageLeakage and tabular LabelAmbiguity checks to understand their shared logic. Then determine how conflicting labels should be identified for similar images and whether object-detection bounding boxes must be compared. Done means the intended behavior and reusable implementation scope are defined and covered for the relevant image tasks.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.