activeloopai / activeloopai/deeplake

[FEATURE] Detect duplicate samples when adding new data to tensors (images)

Open
#1,757 12 comments 0 reactions 1 assignee Claimed by @deepak-soni-git View on GitHub
enhancement
Dominant language
C++
Stars
9.2k
Forks
722
PR merge metrics
No merged PRs in 30d

Description

## 🚨🚨 Feature Request

- A new implementation (Improvement, Extension)

Is it possible to discard samples in case they are already present in the dataset? If not, would this be something interesting to implement? I feel like this would make the dataset extension pipeline much easier to use and implement

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.