activeloopai / activeloopai/deeplake

[FEATURE] Detect duplicate samples when adding new data to tensors (images)

未关闭
#1,757 12 条评论 0 个 reaction 已指派 1 人 已被 @deepak-soni-git 认领 在 GitHub 查看
enhancement
主要语言
C++
星标
9.2k
派生
722
PR 合并指标
30 天内没有已合并 PR

描述

## 🚨🚨 Feature Request

- A new implementation (Improvement, Extension)

Is it possible to discard samples in case they are already present in the dataset? If not, would this be something interesting to implement? I feel like this would make the dataset extension pipeline much easier to use and implement

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。