Duplicate Items in Shared Dataset MSSPACE1B - Bug or Intended Design?
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 5k
- Forks
- 622
- Avg merge
- 8h 37m
- Merged PRs (30d)
- 5
Description
Description: I noticed that the dataset shared with the SPTAG repository contains many duplicate items / vectors with identical column-wise values. This behavior raises questions about whether it is a bug. The presence of duplicates could potentially impact the performance or results when using SPTAG for nearest neighbor search tasks.
One such example is the row 258036 (0-indexed). It is replicated 33 times in the first 1M rows. See attached images for details.
Expected Behavior: Datasets used for nearest neighbor search typically do not include duplicates unless explicitly stated, as duplicates can skew the performance and evaluation metrics. If duplicates are included by design, would you kindly provide documentation or comments clarifying their purpose.
Thank you for taking time considering this!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing the provenance and intended use of the MSSPACE1B dataset, focusing on the reported 0-indexed row 258036 and its 33 repetitions in the first 1M rows. The issue names no source file or test; done means determining whether the duplicates are intentional and, if so, documenting that behavior or identifying the dataset correction needed.
Written by the indexing model from the issue text.
Assessment
- Domain
- data, search
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100