microsoft / microsoft/SPTAG

low dimension data (dimension 4) problem occur in "Parallel TpTree Partition begin" step

Open
#121 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C++
Stars
5k
Forks
622
Avg merge
8h 37m
Merged PRs (30d)
5

Description

for now, the index build and index search go well in dataset which dimension is bigger than 8.
However, when i use the random dataset 10M * 4, there is a "Segmentation fault". the detail position is as follow:
Start to build BKTree 1
1 BKTree built, 10000001 10000000
build RNG graph!
Parallel TpTree Partition begin
Segmentation fault (here).

So, i wonder whether there exist a parameter that limits the input dataset dimension?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the failure with the random 10M × 4 dataset and follow the index-build path through the reported “Parallel TpTree Partition begin” step. Determine why the segmentation fault occurs for dimension 4, and verify that index building completes without a crash for the affected input.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
search
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.