microsoft / microsoft/SPTAG

>100 dimensions not currently supported for GPU construction.

Open
#184 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C++
Stars
5k
Forks
622
Avg merge
8h 37m
Merged PRs (30d)
5

Description

Using a GloVe100D word embedding I'm able to successfully build and query the index. However, If I try to use a GloVe200D embedding I get the error '>100 dimensions not currently supported for GPU construction.' I'm currently using the python wrapper with nimbusML (ML.NET) to get the word embeddings.

Is there any way to turn off GPU construction? Alternatively, are there plans to support higher dimensions? Thanks for your help with this.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files or tests. Reproduce the GloVe200D case through the Python wrapper, then trace the C++ GPU-construction path and the >100-dimension guard. Done means providing a documented way to disable GPU construction or supporting higher-dimensional embeddings, with coverage for the chosen behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, python
Domain
machine-learning, search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.