NVIDIA / NVIDIA/cuvs

Inquiry for Format or Interface of cuVS Index Transfering for CPU-GPU Workflow

Open
#338 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Cuda
Stars
854
Forks
236
Avg merge
3d 3h
Merged PRs (30d)
62

Description

When using cuVS without a GPU, both the build and search processes throw errors. Is this related to the RMM (RAPIDS Memory Manager) resource management, or does cuVS require a GPU to run? If cuVS is GPU-dependent, the limited GPU memory may prevent the construction of large datasets, such as being unable to build an index for a dataset of 10M 1024-dimensional vectors. However, if I use compression methods like IVFPQ, the search phase would require less memory as it doesn't need to store the original vectors, possibly allowing the search to be executed on the GPU. I would like to try using other tools to build the index on a CPU platform and then use the GPU platform for search. In this case, what format should I use to pass the built index into ivf_pq or cagra? Could you provide the format specification or interface details for loading the index?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names cuVS, ivf_pq, and cagra but no files or tests. Start by reviewing the existing index-loading interfaces and GPU/RMM requirements for those components. Done means documenting whether CPU-built indexes can be loaded for GPU search and, if supported, the accepted transfer format.

Written by the indexing model from the issue text.

Assessment

Domain
machine-learning, search
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.