[FEA]Vamana API Disk Index Support
Nobody has claimed this yet.
- Dominant language
- Cuda
- Stars
- 854
- Forks
- 236
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 62
Description
Is your feature request related to a problem? Please describe.
The Vamana python api currently only supports getting loaded by StaticMemoryIndex of diskannpy,
need the Vamana api exposed via python to support exporting the index in a way that can be used by the StaticDiskIndex class in diskannpy (https://microsoft.github.io/DiskANN/docs/python/latest/diskannpy.html#StaticDiskIndex).
We need this to be able to allow customers to use the disk index so that they can support very large indexes that might not fit on resource (cpu/gpu). So we want to allow them to use it from disk, even if search might be slower.
Describe the solution you'd like
I'd like to see the saving of the vamana graph in cuvs work with the vectors_from_file (https://microsoft.github.io/DiskANN/docs/python/latest/diskannpy.html#vectors_from_file), so that I can then create the appropriate StaticDiskIndex.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the Vamana Python API and comparing its current StaticMemoryIndex loading path with diskannpy's StaticDiskIndex and vectors_from_file requirements. Confirm what exported graph and vector data those entry points accept; done means a cuVS-saved Vamana index can be loaded and used through StaticDiskIndex.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- api, search
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100