Indexing support for blob or colder storage tiers.
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 1.9k
- Forks
- 454
- Avg merge
- 3d 22h
- Merged PRs (30d)
- 35
Description
diskann index type is designed and tested for in-memory and local SSD tiers.
We want to extend indexing support to blob and other colder tiers. This requires:
- exploration of suitability of diskann for other tiers
- additional index types if necessary
- distance kernels for columnar formats
- index serialization for OSS table/file formats.
- perf testing on ADLS, HDD, remote disks etc.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue does not name specific files, tests, or entry points. Start by locating the existing DiskANN index, distance-kernel, serialization, and performance-test implementations, then assess their assumptions about in-memory and local SSD tiers. Done means suitable support for colder tiers is designed, implemented where appropriate, and evaluated on ADLS, HDD, and remote disks.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- databases, performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100