Not enough memory on host devices offered by Azure
Open
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 5k
- Forks
- 622
- Avg merge
- 8h 37m
- Merged PRs (30d)
- 5
Description
The resulting index for my application is over 32gb, so there are not many Azure services to host on. Azure needs to integrate this into a product database to store the vectors as well, so the front end device does not need 32gb of vectors loaded in to memory.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named in the issue. First clarify how SPTAG indexes over 32 GB could be stored and served through an Azure product database instead of loading all vectors on the front-end device; done means a defined, supported storage and serving approach.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure, cpp
- Domain
- cloud, databases, distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100