Add benchmarks
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 5k
- Forks
- 622
- Avg merge
- 8h 37m
- Merged PRs (30d)
- 5
Description
It would be great to get some ANN performance benchmarks for SPTAG for single node and distributed. The repo doesn't say how well it scales.
My team wanted to use FAISS a few months ago but there was a problem with the License so we are now using HNSWlib even though it isn't quite as performant. We would love to know if this is a viable alternative to FAISS
https://github.com/erikbern/ann-benchmarks is a great repo for ANN benchmarks and it would be great if you could help the author add SPTAG benchmarks for single node and multiple node setups. The author may have some difficulties setting everything up.
If you can't help out in the above repo. It would still be useful to show your own performance benchmarks in the README.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the ann-benchmarks repository and SPTAG's README to understand the existing setup and where benchmark results could be documented. Add single-node and distributed performance benchmarks for SPTAG, or document the results in the README, including enough information to assess scaling and compare it with FAISS and HNSWlib.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- distributed-systems, performance, search
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100