infiniflow / infiniflow/infinity
[Feature Request]: Benchmark framework
- Dominant language
- C++
- Stars
- 4.7k
- Forks
- 445
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 7
Description
### Is there an existing issue for the same feature request?
- [X] I have checked the existing issues.
### Is your feature request related to a problem?
_No response_
### Describe the feature you'd like
Currently, there is a lack of benchmarks for comparing the vector and full-text search capabilities of various vector databases/search engines. The goal of the issue is to evaluate hybrid search performance under the same hardware conditions using a unified framework.
### Describe implementation you've considered
_No response_
### Documentation, adoption, use case
_No response_
### Additional information
_No response_
Contributor guide
Research direction
No files, tests, or entry points are identified in the issue. Start by surveying the repository's vector and full-text search components and any existing benchmarking tools, then define the unified framework's scope, comparable workloads, and hardware conditions before implementation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- databases, performance, search
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100