infiniflow / infiniflow/infinity

[Feature Request]: Benchmark framework

Open
#951 0 comments 0 reactions 0 assignees View on GitHub
feature request
Dominant language
C++
Stars
4.7k
Forks
445
Avg merge
2d 2h
Merged PRs (30d)
7

Description

### Is there an existing issue for the same feature request?

- [X] I have checked the existing issues.

### Is your feature request related to a problem?

_No response_

### Describe the feature you'd like

Currently, there is a lack of benchmarks for comparing the vector and full-text search capabilities of various vector databases/search engines. The goal of the issue is to evaluate hybrid search performance under the same hardware conditions using a unified framework.

### Describe implementation you've considered

_No response_

### Documentation, adoption, use case

_No response_

### Additional information

_No response_

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are identified in the issue. Start by surveying the repository's vector and full-text search components and any existing benchmarking tools, then define the unified framework's scope, comparable workloads, and hardware conditions before implementation.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
databases, performance, search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.