zilliztech/VectorDBBench

View on GitHub

Benchmark for vector databases.

Stars: 1.2k
Forks: 438
Open beginner issues: 0
Indexed issues: 131
Avg merge: 1d 4h
Merged PRs (30d): 1

Dominant language: Python
License: MIT
Last GitHub push: Sep 11, 2026
Latest indexed: Sep 20, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

131 open issues indexed

Cohere Dataset Size documentation inconsistent and off by a factor of 10 in Places Open

Difficulty 2/5 1-3 hours Newbie friendliness 74/100

zilliztech/VectorDBBench#878 · Opened Sep 17, 2026
Tracking: ongoing refactors — case-config finalization and hardening Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

zilliztech/VectorDBBench#877 · 1 comment · Opened Sep 16, 2026
[Feature Request] Allow an optional search level in milvusautoindex Open

Difficulty 2/5 1-3 hours Newbie friendliness 76/100

zilliztech/VectorDBBench#875 · Opened Sep 16, 2026
[Feature Request] Support configurable NQ for concurrent vector search Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

zilliztech/VectorDBBench#873 · Opened Sep 15, 2026
Support Qdrant FineWeb-10B, PubMed-MV, and Coyo-VE datasets Open

enhancement

zilliztech/VectorDBBench#869 · 1 assignee · Opened Sep 10, 2026
Add support for SurrealDB Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

zilliztech/VectorDBBench#854 · Opened Aug 17, 2026
Result publication permits unresolvable provenance for composed metrics Open

bug

Difficulty 5/5 Over a week Newbie friendliness 30/100

zilliztech/VectorDBBench#837 · Opened Aug 6, 2026
After a successful pgvector run: "PgVectorConfig Value error, Empty field(s): password" Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

zilliztech/VectorDBBench#831 · Opened Aug 2, 2026
[Feature Request] Add a substring / grep (`LIKE '%...%'`) benchmark case, backed by the Pizza&Chili corpus Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

zilliztech/VectorDBBench#827 · 2 comments · Opened Jul 30, 2026
[Feature Request] Add a Large-TopK benchmark case: LAION-100M with top-1M ground truth Open

zilliztech/VectorDBBench#826 · 7 comments · 1 assignee · Opened Jul 29, 2026
[Question/Enhancement] Unconditional force-merge compaction in Milvus client `_optimize()` may be too costly and non-reproducible at 100M scale (LAION-100M) Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

zilliztech/VectorDBBench#825 · 8 comments · Opened Jul 29, 2026
ci: separate hermetic unit tests from online E2E tests Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

zilliztech/VectorDBBench#819 · 1 comment · Opened Jul 17, 2026
About initial data on elasticsearch validate performance without vector columns Open

Difficulty 3/5 1-2 days Newbie friendliness 52/100

zilliztech/VectorDBBench#798 · 1 comment · Opened Jun 15, 2026
[BUG]: QdrantLocal Error Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

zilliztech/VectorDBBench#796 · Opened Jun 8, 2026
Add support for YDB as a benchmark target database Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

zilliztech/VectorDBBench#792 · Opened May 31, 2026
Broken link in Readme Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

zilliztech/VectorDBBench#788 · 1 comment · Opened May 29, 2026
Milvus optimize can start search before post-compaction query view is stable Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 38/100

zilliztech/VectorDBBench#784 · 1 comment · Opened May 20, 2026
uv sync --all-extras fails Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

zilliztech/VectorDBBench#780 · 1 comment · Opened May 15, 2026
[BUG REPORT]:Skip File Validation When Offline with Existing Datasets Open

zilliztech/VectorDBBench#771 · 1 comment · 1 assignee · Opened May 1, 2026
Termial output: "access method 'HNSW' does not exist" Error Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

zilliztech/VectorDBBench#759 · 4 comments · Opened Apr 16, 2026
Add support Citus for PostgreSQL vector extensions Open

Difficulty 5/5 Over a week Newbie friendliness 38/100

zilliztech/VectorDBBench#752 · 3 comments · Opened Apr 9, 2026
Streaming results in qdrant and redis Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

zilliztech/VectorDBBench#740 · Opened Mar 30, 2026
Add avg serial latency output Open

Difficulty 2/5 1-3 hours Newbie friendliness 48/100

zilliztech/VectorDBBench#735 · 1 comment · Opened Mar 6, 2026
Metric Addition Request: Adding Average Latency to the Reported Latency Metrics with p95 and p99 Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

zilliztech/VectorDBBench#732 · 2 comments · Opened Mar 3, 2026
Where is the parameter sweep Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

zilliztech/VectorDBBench#719 · 2 comments · Opened Feb 6, 2026
LanceDB support Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

zilliztech/VectorDBBench#712 · 1 comment · Opened Feb 2, 2026
vectordbbench run fail with Error: cannot pickle 'generator' object Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

zilliztech/VectorDBBench#706 · 2 comments · Opened Jan 28, 2026
How to reproduce filter perfermance ? Open

Difficulty 2/5 1-3 hours Newbie friendliness 25/100

zilliztech/VectorDBBench#701 · 2 comments · Opened Jan 19, 2026
Query regarding filter performance graph in VDBBench Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

zilliztech/VectorDBBench#696 · 2 comments · Opened Jan 12, 2026
When using VectorDBBench to test seekdb, filling in the test information caused an error. Open

zilliztech/VectorDBBench#689 · 5 comments · 1 assignee · Opened Dec 31, 2025
Get an error :list index out of range, when running Milvus performance test using deep1b dataset. Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

zilliztech/VectorDBBench#688 · Opened Dec 26, 2025
Add Filtering Performance based on `match_phrase` with knn search for RAG Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

zilliztech/VectorDBBench#687 · 1 comment · Opened Dec 26, 2025
Incorrect parameter description for `rbq_bits_query` in MilvusIVFRABITQTypedDict Open

Difficulty 1/5 Under an hour Newbie friendliness 65/100

zilliztech/VectorDBBench#683 · Opened Dec 24, 2025
[Enhancement]: Support SCANN index for Milvus Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

zilliztech/VectorDBBench#681 · Opened Dec 23, 2025
Hard-coded links in the code cause the server.baseUrlPath to fail in reverse proxy environments‌ Open

Difficulty 2/5 1-3 hours Newbie friendliness 62/100

zilliztech/VectorDBBench#679 · Opened Dec 23, 2025
Chroma support regressed, possibly due to dependency incompatibility Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

zilliztech/VectorDBBench#675 · 1 comment · Opened Dec 22, 2025
Is it possible to specify testing of the pgvector ivfflat index through configuration? Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

zilliztech/VectorDBBench#672 · Opened Dec 10, 2025
How can I make a test that could merge multiple results of different command line into one result file Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

zilliztech/VectorDBBench#666 · 3 comments · 1 reaction · Opened Dec 4, 2025
Can VectorDBBench be configured to set the number of concurrent operations for inserting data into Elasticsearch? Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

zilliztech/VectorDBBench#639 · 4 comments · Opened Nov 12, 2025
is cohere 1m dataset changed from last december Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

zilliztech/VectorDBBench#637 · 1 comment · Opened Nov 11, 2025
vectordbbench should detect the index mis-match Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

zilliztech/VectorDBBench#634 · 1 comment · Opened Nov 8, 2025
"--refine-type" and "--refine-k" should be required only when "--refine" is set to True Open

zilliztech/VectorDBBench#633 · 1 comment · 1 assignee · Opened Nov 8, 2025
Is there any naming rules for external dataset file names ? Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

zilliztech/VectorDBBench#629 · 1 comment · Opened Nov 6, 2025
Package dependency missing Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

zilliztech/VectorDBBench#628 · 2 comments · Opened Nov 6, 2025
Cannot run vectordb-bench in offline env Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

zilliztech/VectorDBBench#620 · 6 comments · Opened Oct 24, 2025
Title: Milvus GPU (CAGRA) benchmark stuck at “Milvus optimizing before search” Description Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

zilliztech/VectorDBBench#615 · 1 comment · Opened Oct 17, 2025
Support bm25 SPARSE_INVERTED_INDEX and hybird search benchmark? Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

zilliztech/VectorDBBench#612 · 4 comments · Opened Oct 2, 2025
opensearch-py client broken in latest release Open

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

zilliztech/VectorDBBench#611 · Opened Oct 1, 2025
How should the yml configuration file for testing Elasticsearch with VectorDBBench be written? Could you provide a simple example? Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

zilliztech/VectorDBBench#602 · 1 comment · Opened Sep 15, 2025
What should be noted when using VectorDBBench to test Milvus in a local area network (LAN) environment? Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

zilliztech/VectorDBBench#599 · 1 comment · Opened Sep 12, 2025

zilliztech/VectorDBBench

Get new issues in your inbox