zilliztech / zilliztech/VectorDBBench

task run failed when i excut the testing

Open
#336 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
1.2k
Forks
438
Avg merge
1d 4h
Merged PRs (30d)
1

Description

error: code=0, message=metric type not found or not supported, supported: [L2 IP]

WARNING: pre run case error: <MilvusException: (code=0, message=metric type not found or not supported, supported: [L2 IP])> (task_runner.py:92) (546)
2024-06-19 07:49:05,797 | WARNING: [1/1] case {'label': <CaseLabel.Performance: 2>, 'dataset': {'data': {'name': 'Cohere', 'size': 1000000, 'dim': 768, 'metric_type': <MetricType.COSINE: 'COSINE'>}}, 'db': 'Milvus'} failed to run, reason=<MilvusException: (code=0, message=metric type not found or not supported, supported: [L2 IP])> (interface.py:187) (546)
Traceback (most recent call last):
File "/opt/code/vectordb_bench/interface.py", line 168, in _async_task_v2
case_res.metrics = runner.run(drop_old)
^^^^^^^^^^^^^^^^^^^^
File "/opt/code/vectordb_bench/backend/task_runner.py", line 96, in run
self._pre_run(drop_old)
File "/opt/code/vectordb_bench/backend/task_runner.py", line 93, in _pre_run
raise e from None
File "/opt/code/vectordb_bench/backend/task_runner.py", line 86, in _pre_run
self.init_db(drop_old)
File "/opt/code/vectordb_bench/backend/task_runner.py", line 77, in init_db
self.db = db_cls(
^^^^^^^
File "/opt/code/vectordb_bench/backend/clients/milvus/milvus.py", line 64, in init
col.create_index(
File "/usr/local/lib/python3.11/site-packages/pymilvus/orm/collection.py", line 1371, in create_index
return conn.create_index(self._name, field_name, index_params, timeout=timeout, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/pymilvus/decorators.py", line 147, in handler
raise e from e
File "/usr/local/lib/python3.11/site-packages/pymilvus/decorators.py", line 143, in handler
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/pymilvus/decorators.py", line 182, in handler
return func(self, *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/pymilvus/decorators.py", line 122, in handler
raise e from e
File "/usr/local/lib/python3.11/site-packages/pymilvus/decorators.py", line 87, in handler
return func(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/site-packages/pymilvus/client/grpc_handler.py", line 987, in create_index
check_status(status)
File "/usr/local/lib/python3.11/site-packages/pymilvus/client/utils.py", line 63, in check_status
raise MilvusException(status.code, status.reason, status.error_code)

step:
git clone https://github.com/zilliztech/VectorDBBench.git
cd VectorDBBench
pip install -e ".[test]"
init_bench

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the failure using the listed clone, installation, and init_bench steps. Read backend/task_runner.py around _pre_run and init_db, then inspect backend/clients/milvus/milvus.py around collection index creation and the COSINE dataset configuration. Done means the Cohere Milvus case initializes and runs without the metric-type error.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
database
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.