zilliztech / zilliztech/VectorDBBench
Using a batch configuration file fail
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.2k
- Forks
- 438
- Avg merge
- 1d 4h
- Merged PRs (30d)
- 1
Description
无法使用命令行配置文件的方式批量跑数据,因为yaml中传的是list,而runner将milvushnsw对象当成map,所以有以下报错:
AttributeError: 'list' object has no attribute 'get'
目前的需求是:
- 能不能支持部分字段list,比如测hnsw的时候,会有构图m、efconstrction参数不变,只有ef在变的情况,ef是否能当成list传进去
- 如果不支持的话,能否真正支持批量跑,比如配多组参数,目前应该是不支持批量跑。
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing a batch run from the YAML configuration and read the runner's handling of the configuration object. Clarify whether the intended scope is list-valued fields such as ef, multiple parameter groups, or both. Done means the supported batch configuration runs without the reported AttributeError and its expected parameter combinations are executed.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- cli, performance
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100