zilliztech / zilliztech/VectorDBBench
Is there any naming rules for external dataset file names ?
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.2k
- Forks
- 438
- Avg merge
- 1d 4h
- Merged PRs (30d)
- 1
Description
- download "bioasq_medium_1m" and "bioasq_large_10m" dataset from "s3://assets.zilliz.com/benchmark"
- save above dataset to local dir, and treat them as customized dataset
- do test with following command
- vectordb-bench try to get the file with name "train.parquet" but failed
- if I add a symbol link "train.parquet", and let it link to "shuffle_train.parquet", the test can run smoothly
- but for "bioasq_large_10m", the train data file name is like "shuffle_train-00-of-10.parquet", vectordb-bench still want to get the file with name "train.parquet" and fail
Is there any naming rules for external dataset file names ?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No file, test, or entry point is named in the report. Reproduce the custom-dataset run with the supplied dataset names, trace where vectordb-bench looks specifically for train.parquet, and define done as handling or documenting the naming rule for both single-file and sharded parquet datasets.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100