Data validation and `upload_collection` method
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.4k
- Forks
- 304
- Avg merge
- 2d 9h
- Merged PRs (30d)
- 37
Description
I think the upload_collection method should validate data before uploading it.
For example, it will silently upload 1 million records where vector_size=256 to a collection where vector_size=512.
As a result, you get no errors and no data will be added to a collection.
Comparing the vector size of a collection to the input array size is very cheap.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the Python implementation of upload_collection and any existing tests for collection uploads. Reproduce the vector_size mismatch described in the issue, then verify that validation prevents incompatible data from being silently accepted and that the existing upload behavior remains covered.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- databases
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 58/100