lance-format / lance-format/lance
Investigate better handling of streaming writes / lists in AIMD throttle
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
The AIMD throttled store currently does not throttle put_multipart and it should
The AIMD throttled store only throttles list operations (and delete_stream) once, at the beginning, because there is no easy way to determine when the object_store is fetching a new page of data.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the AIMD throttled store and tracing its put_multipart, list, and delete_stream entry points, then inspect how object_store fetches paginated data. Check existing throttling tests, if present, and confirm that multipart writes and streamed list pages are throttled consistently without regressing the operations already covered.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- backend, performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100