lance-format / lance-format/lance
Make it possible for Rewrite to rebase on top of an Update / Delete
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
Currently an update / delete operation that modifies fragments being rewritten will result in a retryable conflict. Rewrites are very expensive and it would be good to rebase this if at all possible. I believe, if there is a frag_reuse_index, or if we are using stable row ids, it should be possible for the two operations to be rebased.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No file, test, or entry point is named in the issue. Begin by tracing how Rewrite conflicts with Update and Delete, then determine how frag_reuse_index and stable row ids affect rebasing; done means eligible operations rebase instead of producing a retryable conflict.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- database, distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100