lance-format / lance-format/lance

Rebase successfully if two deletes affect the same rows

Open
#6,149 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Rust
Stars
7.1k
Forks
852
Avg merge
3d 18h
Merged PRs (30d)
272

Description

Currently if two concurrent delete operations delete the same row then the rebase will fail and it will degrade into a retryable conflict. However, it seems like there is no need for this. We can still use the merged deletion vectors.

I personally have no priority on this, I am working on updating the conflict docs and just observed this potential optimization.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files or tests are named. Start by locating the rebase path that handles concurrent deletes and inspect how merged deletion vectors are used. Confirm completion when two deletes targeting the same rows rebase successfully without becoming a retryable conflict, with regression coverage.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
databases, distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.