apache / apache/incubator-xtable

Handle snapshot case in deletion vector conversion

Open
#640 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
1.2k
Forks
212
Avg merge
4d 9h
Merged PRs (30d)
16

Description

It is also important to cover the snapshot case since that is how the first sync happens for a table. If the first sync does not carry through the deletion vectors, that could lead to some correctness issues.

_Originally posted by @the-other-tim-brown in https://github.com/apache/incubator-xtable/pull/634#discussion_r1938084202_

Contributor guide

No contributing guide indexed for this repository

Research direction

No file or test is named. Start by locating the deletion vector conversion entry point and the snapshot path used for a table's first sync; trace whether deletion vectors are preserved there. Done means the snapshot conversion carries deletion vectors correctly, with coverage for that case.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.