apache / apache/incubator-xtable

Fetch snapshot specific partition spec

Open
#126 0 comments 0 reactions 0 assignees View on GitHub
Iceberg source
Dominant language
Java
Stars
1.2k
Forks
212
Avg merge
4d 9h
Merged PRs (30d)
16

Description

The spec id expected in `getTable` is expected to be spec as_of snapshot. Currently the one used is spec of an iceberg table, `iceTable.spec()` should return current spec id. This spec may not be valid for the given snapshot.

_Originally posted by @ashvina in https://github.com/onetable-io/onetable/pull/111#discussion_r1373780190_

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing getTable and how it obtains the partition spec from iceTable.spec(). Compare that current table spec with the spec associated with the requested snapshot; done means getTable uses the snapshot-specific spec and remains valid for that snapshot.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.