apache / apache/iceberg-cpp

Support data sequence numbers in REST scan tasks

Open
#834 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
C++
Stars
221
Forks
124
Avg merge
1d 16h
Merged PRs (30d)
21

Description

REST-planned `FileScanTask` currently parses `first-row-id` from the embedded `data-file` JSON, but the REST scan-task payload does not expose the manifest-entry data sequence number.

For v3 row lineage readers, `_last_updated_sequence_number` inheritance needs the data file data sequence number. Without it, REST-planned tasks can pass `first_row_id` but cannot inherit `_last_updated_sequence_number` for files that omit or store null row-lineage columns.

Follow-up from apache/iceberg-cpp#822. The PR adds a skipped test, `FileScanTasksFromJsonTest.RowLineageSequence`, that should be enabled once REST scan-task JSON can carry this value.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing REST scan-task JSON parsing and how the manifest-entry data sequence number is represented. Use the skipped FileScanTasksFromJsonTest.RowLineageSequence test as the acceptance check. Done means REST-planned tasks carry the data sequence number and the test is enabled and passes for row-lineage inheritance.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
api, backend
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
68/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.