apache / apache/paimon

[Feature] Chained tables should allow set fallback rules for non-existent partitions.

Open
#7,682 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Java
Stars
3.4k
Forks
1.4k
Avg merge
1d 11h
Merged PRs (30d)
396

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.

### Motivation

when using chain tables:
my partitions :
branch_snapshot: 20260101
branch_delta: 20260102、20260104

so i using: `select count(1) from table where dt=20260103` is 0
but in a scenario, It should return the most recent partition from the beginning of the timeline,
like above, should return data in 20260102
not 0.

### Solution

add a configuration, allow user to decide whether to fallback to the most recent partition from the beginning of the timeline

### Anything else?

_No response_

### Are you willing to submit a PR?

- [ ] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start from the chained-table handling for a query such as `select count(1) from table where dt=20260103`, and trace how non-existent partitions are resolved. Review the configuration path for chained tables, then verify that an enabled fallback returns the most recent earlier partition while the existing behavior remains available.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.