Make full scan optional for metadata partitions other than FILES
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Currently, just one config controls whether to do full scan or point lookup while reading log records in metadata table and that config applies to ALL metadata partitions. However, full scan is disabled for column_stats and bloom_filters partitions: HoodieBackedTableMetadata#isFullScanAllowedForPartition
We should make it configurable for other partitions too.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-3809
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-1822
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with HoodieBackedTableMetadata#isFullScanAllowedForPartition and trace the existing configuration that controls full scans versus point lookups for metadata partitions. Identify how that setting is applied to FILES, column_stats, and bloom_filters, then verify that other partitions can be configured independently while preserving the existing behavior. Confirm the change with the relevant metadata-table tests, if present.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- databases
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100