[SUPPORT] Should we limit clustering on Append mode of COW table
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
https://github.com/apache/hudi/blob/6a0ba2d4e466408d85aa0b22dc32e9581acdb3e3/hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableSink.java#L92-L103
I would like to upsert small files first and merge to big file after to increasing both write and read performance.
But Hudi only allow clustering on insert operation of COW table now....
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the linked hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/table/HoodieTableSink.java lines 92-103 and trace how clustering is currently limited for COW tables. Identify the relevant write-path tests, then define completion as verified support or an explicit decision for clustering after append/upsert operations.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100