[Feature] Use Parquet Merge in compaction for AppendOnlyTable
- Dominant language
- Java
- Stars
- 3.4k
- Forks
- 1.4k
- Avg merge
- 1d 11h
- Merged PRs (30d)
- 396
Description
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
### Motivation
See more in: https://issues.apache.org/jira/browse/PARQUET-382
This could save lots of resource usage for append only table's compaction.
### Solution
_No response_
### Anything else?
_No response_
### Are you willing to submit a PR?
- [x] I'm willing to submit a PR!
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reading the AppendOnlyTable compaction implementation and the linked PARQUET-382 discussion to understand the proposed Parquet Merge behavior. Done means compaction for append-only tables uses Parquet Merge and demonstrates reduced resource usage, but the issue does not name files or tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100