[Bug] The UnawareAppendTableCompactionCoordinator may leave some small files can not be compacted
- Dominant language
- Java
- Stars
- 3.4k
- Forks
- 1.4k
- Avg merge
- 1d 11h
- Merged PRs (30d)
- 396
Description
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.
### Paimon version
1.0
### Compute Engine
all
### Minimal reproduce step
.
### What doesn't meet your expectations?
when compact in batch, there is no `age` maintained, we should compact the remaining files
### Anything else?
_No response_
### Are you willing to submit a PR?
- [ ] I'm willing to submit a PR!
Contributor guide
No contributing guide indexed for this repository
Research direction
Locate UnawareAppendTableCompactionCoordinator and read its batch-compaction logic, focusing on how file age is maintained and how remaining small files are selected. Reproduce the reported case if possible, then verify that small files left after batch compaction are eventually eligible for compaction.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100