Use completion time based ordering of log files in file group
Open
from-jira
priority:high
status:pr-available
type:bug
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Currently completion time is not taken into account while ordering log files in file group. This can lead to log files being unordered. The Jira aims to add a fix for the same in table version 8.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-9423
- Type: Bug
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the file-group log-file ordering implementation and the tests covering table version 8. Inspect a case where log-file completion times differ, then verify that ordering follows completion time and that the relevant regression test passes.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 55/100