Hudi Partition Key Generator for Decimal and Timestamp Field is buggy
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
!image.png|width=2357,height=1535!
As can be seen, the when performing writes, decimal fields are not correct on the filesystem path, but is correct in the data file.
This will be problematic for Trino as partition values are generated from Path values instead of data file.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-9496
- Type: Task
- Attachment(s):
- 06/Jun/25 03:53;vhs;image.png;https://issues.apache.org/jira/secure/attachment/13076856/image.png
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing Hudi's Partition Key Generator during writes, comparing how decimal and timestamp values are represented in filesystem paths versus data files. Reproduce the issue and check the resulting paths, then verify that Trino can derive the intended partition values from those paths.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 42/100