apache / apache/hudi

Hudi Partition Key Generator for Decimal and Timestamp Field is buggy

Open
#17,041 1 comment 0 reactions 0 assignees View on GitHub
from-jira priority:high type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

!image.png|width=2357,height=1535!

As can be seen, the when performing writes, decimal fields are not correct on the filesystem path, but is correct in the data file.

 

This will be problematic for Trino as partition values are generated from Path values instead of data file.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-9496
- Type: Task
- Attachment(s):
- 06/Jun/25 03:53;vhs;image.png;https://issues.apache.org/jira/secure/attachment/13076856/image.png

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing Hudi's Partition Key Generator during writes, comparing how decimal and timestamp values are represented in filesystem paths versus data files. Reproduce the issue and check the resulting paths, then verify that Trino can derive the intended partition values from those paths.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.