apache / apache/hudi

Hive Style partitioning on a bootstrap table is not configurable

Open
#16,500 1 comment 0 reactions 0 assignees View on GitHub
component:bootstrap from-jira priority:medium type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

I modified DecodedBootstrapPartitionPathTranslator to be:
{code:java}
public class DecodedBootstrapPartitionPathTranslator extends BootstrapPartitionPathTranslator {
public DecodedBootstrapPartitionPathTranslator() {
super();
}

@Override
public String getBootstrapTranslatedPath(String bootStrapPartitionPath) {
String pathMaybeWithHive = PartitionPathEncodeUtils.unescapePathName(bootStrapPartitionPath);
if (pathMaybeWithHive.contains("=")) {
return Arrays.stream(pathMaybeWithHive.split("/")).map(split -> {
if (split.contains("=")) {
return split.split("=")[1];
} else {
return split;
}
}).collect(Collectors.joining("/"));
}
return pathMaybeWithHive;
}
} {code}
And setting hive style partitioning to true does not add it back

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-7813
- Type: Bug

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing DecodedBootstrapPartitionPathTranslator and its getBootstrapTranslatedPath method, then inspect how the Hive-style partitioning setting is passed through bootstrap path translation. Reproduce the case where the setting is true and verify that the translated path retains Hive-style partition names; add or update coverage for both enabled and disabled behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
62/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.