Hive Style partitioning on a bootstrap table is not configurable
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
I modified DecodedBootstrapPartitionPathTranslator to be:
{code:java}
public class DecodedBootstrapPartitionPathTranslator extends BootstrapPartitionPathTranslator {
public DecodedBootstrapPartitionPathTranslator() {
super();
}
@Override
public String getBootstrapTranslatedPath(String bootStrapPartitionPath) {
String pathMaybeWithHive = PartitionPathEncodeUtils.unescapePathName(bootStrapPartitionPath);
if (pathMaybeWithHive.contains("=")) {
return Arrays.stream(pathMaybeWithHive.split("/")).map(split -> {
if (split.contains("=")) {
return split.split("=")[1];
} else {
return split;
}
}).collect(Collectors.joining("/"));
}
return pathMaybeWithHive;
}
} {code}
And setting hive style partitioning to true does not add it back
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-7813
- Type: Bug
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing DecodedBootstrapPartitionPathTranslator and its getBootstrapTranslatedPath method, then inspect how the Hive-style partitioning setting is passed through bootstrap path translation. Reproduce the case where the setting is true and verify that the translated path retains Hive-style partition names; add or update coverage for both enabled and disabled behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 62/100