apache / apache/incubator-xtable
How to infer partition fields from hudi source table and use them datasetConfig.yaml
- Dominant language
- Java
- Stars
- 1.2k
- Forks
- 212
- Avg merge
- 4d 9h
- Merged PRs (30d)
- 16
Description
Hi Team,
We're looking to infer partition fields (if any) associated with a given Hudi source table and incorporate them into the datasetConfig.yaml file (as a `partitionSpec`) before running the XTable utility jar for data format conversion.
Could someone please assist me with this?
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by examining the Hudi source table metadata and the datasetConfig.yaml partitionSpec used by the XTable utility jar. The issue does not name an implementation file or test; done would mean documenting or establishing how partition fields are inferred and represented before conversion.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100