apache / apache/incubator-xtable

How to infer partition fields from hudi source table and use them datasetConfig.yaml

Open
#411 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
1.2k
Forks
212
Avg merge
4d 9h
Merged PRs (30d)
16

Description

Hi Team,

We're looking to infer partition fields (if any) associated with a given Hudi source table and incorporate them into the datasetConfig.yaml file (as a `partitionSpec`) before running the XTable utility jar for data format conversion.

Could someone please assist me with this?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by examining the Hudi source table metadata and the datasetConfig.yaml partitionSpec used by the XTable utility jar. The issue does not name an implementation file or test; done would mean documenting or establishing how partition fields are inferred and represented before conversion.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.