apache / apache/hudi

Test out of the box schema evolution w/ hive sync

Open
#15,960 0 comments 0 reactions 0 assignees View on GitHub
component:catalog-sync from-jira priority:high type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

We need to add more tests and establish out of the box schema evolution w/ meta sync (for eg, hive sync). 

 
* What works, what does not work.
* For eg, can we add a new column in the middle of the schema? 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-6224
- Type: Improvement

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the existing schema-evolution tests and meta-sync or Hive-sync integration tests in the repository. Exercise the cases described in the issue, including adding a column in the middle of a schema, and document which scenarios work out of the box and which do not.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.