apache / apache/hudi

Follow up tests for Upgrade/Downgrade Fixtures

Open
#17,138 1 comment 0 reactions 0 assignees View on GitHub
from-jira priority:high type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Recently we have landed the following test fixtures PR: [https://github.com/apache/hudi/pull/13669]

We would like to add the following tests to this test class in the future.

* Add a test on a table with default/null partition for default partition change (see FourToFiveUpgradeHandler).

Add a test for verifying the auxiliary folder. (See FixToSixUpgradeHandler) 

Add a test for going from ( 6 -> 9 ) however autoUpgrade is true but write.table.version is 8 meaning the uprgade should stop at 8. As well as write.table.version is 6 and then it should not even autoUpgrade.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-9688
- Type: Improvement

Contributor guide

No contributing guide indexed for this repository

Research direction

Start in the existing upgrade/downgrade fixture test class from PR 13669, then read FourToFiveUpgradeHandler and FixToSixUpgradeHandler for the relevant behaviors. Run that test class and add coverage for default/null partitions, the auxiliary folder, and the 6-to-9 upgrade stopping at the configured write.table.version; done means all listed cases pass.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, testing-qa
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
62/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.