Add schema upgrade test w/ metadata payload
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Let's add a unit test to test schema upgrade w/ metadata payload.
* start using payloadV1. few writes.
* upgrade payload to V2. read older and also trigger few more writes.
* upgrade payload to V3, read older and also trigger few more writes.
We plan to disable schema validation for any metadata table. so we might need this test to be added to our CI.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-5566
- Type: Improvement
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the metadata-table schema validation tests and the CI configuration. Add coverage for writes and reads across payloadV1 to V2 to V3, including older payloads after each upgrade, and verify the test passes in CI.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100