Fix schema evolution gaps for FG reader
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
We tested schema evolution support from FG reader through three tests:
CASE1: Two base files have different schemas.
CASE2: One base files with multiple log files, and log files have different schemas.
CASE3: One base file and one log file have different schemas.
Using the above tests, we found that there are some failures for:
# Adding nested column for Hive: CASE1, CASE2
# Adding nested column for Java: CASE2
# Type upgrade from int to long Hive: CASE2
# All test cases failed for Flink: probably due to some bugs in the test.
The PR for running tests: [https://github.com/apache/hudi/pull/13443]
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-9561
- Type: Improvement
- Fix version(s):
- 1.1.0
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.