Base schema used by executors of the same writer should be the same
Open
from-jira
priority:high
type:feature
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
how do we manage the granularity of base schemas during a write
we do writer schema evolving in each executors, there is a chance that different executors use different schema as the base schema to evolve.
We should dig more to see what's the actual behavior and ideally we should unify the write schema at lest in the commit level, all the executors should use one base schema to evolve to the latest write schema.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-8332
- Type: New Feature
- Fix version(s):
- 1.1.0
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.