Spark SQL MIT global index change partition paths will not work with custom merger
Open
area:sql
from-jira
priority:blocker
type:devtask
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
We use avro record merger so we can use expression payload, and we overwrite the merger impls. There might be some changes to how we do merger impls so I don't want to address this issue yet.
If overwrite or event time is used it is fine because we just use the payload based merging. But if they have a custom merger, then we need to use that when reading the records
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-8241
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-9109
- Fix version(s):
- 1.1.0
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.