Fix unsupported data types for SPARK record type w/ col stats
Open
area:metadata-table
from-jira
priority:blocker
type:devtask
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
When we tried enabling col stats by default, we realized that BYTES and FIXED data type is not supported in SPARK record type.
Ref patch:
[https://github.com/apache/hudi/pull/12331]
Ref test:
TestMORDataSource.testPrunedFiltered
lets fix the user-exp by adding these as unsupported types upfront. rather than throwing random errors.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-8585
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-9100
- Fix version(s):
- 1.1.0
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.