Calculate "mandatory partition fields to read from the file" inside of the filegroup reader so we can have cross engine support
Open
area:reader
from-jira
priority:high
type:improvement
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
[https://github.com/apache/hudi/pull/11770] [Hudi-5807] adds support to spark fg reader to read the actual values from timestamp keygen columns. We can probably pull that logic into the fg reader. For hive the logic will be different though. Because partition path has to be constant so we create an artificial field iirc. And also we might need to pass in the partition value into the fg reader for appending
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-8166
- Type: Improvement
- Fix version(s):
- 1.1.0
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.