Add JSON file reader support for Delta Streamer
Open
area:ingest
from-jira
priority:high
type:improvement
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Delta Streamer doesn't supports the normal json file reader, the current implementation of
JsonDFSSource is mostly created to read the single json record from file.
Leverage spark Json reader by overriding org.apache.hudi.utilities.sources.RowSource similar to CSVDFSSource.
Github Issue - [https://github.com/apache/hudi/issues/8409]
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-6059
- Type: Improvement
- Fix version(s):
- 0.16.0
- 1.1.0
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.