Create common SchemaProvider and RecordPayloads for spark, flink etc.
Open
area:writer
engine:kafka-connect
from-jira
priority:blocker
type:improvement
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Create common SchemaProvider and RecordPayloads for spark, flink etc.
- Currently the class org.apache.hudi.utilities.schema.SchemaProvider takes in input JavaSparkContext, and is specific to Spark Engine. So we have created a separate SchemaProvider for flink. Now for Kafka connect, we can use neither, since its neither spark nor flink. Implement a common class that uses HoodieEngineContext ..
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-2375
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-538
- Fix version(s):
- 1.1.0
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.