Integrate RLI with kafka connect writes
Open
area:metadata-table
engine:kafka-connect
from-jira
priority:high
type:improvement
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
We might want to get kafka connect work for RLI index as well. we might need to test it end to end, support bootstrap flows as well.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-6608
- Type: Improvement
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by tracing the RLI index and Kafka Connect write paths, then identify how bootstrap flows are handled. The issue calls for end-to-end testing, but names no files or test entry points; done would require Kafka Connect writes and bootstrap flows to work with the RLI index and pass end-to-end validation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, kafka
- Domain
- data-engineering, stream-processing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100