[Feature Request]: Beam - Support for Debezium I/O
- Dominant language
- Java
- Stars
- 1.5k
- Forks
- 476
- Avg merge
- 18h 32m
- Merged PRs (30d)
- 216
Description
### What would you like to happen?
Migration: https://issues.apache.org/jira/browse/HOP-2597
As a developer, when creating Beam pipelines in Apache Hop, I'd like to use Debezium I/O so that I can take advantage of Debezium's CDC features. Apache Beam 2.29 will include Debezium I/O.
https://beam.apache.org/releases/javadoc/2.30.0/org/apache/beam/io/debezium/DebeziumIO.html
### Issue Priority
Priority: 3
### Issue Component
Component: Beam
Contributor guide
Research direction
Start by reviewing the Apache Beam DebeziumIO documentation linked in the issue and the Apache Jira migration HOP-2597. Then locate the Beam pipeline integration area in Apache Hop and determine the entry point for adding Debezium I/O support; done means developers can use Debezium I/O in Beam pipelines.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, stream-processing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100