apache / apache/hop

[Feature Request]: Beam - Support for Debezium I/O

Open
#2,409 0 comments 0 reactions 0 assignees View on GitHub
awaiting triage Beam P3
Dominant language
Java
Stars
1.5k
Forks
476
Avg merge
18h 32m
Merged PRs (30d)
216

Description

### What would you like to happen?

Migration: https://issues.apache.org/jira/browse/HOP-2597

As a developer, when creating Beam pipelines in Apache Hop, I'd like to use Debezium I/O so that I can take advantage of Debezium's CDC features. Apache Beam 2.29 will include Debezium I/O.

https://beam.apache.org/releases/javadoc/2.30.0/org/apache/beam/io/debezium/DebeziumIO.html

### Issue Priority

Priority: 3

### Issue Component

Component: Beam

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the Apache Beam DebeziumIO documentation linked in the issue and the Apache Jira migration HOP-2597. Then locate the Beam pipeline integration area in Apache Hop and determine the entry point for adding Debezium I/O support; done means developers can use Debezium I/O in Beam pipelines.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, stream-processing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.