apache / apache/beam

Add support for dynamic destinations when writing to Kafka

Open
#19,254 2 comments 0 reactions 0 assignees View on GitHub
improvement io java kafka P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

BEAM-5798 introduced support to write to multiple topics when writing to Kafka.
This is similar in function to what DynamicDestinations do on BigQueryIO, AvroIO and TextIO but with a different API. The goal of this issue is to add the dynamic destinations style API to KafkaIO API e.g. KafkaIO.write().to(new DynamicDestination(...)).

Imported from Jira [BEAM-6385](https://issues.apache.org/jira/browse/BEAM-6385). Original Jira may contain additional context.
Reported by: iemejia.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.