apache / apache/beam

PubsubIO - DynamicDestinations

Open
#18,623 0 comments 0 reactions 0 assignees View on GitHub
gcp io java new feature P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

PubsubIO does not support the "DynamicDestinations" notion that is currently implemented for File-based I/O and BigQueryIO.

It would be nice if PubsubIO could also support this functionality - the ability to write to a Pub/Sub topic dynamically.

Imported from Jira [BEAM-3503](https://issues.apache.org/jira/browse/BEAM-3503). Original Jira may contain additional context.
Reported by: Nalseez.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the existing DynamicDestinations implementations for file-based I/O and BigQueryIO, then inspect PubsubIO's write path. The original Jira issue may contain additional context; done means PubsubIO supports selecting the Pub/Sub topic dynamically.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.