apache / apache/beam

Enable Pubsub as source/sink on Nexmark

Open
#18,400 0 comments 0 reactions 0 assignees View on GitHub
dataflow improvement nexmark P3 tests
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

During the migration to Beam 2.x we removed this functionality for API compatibility reasons, this should be re-enabled.

Imported from Jira [BEAM-2851](https://issues.apache.org/jira/browse/BEAM-2851). Original Jira may contain additional context.
Reported by: iemejia.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the Nexmark implementation and the linked BEAM-2851 Jira issue for the Pubsub source and sink behavior removed during the Beam 2.x migration. Compare the current Nexmark configuration with the historical context. Done means Pubsub can again be enabled as both a source and sink on Nexmark, with the relevant validation passing.

Written by the indexing model from the issue text.

Assessment

Tech stack
google-cloud, java
Domain
stream-processing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.