apache / apache/beam

Implement Flink "uber jar" job server in Go SDK.

Open
#21,234 1 comment 0 reactions 0 assignees View on GitHub
flink go new feature P2 runners
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

The Flink 'uber jar' job server in Python has proved a useful way to cut out a deployment step and circumvent artifact staging. It'd be useful to have this in Go as well. https://github.com/apache/beam/blob/master/sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py

Imported from Jira [BEAM-12956](https://issues.apache.org/jira/browse/BEAM-12956). Original Jira may contain additional context.
Reported by: ibzib.

Contributor guide

Open the contributing guide

Research direction

Start with the referenced Python implementation at sdks/python/apache_beam/runners/portability/flink_uber_jar_job_server.py and review the linked Jira issue for additional context. Then locate the corresponding Go SDK job-server entry points; the work is done when the Flink uber jar job server is available in Go without the deployment or artifact-staging step.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, python
Domain
distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.