Provide Beam turnkey binary distributions embedding runners and execution runtime
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
Now, the only distribution Beam provides is the source distribution.
For new users, it could be interesting to have ready-to-use binary distribution embedding the SDK, a specific runner with the backend execution runtime.
For instance, we could provide:
- beam-spark-xxx.tar.gz containing SDK, Spark runner, Spark
- beam-flink-xxx.tar.gz containing SDK, Flink runner, Flink
Thoughts ?
Imported from Jira [BEAM-320](https://issues.apache.org/jira/browse/BEAM-320). Original Jira may contain additional context.
Reported by: jbonofre.
Contributor guide
Research direction
The issue names no files, tests, or entry points; begin by clarifying the supported SDK, runner, and execution-runtime combinations for the proposed Spark and Flink archives. Done would require an agreed distribution design and scope, but the issue does not define acceptance criteria.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spark
- Domain
- build-system, data-engineering, distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100