apache / apache/beam

Flatten Spark runner libraries.

Open
#18,137 0 comments 0 reactions 0 assignees View on GitHub
improvement P3 runners spark
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Flatten Spark runner libraries into a single package (or two) so that everything is private.
See [~kenn] comment: https://github.com/apache/beam/pull/2050#discussion_r103136216

Imported from Jira [BEAM-1563](https://issues.apache.org/jira/browse/BEAM-1563). Original Jira may contain additional context.
Reported by: amitsela.

Contributor guide

Open the contributing guide

Research direction

Start by inspecting the Apache Beam Spark runner library layout and the discussion linked from the issue, including pull request 2050. Determine whether the libraries can be consolidated into one or two packages. Done means the Spark runner libraries are flattened and all implementation details are private.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
distributed-systems
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.