apache / apache/beam

Check immutability violations in DirectPipelineRunner

Open
#18,013 0 comments 0 reactions 0 assignees View on GitHub
core good first issue new feature P3 python
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 2h
Merged PRs (30d)
205

Description

Users are going to mutate inputs and outputs of DoFn inappropriately. We should help their tests fail to catch such mistakes. (Similar to the DirectPipelineRunner in Java SDK)

Imported from Jira [BEAM-529](https://issues.apache.org/jira/browse/BEAM-529). Original Jira may contain additional context.
Reported by: altay.
This issue has child subcomponents which were not migrated over. See the original Jira for more information.

Contributor guide

Open the contributing guide

Research direction

Start with the DirectPipelineRunner implementation and the original BEAM-529 Jira issue, which may contain the missing child subcomponents and additional context. Compare the relevant behavior with the Java SDK's DirectPipelineRunner; done means tests fail when DoFn inputs or outputs are mutated inappropriately.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, python
Domain
testing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.