Infer coders in SDK prior to handing off pipeline to Runner
Open
core
improvement
P3
python
types
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 2d 5h
- Merged PRs (30d)
- 204
Description
Currently all runners have to duplicate this work, and there's also a hack storing the element type rather than the coder in the Runner protos.
Imported from Jira [BEAM-2717](https://issues.apache.org/jira/browse/BEAM-2717). Original Jira may contain additional context.
Reported by: robertwb.
Contributor guide
Research direction
Read the SDK-to-Runner pipeline handoff and Runner protos first, then consult BEAM-2717 for additional context. Done means coders are inferred before handoff, runners no longer duplicate this work, and the proto no longer relies on storing element types instead of coders.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, distributed-systems
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100