Migrate DecodeAndEmitDoFn to be a SplittableDoFn
Open
dataflow
improvement
P3
runners
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
This requires the Fn API and Dataflow to support SplittableDoFns.
Imported from Jira [BEAM-2422](https://issues.apache.org/jira/browse/BEAM-2422). Original Jira may contain additional context.
Reported by: lcwik.
Contributor guide
Research direction
Start by reviewing the DecodeAndEmitDoFn entry point and the linked BEAM-2422 Jira issue for the missing context. Then verify the required Fn API and Dataflow support before defining the migration scope. Done means DecodeAndEmitDoFn uses the SplittableDoFn model once those platform prerequisites are available.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, distributed-systems
- Issue type
- Refactor
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100