ParDo should only accept DoFns
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
for version 3.0
Remove support for accepting user fns directly as ParDo input.
Remove this function: https://github.com/apache/beam/blob/911bfbdef62a7bb750426da9cc59537c4ffd9e1f/sdks/python/apache_beam/transforms/core.py#L639
Before version 3.0 the above function could be deprecated.
Imported from Jira [BEAM-2427](https://issues.apache.org/jira/browse/BEAM-2427). Original Jira may contain additional context.
Reported by: altay.
Contributor guide
Research direction
Start in sdks/python/apache_beam/transforms/core.py at the function linked in the issue and trace where ParDo accepts user functions directly. Remove that compatibility path so ParDo accepts only DoFns, then run the relevant Python transform tests to verify the supported behavior remains intact.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Refactor
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Clearly specified
- Newbie friendliness
- 52/100