Implement transform for Series and DataFrame
Open
core
dataframe
dsl
improvement
P3
python
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
We can't run transform with an empty DataFrame after pandas 1.2.0 (and this is likely incorrect anyway), so we can't generate the proxy trivially. Instead we should infer the function's return type.
Imported from Jira [BEAM-11636](https://issues.apache.org/jira/browse/BEAM-11636). Original Jira may contain additional context.
Reported by: bhulette.
Contributor guide
Research direction
The issue does not name any files, tests, or entry points. Start by reviewing the Apache Beam implementation of transform for Series and DataFrame and the linked Jira issue for context; done means transform works with the reported empty-DataFrame case by inferring the function's return type.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- pandas, python
- Domain
- data
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100