Properly support `convert_dtype=True` in Series.apply
Open
core
dataframe
dsl
improvement
P3
python
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
See https://pandas.pydata.org/pandas-docs/stable/reference/api/pandas.Series.apply.html
convert_dtype=True indicates that pandas should observe the output and set the dtype to something other than object if possible. We should intercept this argument and use type inference to set the dtype. We can't rely on pandas' inference since our implementation can't observe the entire dataset.
Imported from Jira [BEAM-11627](https://issues.apache.org/jira/browse/BEAM-11627). Original Jira may contain additional context.
Reported by: bhulette.
Contributor guide
Assessment
This issue has not been assessed yet.