googleapis / googleapis/google-cloud-python
Expose `dtype_backend` argument to align with other I/O methods
- Dominant language
- Python
- Stars
- 5.4k
- Forks
- 1.8k
- Avg merge
- 3d 4h
- Merged PRs (30d)
- 122
Description
`dtypes_backend` options:
* `"default"` (current "mixed" behavior, where most extension dtypes are used but not Float64Dtype or StringDtype) -- edit: might want to check `dtype_backend` in pandas global options (per https://github.com/pandas-dev/pandas/issues/51433),
* None (all legacy types),
* `"numpy_nullable"` corresponds to existing behavior but also nullable floats (https://github.com/googleapis/google-cloud-python/issues/14483) and strings (somewhat related: https://github.com/googleapis/python-bigquery-pandas/issues/275#issuecomment-566100550).
* `"pyarrow"` (all Arrow dtypes)
Implementation note: we probably need to call `to_arrow` for all but default, where `to_dataframe` is still OK.
See also: https://github.com/pandas-dev/pandas/pull/51853
Contributor guide
Assessment
This issue has not been assessed yet.