[Python][C++] Automatically infer/convert uuid.Uuid to an Arrow binary
- Dominant language
- C++
- Stars
- 17.1k
- Forks
- 4.3k
- Avg merge
- 3d 13h
- Merged PRs (30d)
- 88
Description
I'm not sure if the benefit is worth the complexity but this was inspired by https://stackoverflow.com/questions/69067754/handling-uuid-values-in-arrow-with-parquet-files
Short summary of the issue: SQL -> Pandas will generate columns of uuid.Uuid. Pandas treats uuid.Uuid as an opaque object. Resulting dataframe fails to convert to Arrow table.
**Reporter**: [Weston Pace](https://issues.apache.org/jira/browse/ARROW-13930) / @westonpace
#### PRs and other links:
- [GitHub Pull Request #11106](https://github.com/apache/arrow/pull/11106)
**Note**: *This issue was originally created as [ARROW-13930](https://issues.apache.org/jira/browse/ARROW-13930). Please see the [migration documentation](https://github.com/apache/arrow/issues/14542) for further details.*
Contributor guide
Research direction
Start by reviewing linked pull request #11106 and the Python pandas-to-Arrow conversion path described in the issue. Confirm how uuid.Uuid columns currently fail during Arrow table conversion, then verify that the intended uuid-to-binary behavior is covered by the relevant tests; the issue names no specific files or test paths.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, pandas, python
- Domain
- data
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100