apache / apache/arrow

[Python][C++] Automatically infer/convert uuid.Uuid to an Arrow binary

Open
#29,541 1 comment 0 reactions 0 assignees View on GitHub
Component: C++ Type: bug
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

I'm not sure if the benefit is worth the complexity but this was inspired by https://stackoverflow.com/questions/69067754/handling-uuid-values-in-arrow-with-parquet-files

Short summary of the issue: SQL -> Pandas will generate columns of uuid.Uuid. Pandas treats uuid.Uuid as an opaque object. Resulting dataframe fails to convert to Arrow table.

**Reporter**: [Weston Pace](https://issues.apache.org/jira/browse/ARROW-13930) / @westonpace
#### PRs and other links:
- [GitHub Pull Request #11106](https://github.com/apache/arrow/pull/11106)

**Note**: *This issue was originally created as [ARROW-13930](https://issues.apache.org/jira/browse/ARROW-13930). Please see the [migration documentation](https://github.com/apache/arrow/issues/14542) for further details.*

Contributor guide

Open the contributing guide

Research direction

Start by reviewing linked pull request #11106 and the Python pandas-to-Arrow conversion path described in the issue. Confirm how uuid.Uuid columns currently fail during Arrow table conversion, then verify that the intended uuid-to-binary behavior is covered by the relevant tests; the issue names no specific files or test paths.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, pandas, python
Domain
data
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.