apache / apache/arrow

[C++][Python] Unifying differing dictionaries in Arrow compute

Open
#14,955 5 comments 1 reaction 0 assignees View on GitHub
Component: Python Type: bug
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 18h
Merged PRs (30d)
91

Description

### Describe the bug, including details regarding any error messages, version, and platform.

I received the above error when trying to run group_by() with a key column defined as dictionary

Also tried dictionary but received the same error.

When I changed the key column to string(), group_by() ran successfully.

I am therefore guessing that key columns of datatype dictionary are currently not supported by group_by().

Is group_by() support for dictionary key columns planned?

Current setup is :

Windows 11
Python 3.10
pyarrow 10.0.1

### Component(s)

Python

Contributor guide

Open the contributing guide

Research direction

Start by reproducing group_by() with a dictionary key column using the reported Windows 11, Python 3.10, and pyarrow 10.0.1 setup, then trace the Arrow compute group_by path for dictionary handling. Done means dictionary key columns, including differing ordered states, are supported without the reported error and the behavior is covered by relevant tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.