apache / apache/arrow

[Python] Implement DictionaryArray converter for type pa.large_string and pa.large_binary

Open
#49,505 1 comment 0 reactions 1 assignee Claimed by @fotinosk View on GitHub
Component: Python Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the enhancement requested

I get these error when using `pa.array` with dictionary using large binary / string passed as values

```
pyarrow.lib.ArrowNotImplementedError: DictionaryArray converter for type dictionary not implemented
pyarrow.lib.ArrowNotImplementedError: DictionaryArray converter for type dictionary not implemented
```

```python
def test_arrow_missing_function():
pa.array([], pa.dictionary(pa.int32(), pa.string()))
pa.array([], pa.dictionary(pa.int32(), pa.binary()))

with pytest.raises(
pa.ArrowNotImplementedError,
match="DictionaryArray converter for type dictionary\ not implemented",
):
pa.array([], pa.dictionary(pa.int32(), pa.large_string()))

with pytest.raises(
pa.ArrowNotImplementedError,
match="DictionaryArray converter for type dictionary\ not implemented",
):
pa.array([], pa.dictionary(pa.int32(), pa.large_binary()))

```

### Component(s)

Python

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.