apache / apache/arrow

[C++][Compute] Support ChunkedArray sorting for dictionary type

Open
#38,490 1 comment 0 reactions 1 assignee Claimed by @llama90 View on GitHub
Component: C++ Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the enhancement requested

To support join operations for the `DictionaryType`, sorting operations of indices related to the `DictionaryType` in a `ChunkedArray` is required (This applies to `ChunkedArray`, `RecordBatch`, and `Table` alike).

From a data structure perspective, the support for the `DictionaryType` within `Array` and `ChunkedArray`, as well as between `RecordBatch` and `Table`, appeared to be similar.

For instance, based on the sorting of `Array` and `RecordBatch`, there's a need to merge the sorted data structures for `ChunkedArray` and `Table` respectively.

Sorting for the `DictionaryType` within `Array` is already supported, so sorting for `ChunkedArray` is needed. In this context, I've observed that sorting for the `DictionaryType` internally takes place based on the `Rank` of the dictionaries.

In any case, before supporting the `DictionaryType` for `ChunkedArray` based on the algorithm for the `DictionaryType` in `Array`, it seems necessary to pave the way. Given the similarities, this would then allow for support in `RecordBatch` and `Table`. I've created a separate issue for this.

### Component(s)

C++

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.