apache / apache/arrow

[C++][Python] A metadata standard for sorted datasets.

Open
#34,451 8 comments 0 reactions 0 assignees View on GitHub
Component: C++ Component: Python Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 18h
Merged PRs (30d)
91

Description

### Describe the enhancement requested

Split off from #34153.

In order to take advantage of sorted columns, it would be necessary for arrow to standardize on a way to represent sorting in datasets/table metadata. Akin to to pandas' `index_columns`.

### Component(s)

C++, Python

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start by reviewing the split-off context in #34153 and the pandas `index_columns` analogy, then determine how a sorting representation should be standardized across C++ and Python dataset/table metadata. Done means an agreed metadata standard is defined and its scope is clear.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, python
Domain
data
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.