apache / apache/arrow-rs

New crates for take and partition kernels (for use by REE)

Open
#9,737 2 comments 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Rust
Stars
3.6k
Forks
1.3k
Avg merge
2d 18h
Merged PRs (30d)
169

Description

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
As we implement REE across the codebase it turns out that two kernels are important for many operations: `take` and `partition`

However, these kernels are in arrow-ord and arrow-cmp crates

This came up in at least two PRs
- casting from @vegarsti : https://github.com/apache/arrow-rs/pull/8589
- https://github.com/apache/arrow-rs/issues/8708
- json https://github.com/apache/arrow-rs/pull/9658/changes#r3092541499 from @liamzwbao

**Describe the solution you'd like**
I propose we split these kernels into their own new crates to reduce the dependencies.

SOmething like
- `arrow-take`
- `arrow-partition` (I am not sure this will be possible given that partition uses comparisons)

**Describe alternatives you've considered**
@Weijun-H has a proposal here of how to remove in arrow-rcast
- https://github.com/apache/arrow-rs/pull/8716

**Additional context**

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.