apache / apache/arrow-rs

Collect filter selectivity

Open
#8,723 1 comment 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Rust
Stars
3.6k
Forks
1.3k
Avg merge
2d 18h
Merged PRs (30d)
169

Description

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
I would like to collect stats on how selective my filters are for databasey reasons.

**Describe the solution you'd like**
Something like this: https://github.com/coralogix/arrow-rs/blob/53eb05b142df31dfb89b02194f09d78f3f467ca2/parquet/src/arrow/arrow_reader/mod.rs#L640

**Describe alternatives you've considered**
I am open to other options

**Additional context**

Contributor guide

Open the contributing guide

Research direction

Start by reading the linked parquet arrow_reader implementation to understand the selectivity statistics being requested. Then determine the intended API and measurement semantics for arrow-rs; the work is done when a documented approach and agreed validation are available for collecting filter selectivity.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.