datafusion-contrib / datafusion-contrib/orc-rust
Support selection pruning
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 30
- Forks
- 26
- Avg merge
- 19m
- Merged PRs (30d)
- 3
Description
Make use of file statistics, stripe statistics, column statistics, row group indexes, and bloom filters
Need way to expose this functionality so users (like datafusion) can utilize to efficiently query large ORC files, e.g. via predicate pushdown
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by locating the existing handling for file, stripe, column, and row-group statistics, indexes, and bloom filters, then determine how predicate pushdown is exposed. Done means users such as DataFusion can use selection pruning when querying large ORC files.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- data-engineering, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100