apache / apache/arrow-java

[Java] Push-down filtering in Java

Open
#227 8 comments 0 reactions 0 assignees View on GitHub
Type: enhancement Type: usage
Dominant language
Java
Stars
94
Forks
152
Avg merge
3d 16h
Merged PRs (30d)
11

Description

### Push-down filtering (Java) questions

Hey all,

I'm exploring adding push-down filtering to the Java Datasets API, as it currently only supports push-down projection.
Just had a couple of questions before I start this work:

- Is this planned on any current roadmap? I'd like to avoid duplicating work that's already begun
- Does anyone have any smart ideas as to how to pass the filter predicate into ScanOptions? As far as I can tell, the only complication to make this happen would be figuring out some way to call into the Expression object from Java without creating future maintenance effort.

Thanks!

### Component(s)

C++, Java

Contributor guide

Open the contributing guide

Research direction

Start with the Java Datasets API's existing push-down projection support, then inspect how ScanOptions and the Expression object are used across the Java and C++ components. The work is complete when Java filter predicates can be passed through ScanOptions for push-down filtering without creating an unsustainable maintenance burden.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, java
Domain
api, data
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.