apache / apache/pinot

Provide bitmap from previous stages of queries to `RangeIndexReader`

Open
#7,597 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 3h
Merged PRs (30d)
195

Description

If a bitmap of matching rows (so rows which can't match the query are absent from the bitmap) were passed in to `RangeIndexReader` it could be used by the v2 range index to skip work for rows which can't match.

Contributor guide

Open the contributing guide

Research direction

Start by reading RangeIndexReader and the v2 range index implementation to understand how query stages currently select rows. Trace where the bitmap of matching rows is available from previous stages and determine the integration points for passing it into the reader. Done means the v2 range index can use that bitmap to skip rows that cannot match, with behavior covered by relevant tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases, performance
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.