apache / apache/pinot

Add a query option to skip all indexes to help debug potential index issues

Open
#11,310 0 comments 0 reactions 0 assignees View on GitHub
feature
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 55m
Merged PRs (30d)
182

Description

Propose to add a query option to skip all indexes when to run a query. If turning this option on, the query just scans over the fwd index to evaluate the filters, w/o using any indexes. This can help narrow down the scope when debug queries that might be affected by issues in indexes. Similar with the query option `useStarTree`.

Either we just add a big hammer query option that simply skip all kinds of indexes like `skipIndexes=true`; or add a query option like `skipIndexes=.[,.]` to have finer grained control.

Contributor guide

Open the contributing guide

Research direction

Start with the existing `useStarTree` query option and the query/index execution paths. Decide whether the option should skip all indexes or support per-index selection, then verify that filtered queries scan the forward index without using indexes and add coverage for the chosen semantics.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.