apache / apache/pinot

Changes in QueryInvertedSortedIndexRecommender to handle non-dimension columns

Open
#7,018 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 3h
Merged PRs (30d)
195

Description

Typically the dimension columns are used in filter and group by. However, technically nothing prevents user from doing a filter on a non-dimension column. So, we need to update the query inverted index and sorted index recommender (QueryInvertedSortedIndexRecommender) and remove this limitation. This will allow rule engine to recommend inverted or sorted index on non-dimension columns as well
This issue is followup for issue #6937

Contributor guide

Open the contributing guide

Research direction

Start by locating QueryInvertedSortedIndexRecommender and reading how it identifies dimension columns for inverted and sorted index recommendations. Trace the rule-engine inputs and existing tests, then confirm that filters on non-dimension columns can produce the appropriate recommendations without changing existing dimension-column behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.