apache / apache/pinot

Support partitioning on composite column

Open
#9,548 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 55m
Merged PRs (30d)
182

Description

The current mechanism (https://docs.pinot.apache.org/operators/operating-pinot/tuning/routing#partitioning) allows specifying the partitioning logic on a single column. There may be cases where we want to partition the data on a composite column (eg: ). If the data is already partitioned on a composite column - we should have a way of capturing that in the Pinot config

Contributor guide

Open the contributing guide

Research direction

Start with the partitioning documentation at the linked routing page and trace how Pinot currently captures single-column partitioning in its configuration. Define how a composite column such as should be represented and verified, then confirm the configuration supports data already partitioned that way.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.