Support partitioning on composite column
- Dominant language
- Java
- Stars
- 6.1k
- Forks
- 1.5k
- Avg merge
- 2d 55m
- Merged PRs (30d)
- 182
Description
The current mechanism (https://docs.pinot.apache.org/operators/operating-pinot/tuning/routing#partitioning) allows specifying the partitioning logic on a single column. There may be cases where we want to partition the data on a composite column (eg: ). If the data is already partitioned on a composite column - we should have a way of capturing that in the Pinot config
Contributor guide
Research direction
Start with the partitioning documentation at the linked routing page and trace how Pinot currently captures single-column partitioning in its configuration. Define how a composite column such as should be represented and verified, then confirm the configuration supports data already partitioned that way.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- databases, distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100