apache / apache/pinot

storing json in a columnar format

Open
#7,152 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 3h
Merged PRs (30d)
195

Description

when storing a json, it would be beneficial to store it in a columnar format so each indexed field is treated like a column in a regular table.
then Pinot can possibly be able to also use different kinds of indexes on the values and not just inverted index, as well as other benefits of storing in columnar format (compression, etc)

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named. Start by identifying Pinot's existing JSON storage and indexing paths, then clarify the columnar representation, supported indexes, compatibility requirements, and measurable criteria for considering the feature complete.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
database
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.