storing json in a columnar format
Open
- Dominant language
- Java
- Stars
- 6.1k
- Forks
- 1.5k
- Avg merge
- 2d 3h
- Merged PRs (30d)
- 195
Description
when storing a json, it would be beneficial to store it in a columnar format so each indexed field is treated like a column in a regular table.
then Pinot can possibly be able to also use different kinds of indexes on the values and not just inverted index, as well as other benefits of storing in columnar format (compression, etc)
Contributor guide
Research direction
No files, tests, or entry points are named. Start by identifying Pinot's existing JSON storage and indexing paths, then clarify the columnar representation, supported indexes, compatibility requirements, and measurable criteria for considering the feature complete.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- database
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100