apache / apache/pinot

chunk compression type is hardcoded to passthrough for metric columns

Open
#7,973 6 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 3h
Merged PRs (30d)
195

Description

There doesn't seem to be a way to use LZ4 compression for metric column.

https://github.com/apache/pinot/blob/f2f8e38f9424bcacf3946197c9afcd50ef1d58fa/pinot-segment-local/src/main/java/org/apache/pinot/segment/local/realtime/converter/RealtimeSegmentConverter.java#L100

Contributor guide

Open the contributing guide

Research direction

Start in pinot-segment-local/src/main/java/org/apache/pinot/segment/local/realtime/converter/RealtimeSegmentConverter.java at the linked line, and trace how the compression type is chosen for metric columns. Confirm the existing configuration or conversion path for metric-column compression; done means LZ4 can be selected instead of passthrough.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.