apache / apache/pinot

Reducing Heap Memory Usage During Segment Construction

Open
#9,099 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

Segment construction is typically a heap memory intensive operation and there are opportunities to improve the same. This issue tracks the effort.

cc @Jackie-Jiang

Contributor guide

Open the contributing guide

Research direction

Start by locating the segment construction entry points in Apache Pinot and trace where heap-intensive work occurs. The issue provides no file or test references, so first establish the relevant construction path and a way to verify memory usage; done means reducing heap usage during segment construction.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.