apache / apache/pinot

Optimize controller UI for large cluster/tables

Open
#10,504 6 comments 1 reaction 0 assignees View on GitHub
ui
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

We have large tables that have over 220k and 370k offline segments, that we almost always timeout trying to open the offline table page, as it seems the page was trying to load all segment data on the page. It would be great if the UI can be redesigned or tweaked to not trying to load all those data on page load, to make UI more responsive.

Contributor guide

Open the contributing guide

Research direction

Start with the controller UI's offline table page and trace how segment data is loaded when a table is opened. Reproduce the timeout with tables containing roughly 220k and 370k offline segments; done means the page no longer attempts to load all segment data at startup and remains responsive.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
frontend, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.