apache / apache/uniffle

[FEATURE] Show IO/CPU/Disk usage in Dashboard

Open
#1,624 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
454
Forks
172
Avg merge
5d 17h
Merged PRs (30d)
5

Description

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

### Search before asking

- [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no similar issues.

### Describe the feature

We should show IO/CPU/Disk usage for coordinators and shuffle servers in dashboard.
Perhaps we can display the usage of IO, CPU, and Disk in sorted order. This way, we can readily identify which shuffle server has reached its IO/CPU bottleneck, which shuffle server's local disk is nearly full, and so on, allowing us to make a series of optimizations accordingly.

### Motivation

_No response_

### Describe the solution

_No response_

### Additional context

_No response_

### Are you willing to submit PR?

- [ ] Yes I am willing to submit a PR!

Contributor guide

Open the contributing guide

Research direction

Start by locating the dashboard entry point and the existing coordinator and shuffle-server metrics. Trace how IO, CPU, and disk values are exposed and rendered, then verify that the dashboard can sort servers by each usage measure and identify near-bottleneck or nearly full disks.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
observability
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.