apache / apache/uniffle

[Bug] Too high SUnreclaim memery use and does not release memory

Open
#1,479 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
454
Forks
172
Avg merge
5d 17h
Merged PRs (30d)
5

Description

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

### Search before asking

- [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no similar issues.

### Describe the bug

We launch 8 Shuffle Server machine, and there is one machine memory use is very high.
After diagnose, we find there is SUnreclaim too high by run cmd :/etc/meminfo
![image](https://github.com/apache/incubator-uniffle/assets/9440617/30d93e38-a343-4afe-8ce5-88ae1da5850a)

Event though RSS process is down, the memory is not released.

![image](https://github.com/apache/incubator-uniffle/assets/9440617/aa148e69-2761-4fa1-ad74-3d510503187c)

### Affects Version(s)

0.7.0

### Uniffle Server Log Output

_No response_

### Uniffle Engine Log Output

_No response_

### Uniffle Server Configurations

_No response_

### Uniffle Engine Configurations

_No response_

### Additional context

_No response_

### Are you willing to submit PR?

- [ ] Yes I am willing to submit a PR!

Contributor guide

Open the contributing guide

Research direction

The report concerns SUnreclaim memory growth on one of eight Shuffle Server machines, with RSS falling while memory remains allocated. Start by examining the server's memory use and the reported 0.7.0 context; the issue names no source files, tests, or configuration. Done means identifying and addressing why memory is not released, but the report lacks diagnostic logs and concrete reproduction details.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.