alibaba / alibaba/clusterdata

Regarding CPU and memory resource allocation for containers

Open
#89 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2.2k
Forks
482
PR merge metrics
No merged PRs in 30d

Description

According to my analysis of the trace, I found that there are some containers, whose CPU limits are much larger than their CPU request, in many machines. I wonder if those containers are processing offline tasks, and allowed to utilize idle CPUs in the system.
However, their CPU usages seem to indicate that they do not use more CPU than their requests, which makes me very contradictory. The trace only shows a single value for memory limits. Does this mean that the hard limit and soft limit of the container's memory are both set to the same value? Why not set different values?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the referenced trace and compare the container CPU requests, CPU limits, observed usage, and recorded memory limits across machines. The issue does not name project files or tests. Done would require an explicit project-supported explanation of these resource fields and why the trace exposes memory as a single value.

Written by the indexing model from the issue text.

Assessment

Domain
data, infrastructure
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.