alibaba / alibaba/clusterdata

CPU utilization in microservices-v2021 traces

Open
#119 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2.2k
Forks
482
PR merge metrics
No merged PRs in 30d

Description

There are two CPU utilization numbers in the microservices traces:

1. node

|columns | Example Entry |
| ---------- | :-----------: |
| timestamp | 1000 |
| nodeid | ff1fb31957db767c5be4de2855488f128532efc2df0a673c6fa3e7718d10f355 |
| cpu_utilization | 0.7236219289416774 |
| memory_utilization | 0.738378997619996 |

2. MS_Metrics_table

|columns | Example Entry |
| ---------- | :-----------: |
| timestamp | 0 |
| msname | 99f2e7b501f50db9b4089242a5d3e1aba334c32e0c718b8d79281529a9489b15 |
| msinstanceid | 4d1cf65970444ef3ba9870468d7ecf9c17a93782134464767fbdc4aeb6f162eb |
| nodeid | ecd8a876344d673d8e934f566aae38aec05e572d43ab8d58624bd59e3ec43928 |
| cpu_utilization | 0.1299166666654249 |
| memory_utilization | 0.6126489639282227 |

For both of these, what do the utilization numbers mean?

For example, if the utilization is 1, how many cores / CPUs are being utilized? Does it mean the same for both the tables? How many CPUs does a container have in comparison to the full node?

Consider this specific case:

- MS Container has 8 CPUs allocated with utilization 0.5
- It is running on a node that has 16 CPUs

Then does it mean mean the full container is being used? or only 4 CPUs are being used? Is it possible to know the size of the container?

Thanks!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by examining the microservices-v2021 trace data and the definitions for the node and MS_Metrics_table cpu_utilization fields. Done means documenting what utilization 1 represents in each table, how container and node CPU capacity relate, and whether container size can be determined from the dataset.

Written by the indexing model from the issue text.

Assessment

Domain
data
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.