alibaba / alibaba/clusterdata

Inconsistency in Microservice Dataset Across Different Tables (cluster-trace-microservices-v2022)

Open
#203 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2.2k
Forks
482
PR merge metrics
No merged PRs in 30d

Description

Hello @niewuya ,

I am currently working with the 1-hour microservices dataset released by your team, which includes the following tables: `CallGraph_0`, `MCRRTUpdate_0`, `MSMetricsUpdate_0`, and `NodeMetricsUpdate_0`.

I have encountered a challenge when attempting to connect these tables in a meaningful way. Specifically, there seems to be an inconsistency with the `msinstanceid` values between the `CallGraph_0` and `MSMetricsUpdate_0` tables.

For example, in `CallGraph_0`, there is a row with `traceid` T_13736926193 where `um` is MS_40586 and `uminstanceid` is MS_40586_POD_1010. When I attempt to match this to the `MSMetricsUpdate_0` table to find the corresponding metrics for `um` MS_40586, I find records where the `msname` matches `um`, but the `msinstanceid` does not match the `uminstanceid` from `CallGraph_0`.

I am looking for guidance on how to interpret these relations. Is there a linking key that I am missing, or is this an expected discrepancy due to the nature of the data?

Contributor guide

No contributing guide indexed for this repository

Research direction

Compare the schemas and identifier values in CallGraph_0, MSMetricsUpdate_0, MCRRTUpdate_0, and NodeMetricsUpdate_0, starting with traceid T_13736926193 and the MS_40586 records. Determine whether a documented linking key or dataset-generation rule explains the differing instance IDs. Done means the relationship is documented clearly, or the inconsistency is confirmed as a dataset issue.

Written by the indexing model from the issue text.

Assessment

Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.