dotnet / dotnet/msbuild

Add evaluation specific metrcis and graphs to dashboard

Open
#14,931 0 comments 0 reactions 1 assignee Claimed by @AlesProkop View on GitHub
Area: Evaluation
Dominant language
C#
Stars
5.5k
Forks
1.5k
Avg merge
1d 8h
Merged PRs (30d)
141

Description

**Objective**

Add the new evaluation\-specific metrics and graphs introduced in the referenced PerfStar PRs to the performance dashboard.

**References**

PerfStar PR:
- https://devdiv.visualstudio.com/DevDiv/_git/dotnet-perfstar/pullrequest/765029
- https://devdiv.visualstudio.com/DevDiv/_git/dotnet-perfstar/pullrequest/758820

**Requirements**

The dashboard should provide a clear, user\-friendly view of evaluation performance trends and be suitable for presentation during Evaluation Sync meetings. Users should be able to understand performance changes and regressions at a glance.

The dashboard should include:

- Evaluation time broken down by individual evaluation phases.
- Total evaluation time.
- Total build time
- Time before MSBuild submission (dotnet.cli.process\_start\_to\_msbuild\_submission.duration).
- Historical trends showing improvements and regressions over time.
- Percentage change between builds for all key evaluation metrics.

**Build Comparison Experience**

Provide functionality to select and compare two specific builds. For each selected build, display:

- MSBuild commit SHA and a link to the commit.
- SDK commit SHA and a link to the commit used in the build.
- Key metric values for both builds.
- Percentage improvement or regression between the selected builds.

The comparison view should make it easy to answer questions such as:

- What changed between these two builds?
- Which evaluation metrics improved or regressed?
- What was the percentage improvement for each metric?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.