dotnet / dotnet/performance

Support emitting a results file with failures, which can be consumed by the arcade test results exporter

Open
#2,599 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
F#
Stars
773
Forks
301
Avg merge
6d 9h
Merged PRs (30d)
15

Description

The arcade test results reporter publishes the results to azdo, so the errors can be seen from the UI. The currently generated reports are not compatible, and don't show execution errors.

Instead, we should generate a xunit style test results xml with just the failures. The execution errors can be accessed from `report.ExecuteResults` -> `ExecuteResult.Data` (related https://github.com/dotnet/BenchmarkDotNet/pull/2096). This would make it easier to find, and track errors in kusto, or surfacing them in `Build Analysis` on PRs, or directly looking at the details in azdo instead of going to the console log, and then trying to find the failures in that.

cc @adamsitnik @LoopedBard3 @DrewScoggins

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.