Azure / Azure/azure-sdk-tools

[Perf] Fail pipeline if one or more perf tests fails

Open
#5,368 0 comments 0 reactions 1 assignee Claimed by @mikeharder View on GitHub
Central-EngSys pillar-performance
Dominant language
C#
Stars
135
Forks
260
Avg merge
3d 1h
Merged PRs (30d)
143

Description

If one or more perf tests fails, the pipeline should be considered to have failed (turn red), though it should run all tests even if one fails. I believe this can be accomplished by having the `PerfAutomation` app set a flag if any test process returned a non-zero exit code (or returned -1 for throughput). We may also need to update the perf framework in each language to return a non-zero exit code on failures.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.