Azure / Azure/azure-cli-dev-tools

[Test] Add `--playback-only` option to skip tests that don't have recording files

Open
#3 0 comments 0 reactions 1 assignee Claimed by @haroldrandom View on GitHub
enhancement Test
Dominant language
Python
Stars
91
Forks
134
Avg merge
2h 51m
Merged PRs (30d)
1

Description

The current behavior of `run_tests --module` is to playback all tests that have recordings and record all tests that do not (and are not live only). When I have to re-record networking tests, often there are a few tests that are very slow and block. During that downtime, I would love to replay the tests that have already been re-recorded and identify which, if any, fail to playback. If I do this by running the module, I'll inevitably have two processes trying to record the same test, and nothing good comes of that.

Consider adding a `--playback-only` flag to `run_tests` that will only playback tests, and skips any tests that are live_only (obviously) or aren't but don't have a recording file.

...and the summary of which tests fail at the end of the run would be super super super helpful.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.