Azure / Azure/azure-cli-dev-tools

[Test] Add `--playback-only` option to skip tests that don't have recording files

Aperta
#3 0 commenti 0 reazioni 1 assegnatario Rivendicata da @haroldrandom Vedi su GitHub
enhancement Test
Lingua principale
Python
Stelle
91
Fork
134
Merge medio
2h 51m
PR unite (30g)
1

Descrizione

The current behavior of `run_tests --module` is to playback all tests that have recordings and record all tests that do not (and are not live only). When I have to re-record networking tests, often there are a few tests that are very slow and block. During that downtime, I would love to replay the tests that have already been re-recorded and identify which, if any, fail to playback. If I do this by running the module, I'll inevitably have two processes trying to record the same test, and nothing good comes of that.

Consider adding a `--playback-only` flag to `run_tests` that will only playback tests, and skips any tests that are live_only (obviously) or aren't but don't have a recording file.

...and the summary of which tests fail at the end of the run would be super super super helpful.

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.