microsoft / microsoft/playwright-pytest

[FR] Support for working with pytest-rerunfailures to only create --output on true failure

Open
#210 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

p3-collecting-feedback
Dominant language
Python
Stars
563
Forks
90
Avg merge
11m
Merged PRs (30d)
1

Description

It would be nice if this plugin could work nicely with pytest-rerun failures to mitigate flaky tests.

In the current state when using both plugins, when a test fails and it re runs the failure, the --output artifact such as the trace or a video is still created for each re run attempt, it would be nice to have an option to only retrieve the true failure and not the re runs

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the interaction between pytest-rerunfailures and the plugin's --output option, observing when trace or video artifacts are created across rerun attempts. Then inspect the plugin entry points and lifecycle handling involved in artifact collection. Done means an option or behavior allows artifacts to be retained only for the true final failure rather than each rerun.

Written by the indexing model from the issue text.

Assessment

Tech stack
playwright, python
Domain
testing-qa
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.