box / box/flaky

Flaky decorators on individual tests have no effect if `--force-flaky` argument is passed

Open
#209 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
398
Forks
57
PR merge metrics
No merged PRs in 30d

Description

From `README.rst`:

> Pass --max-runs=MAX_RUNS and/or --min-passes=MIN_PASSES to control the behavior of flaky if --force-flaky is specified. Flaky decorators on individual tests will override these defaults.

However, flaky decorators on individual tests do not override these defaults.

To repro the issue, consider the following test file `test.py`:

```
import pytest

@pytest.mark.flaky(max_runs=10)
def test_foo():
assert False
```

Then run `pytest test.py --force-flaky` and observe the test was run the default 2 times instead of the 10 specified by the decorator.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.