microsoft / microsoft/STL

tests/libcxx: Skip tests annotated ALLOW_RETRIES

Open
#807 1 comment 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

test
Dominant language
C++
Stars
11.1k
Forks
1.7k
Avg merge
4d 15h
Merged PRs (30d)
22

Description

Flaky libc++ tests have an // ALLOW_RETRIES: n attribute that instructs the test runner to retry the test up to n times if necessary. We don't respect this attribute for various reasons, which is fine, but we also don't treat these tests specially, which results in intermittent failures. Ideally we should filter such tests out in the test runner and simply treat them as UNSUPPORTED.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the libc++ test runner and the handling of the ALLOW_RETRIES attribute. Check how tests are classified when this annotation is present; done means such tests are filtered out and treated as UNSUPPORTED, preventing intermittent failures.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
testing-qa
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.