[automated] Monitor selective PR CI accuracy after enforcement
- Dominant language
- C#
- Stars
- 6.3k
- Forks
- 991
- Avg merge
- 2d 15h
- Merged PRs (30d)
- 196
Description
[automated] Track the bounded rollout audit after #19688 enabled selective PR test execution.
Current checkpoint: 42 of 50 eligible runs reviewed; 30 selected a subset and 12 selected `ALL`. No false positives or false negatives have been observed. One safe over-selection issue in renamed-file handling was investigated.
- [ ] Continue through September 4, 2026 or 50 eligible runs.
- [ ] Record missed test lanes, unnecessary selections, and incorrect `ALL` fallbacks.
- [ ] File and land fixes for confirmed selector defects.
- [ ] Publish the final accuracy and performance summary in #18036.
Contributor guide
Research direction
Start by reading #19688 to understand the selective PR test execution rollout and its eligible-run criteria. Continue the audit through September 4, 2026 or 50 runs, record missed lanes, over-selection, and incorrect ALL fallbacks, and report confirmed fixes and the final accuracy and performance summary in #18036.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- csharp
- Domain
- ci-cd, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100