dotnet / dotnet/msbuild

[Flaky Test] Microsoft.Build.BuildCheck.UnitTests.EndToEndTests.TFMinNonSdkCheckTest

Open
#14,539 9 comments 0 reactions 0 assignees View on GitHub
flaky-test
Dominant language
C#
Stars
5.5k
Forks
1.5k
Avg merge
1d 8h
Merged PRs (30d)
141

Description

**Flaky-test key** (automated de-duplication — do not edit):
```text
flaky-test-id: Microsoft.Build.BuildCheck.UnitTests.EndToEndTests.TFMinNonSdkCheckTest
```

## Evidence

- **Assembly**: `Microsoft.Build.BuildCheck.UnitTests`
- **Fully-qualified name**: `Microsoft.Build.BuildCheck.UnitTests.EndToEndTests.TFMinNonSdkCheckTest`
- **Distinct sources**: 3 (0 PRs + 3 rolling builds)
- **Rolling builds**: [1506834](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1506834), [1517682](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1517682), [1527742](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1527742)
- **Legs**: FullOnWindows, FullOnWindows Release
- **TFMs**: net472
- **First seen**: 2026-07-13 | **Last seen**: 2026-07-27
- **Total failures**: 8
- **Error hashes**: 4 distinct (`63296afd`, `159b6d2e`, `2b21cff8`, `9b571f7b`)

### Sample error

```
Shouldly.ShouldAssertException: ...
```

See [sample build](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1506834) for details.

## Action

This test will be quarantined with `[ActiveIssue("")]` (from `Microsoft.DotNet.XUnitV3Extensions`, namespace `Xunit`) until the underlying nondeterminism is fixed. The quarantine pipeline (def 344) will continue running it to gather signal.

> [!WARNING]
>
> Firewall blocked 2 domains
>
> The following domains were blocked by the firewall during workflow execution:
>
> - `awmgmcpg`
> - `southcentralus0.in.applicationinsights.azure.com`
>> To allow these domains, add them to the `network.allowed` list in your workflow frontmatter:
>
> ```yaml
> network:
> allowed:
> - defaults
> - "awmgmcpg"
> - "southcentralus0.in.applicationinsights.azure.com"
> ```
>
> See [Network Configuration](https://github.github.com/gh-aw/reference/network/) for more information.
>
>

> Generated by [Flaky Test Triage](https://github.com/dotnet/msbuild/actions/runs/30267259222) · sonnet46 · 153.8 AIC · ⌖ 6.72 AIC · ⊞ 14.7K · [◷](https://github.com/search?q=repo%3Adotnet%2Fmsbuild+is%3Aissue+%22gh-aw-workflow-call-id%3A+dotnet%2Fmsbuild%2Fflaky-test-detector.agent%22&type=issues)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by running Microsoft.Build.BuildCheck.UnitTests.EndToEndTests.TFMinNonSdkCheckTest on net472 in the FullOnWindows configurations, then inspect the three linked rolling builds and the sample build for the full Shouldly assertion details. Trace the test's setup and external inputs to identify the nondeterminism. Done means the test passes reliably and no longer needs quarantine.

Written by the indexing model from the issue text.

Assessment

Tech stack
csharp
Domain
testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.