dotnet / dotnet/msbuild

[Flaky Test] Microsoft.Build.UnitTests.CodeTaskFactoryTests.EmbedsGeneratedFromSourceFileInBinlog

Open
#14,574 3 comments 0 reactions 0 assignees View on GitHub
flaky-test
Dominant language
C#
Stars
5.5k
Forks
1.5k
Avg merge
1d 8h
Merged PRs (30d)
141

Description

**Flaky-test key** (automated de-duplication — do not edit):
```text
flaky-test-id: Microsoft.Build.UnitTests.CodeTaskFactoryTests.EmbedsGeneratedFromSourceFileInBinlog
```

## Evidence

- **Distinct sources:** 4 (0 PRs, 4 rolling builds on `main`)
- **Rolling build IDs:** [1514373](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1514373), [1517682](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1517682), [1527742](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1527742), [1532844](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1532844)
- **Legs:** FullOnWindows Release
- **Assembly:** `Microsoft.Build.Tasks.UnitTests`
- **First seen:** 2026-07-17 | **Last seen:** 2026-07-30
- **Error hash:** d888cdeb
- **Sample error:** `Assert.Equal() Failure: Values differ — Expected: True, Actual: False`

## Action

This test will be quarantined via `[ActiveIssue("")]` (from `Microsoft.DotNet.XUnitV3Extensions`, namespace `Xunit`) until the underlying nondeterminism is fixed. The quarantine pipeline (def 344) will continue gathering pass/fail signal.

**Assembly:** `Microsoft.Build.Tasks.UnitTests`
**Class:** `Microsoft.Build.UnitTests.CodeTaskFactoryTests`
**Method:** `EmbedsGeneratedFromSourceFileInBinlog`
**Source:** `src/Tasks.UnitTests/CodeTaskFactoryTests.cs`

> [!WARNING]
>
> Firewall blocked 2 domains
>
> The following domains were blocked by the firewall during workflow execution:
>
> - `awmgmcpg`
> - `southcentralus0.in.applicationinsights.azure.com`
>> To allow these domains, add them to the `network.allowed` list in your workflow frontmatter:
>
> ```yaml
> network:
> allowed:
> - defaults
> - "awmgmcpg"
> - "southcentralus0.in.applicationinsights.azure.com"
> ```
>
> See [Network Configuration](https://github.github.com/gh-aw/reference/network/) for more information.
>
>

> Generated by [Flaky Test Triage](https://github.com/dotnet/msbuild/actions/runs/30541891245) · sonnet46 · 155.1 AIC · ⌖ 5.48 AIC · ⊞ 14.7K · [◷](https://github.com/search?q=repo%3Adotnet%2Fmsbuild+is%3Aissue+%22gh-aw-workflow-call-id%3A+dotnet%2Fmsbuild%2Fflaky-test-detector.agent%22&type=issues)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start in src/Tasks.UnitTests/CodeTaskFactoryTests.cs at CodeTaskFactoryTests.EmbedsGeneratedFromSourceFileInBinlog and review the four rolling-build failures and their Assert.Equal result. Investigate the nondeterminism causing the expected value to be false, then verify the test passes reliably on the FullOnWindows Release leg before removing the quarantine.

Written by the indexing model from the issue text.

Assessment

Tech stack
csharp
Domain
build-system, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.