dotnet / dotnet/msbuild

[Flaky Test] Microsoft.Build.UnitTests.CodeTaskFactoryTests.EmbedsGeneratedFileInBinlog

Open
#14,569 5 comments 0 reactions 0 assignees View on GitHub
flaky-test
Dominant language
C#
Stars
5.5k
Forks
1.5k
Avg merge
1d 8h
Merged PRs (30d)
141

Description

**Flaky-test key** (automated de-duplication — do not edit):
```text
flaky-test-id: Microsoft.Build.UnitTests.CodeTaskFactoryTests.EmbedsGeneratedFileInBinlog
```

## Evidence

- **Distinct sources:** 3 (0 PRs + 3 rolling builds)
- **Rolling builds:** [1514373](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1514373), [1517682](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1517682), [1527742](https://dev.azure.com/dnceng-public/public/_build/results?buildId=1527742)
- **Legs:** FullOnWindows Release
- **TFMs:** net472
- **Assembly:** Microsoft.Build.Tasks.UnitTests
- **First seen:** 2026-07-17 | **Last seen:** 2026-07-27

## Sample error

```
Assert.True() Failure (hash: d888cdeb)
```

## Fully-qualified test name

`Microsoft.Build.UnitTests.CodeTaskFactoryTests.EmbedsGeneratedFileInBinlog`

Source: `src/Tasks.UnitTests/RoslynCodeTaskFactory_Tests.cs` (method `EmbedsGeneratedFileInBinlog`) or `src/Tasks.UnitTests/CodeTaskFactoryTests.cs`

## Next steps

This test will be quarantined via `[ActiveIssue("https://github.com/dotnet/msbuild/issues/")]` (from `Microsoft.DotNet.XUnitV3Extensions`, namespace `Xunit`) until the underlying nondeterminism is fixed.

> [!WARNING]
>
> Firewall blocked 1 domain
>
> The following domain was blocked by the firewall during workflow execution:
>
> - `awmgmcpg`
>> To allow these domains, add them to the `network.allowed` list in your workflow frontmatter:
>
> ```yaml
> network:
> allowed:
> - defaults
> - "awmgmcpg"
> ```
>
> See [Network Configuration](https://github.github.com/gh-aw/reference/network/) for more information.
>
>

> Generated by [Flaky Test Triage](https://github.com/dotnet/msbuild/actions/runs/30451703648) · sonnet46 · 150.7 AIC · ⌖ 5.46 AIC · ⊞ 14.7K · [◷](https://github.com/search?q=repo%3Adotnet%2Fmsbuild+is%3Aissue+%22gh-aw-workflow-call-id%3A+dotnet%2Fmsbuild%2Fflaky-test-detector.agent%22&type=issues)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with Microsoft.Build.UnitTests.CodeTaskFactoryTests.EmbedsGeneratedFileInBinlog in src/Tasks.UnitTests/RoslynCodeTaskFactory_Tests.cs and src/Tasks.UnitTests/CodeTaskFactoryTests.cs, then reproduce it on the FullOnWindows Release net472 leg. Trace the Assert.True failure and binlog generation to identify the nondeterminism; done means the test passes reliably without requiring the planned ActiveIssue quarantine.

Written by the indexing model from the issue text.

Assessment

Tech stack
csharp
Domain
build-system, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.