dotnet / dotnet/sdk

[AI discovered CI] Template authoring integration tests cannot find targeting packs in test feeds

Open
#56,058 1 comment 1 reaction 2 assignees Claimed by @nagilson View on GitHub
agentic-workflows cookie domestic-cat live-build-incident Test Debt untriaged
Dominant language
C#
Stars
3.2k
Forks
1.3k
PR merge metrics
PR metrics pending

Description

## Build Information
- **Current build:** [1575657](https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=1575657)
- **Branch:** `refs/heads/main`
- **Failing tests:** Template authoring task integration tests (`LocalizeTemplateTests` and `ValidateTemplatesTests`) in the Windows x64 FullFramework Helix job; 12 tests failed.
- **Phase:** `test-execution`; **failureType:** `test-assertion`; **evidenceSources:** `helix-trx`
- **Matching prior builds:** None in the supplied related-failure summaries. Recent sequence: failed 1575533, 1575141, 1575045, 1574612, 1573708, 1573623, 1573087, 1571869, 1571595, 1571404; passed 1575340, 1573721, 1573234, 1572955, 1572757, 1572554, 1571833, 1571770, 1571202.
- **Failure fingerprints:**
- `test-execution|test-assertion|microsoft.templateengine.authoring.tasks.integrationtests.localizetemplatetests.canruntask|assertion-failed.-expected-values-to-be-equal.-expected-command-to-pass-but-it-did-not.-exit-code---error-nu1101-unable-to-find-package-microsoft.netcore.app.ref`
- `test-execution|test-assertion|microsoft.templateengine.authoring.tasks.integrationtests.localizetemplatetests.canruntaskanddetecterror|assertion-failed.-expected-condition-to-be-true.-expected-standard-output-to-contain-each-child-of-postactions-should-have-a-unique-id-but-it-did-not.-exit-code--`

## Failure History
The current build reports 12 template-authoring tests failing because their setup restores cannot locate targeting-pack packages in the configured test feeds. The supplied history does not establish recurrence of this exact NU1101 mechanism in an independent build; surrounding builds are mixed pass/fail observations.

## Error Details
```text
Assertion failed. Expected values to be equal.
Expected command to pass but it did not.
Exit Code: 1
: error NU1101: Unable to find package Microsoft.NETCore.App.Ref. No packages exist with this id in source(s): testPackages0, testPackages1
: error NU1101: Unable to find package Microsoft.WindowsDesktop.App.Ref. No packages exist with this id in source(s): testPackages0, testPackages1
: error NU1101: Unable to find package Microsoft.AspNetCore.App.Ref. No packages exist with this id in source(s): testPackages0, testPackages1
Failed to restore .
```

## Root Cause Analysis
**Observed:** Multiple template-authoring tests fail during setup restore; expected validation/localization output is absent because the command exits on NU1101.

**Assessment:** The shared proximate cause is that the configured `testPackages0` and `testPackages1` sources do not contain the required .NET reference-pack packages. The assertion failures are downstream wrappers. The evidence does not establish whether package publication, feed configuration, or test provisioning is responsible.

**Confidence:** Medium.

**Alternatives / Unknowns:** No feed configuration, binlog, target-branch comparison, or matching related candidate was supplied. If both sources were intentionally empty or the issue is a broad feed outage, routing may belong in `dotnet/dnceng`.

## Suggested Investigation
Inspect the failing Helix asset\s NuGet sources and package contents first; verify whether the exact reference packs are published to `testPackages0`/`testPackages1`. Compare the test packaging/provisioning with the last passing build and collect restore diagnostics to distinguish SDK-owned test setup from external feed availability.

> Generated by [🕵️ CI Quality Investigator](https://github.com/dotnet/sdk/actions/runs/33452127743) · gpt56 · 3.48 AIC · ⌖ 0.749 AIC · ⊞ 17.5K · [◷](https://github.com/search?q=repo%3Adotnet%2Fsdk+is%3Aissue+%22gh-aw-workflow-call-id%3A+dotnet%2Fsdk%2Fci-quality-monitor%22&type=issues)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.