microsoft / microsoft/aspire

[tests] Quarantined tests dashboard

Open
#8,813 5 comments 0 reactions 0 assignees View on GitHub
area-engineering-systems testing ☑️ tracking
Dominant language
C#
Stars
6.3k
Forks
991
Avg merge
2d 15h
Merged PRs (30d)
196

Description

*Data from Jun 2, 2026 to Jun 30, 2026 (28 days, 311 workflow runs)*

## Quarantined Tests (sorted by failed%)

| Failed (28d) | Total Failed / Runs | Failed % (28d) | Test |
| --- | --- | --- | --- |
| 310 | 310 / 310 | 100.0% | ⚠️ [Aspire.Cli.EndToEnd.Tests.KubernetesDeployWithNatsTests.DeployK8sWithNats](#aspirecliendtoendtestskubernetesdeploywithnatstestsdeployk8swithnats) |
| 129 | 129 / 311 | 41.5% | [Aspire.Hosting.OpenAI.Tests.OpenAIFunctionalTests.DependentResourceWaitsForOpenAIModelResourceWithHealthCheckToBeHealthy](https://github.com/microsoft/aspire/issues/10977) |
| 50 | 50 / 311 | 16.1% | [Aspire.Hosting.Tests.ExecutableResourceFailureLoggingTests.ExecutableExitsImmediately](https://github.com/microsoft/aspire/issues/16189) |
| 38 | 38 / 310 | 12.3% | ⚠️ [Aspire.Cli.EndToEnd.Tests.ResourceCommandTests.ResourceCommand\_FailsWhenInteractionServiceIsRequired](#aspirecliendtoendtestsresourcecommandtestsresourcecommandfailswheninteractionserviceisrequired) |
| 38 | 38 / 310 | 12.3% | ⚠️ [Aspire.Cli.EndToEnd.Tests.LogLevelTests.LogLevelTrace\_ProducesTraceEntriesInCliLogFile](#aspirecliendtoendtestslogleveltestslogleveltraceproducestraceentriesinclilogfile) |
| 27 | 27 / 241 | 11.2% | [Aspire.Cli.EndToEnd.Tests.PersistentContainerEndToEndTests.PersistentContainersPreserveDataAcrossAppHostRuns](https://github.com/microsoft/aspire/issues/17995) |
| 5 | 5 / 311 | 1.6% | [Aspire.Hosting.Tests.SlimTestProgramTests.TestProjectStartsAndStopsCleanly](https://github.com/microsoft/aspire/issues/9672) |
| 5 | 5 / 311 | 1.6% | [Aspire.Hosting.Tests.SlimTestProgramTests.TestPortOnEndpointAnnotationAndAllocatedEndpointAnnotationMatchForReplicatedServices](https://github.com/microsoft/aspire/issues/9673) |
| 5 | 5 / 311 | 1.6% | [Aspire.Hosting.Tests.SlimTestProgramTests.TestPortOnEndpointAnnotationAndAllocatedEndpointAnnotationMatch](https://github.com/microsoft/aspire/issues/9671) |
| 2 | 2 / 310 | 0.6% | [Aspire.Cli.EndToEnd.Tests.StartStopTests.CreateStartAndStopAspireProject](https://github.com/microsoft/aspire/issues/16191) |
| 2 | 2 / 310 | 0.6% | ⚠️ [Aspire.Cli.EndToEnd.Tests.StopNonInteractiveTests.StopNonInteractiveMultipleAppHostsShowsError](#aspirecliendtoendtestsstopnoninteractivetestsstopnoninteractivemultipleapphostsshowserror) |
| 1 | 1 / 311 | 0.3% | ⚠️ [Aspire.Hosting.Yarp.Tests.YarpFunctionalTests.VerifyYarpResourceExtensionsConfig](#aspirehostingyarptestsyarpfunctionaltestsverifyyarpresourceextensionsconfig) |
| 1 | 1 / 311 | 0.3% | [Aspire.Hosting.Tests.DistributedApplicationTests.TestServicesWithMultipleReplicas](https://github.com/microsoft/aspire/issues/9340) |
| 1 | 1 / 310 | 0.3% | ⚠️ [Aspire.Cli.EndToEnd.Tests.StopNonInteractiveTests.StopAllAppHostsFromUnrelatedDirectory](#aspirecliendtoendtestsstopnoninteractivetestsstopallapphostsfromunrelateddirectory) |

## Ready to Unquarantine — 25+ days of data with no failures (sorted by test name)

| Failed (28d) | Total Failed / Runs | Failed % (28d) | Test |
| --- | --- | --- | --- |
| 0 | 0 / 311 | 0.0% | [Aspire.Hosting.Tests.DistributedApplicationTests.ProxylessEndpointWorks](https://github.com/microsoft/aspire/issues/8728) |
| 0 | 0 / 311 | 0.0% | [Aspire.Hosting.Tests.DistributedApplicationTests.StartResourceForcesStart](https://github.com/microsoft/aspire/issues/15777) |

## Observations

### Tests missing tracking issues

These tests are in quarantine but don't have a corresponding GitHub issue:

#### ⚠️ Aspire.Cli.EndToEnd.Tests.KubernetesDeployWithNatsTests.DeployK8sWithNats

| OS | Last runs |
| --- | --- |
| **linux** (310/310) | ... [❌](https://github.com/microsoft/aspire/actions/runs/26983421015) [❌](https://github.com/microsoft/aspire/actions/runs/26978272976) [❌](https://github.com/microsoft/aspire/actions/runs/26972236627) [❌](https://github.com/microsoft/aspire/actions/runs/26966788404) [❌](https://github.com/microsoft/aspire/actions/runs/26960086897) [❌](https://github.com/microsoft/aspire/actions/runs/26953209666) [❌](https://github.com/microsoft/aspire/actions/runs/26947714575) [❌](https://github.com/microsoft/aspire/actions/runs/26942691134) [❌](https://github.com/microsoft/aspire/actions/runs/26937702480) [❌](https://github.com/microsoft/aspire/actions/runs/26932982590) [❌](https://github.com/microsoft/aspire/actions/runs/26927745776) [❌](https://github.com/microsoft/aspire/actions/runs/26922547287) [❌](https://github.com/microsoft/aspire/actions/runs/26917592550) [❌](https://github.com/microsoft/aspire/actions/runs/26912787988) [❌](https://github.com/microsoft/aspire/actions/runs/26907325745) [❌](https://github.com/microsoft/aspire/actions/runs/26902173217) [❌](https://github.com/microsoft/aspire/actions/runs/26895259467) [❌](https://github.com/microsoft/aspire/actions/runs/26888150644) [❌](https://github.com/microsoft/aspire/actions/runs/26882111194) [❌](https://github.com/microsoft/aspire/actions/runs/26876254155) [❌](https://github.com/microsoft/aspire/actions/runs/26870633204) [❌](https://github.com/microsoft/aspire/actions/runs/26865893066) [❌](https://github.com/microsoft/aspire/actions/runs/26861206180) [❌](https://github.com/microsoft/aspire/actions/runs/26856719334) [❌](https://github.com/microsoft/aspire/actions/runs/26852252608) [❌](https://github.com/microsoft/aspire/actions/runs/26847787612) [❌](https://github.com/microsoft/aspire/actions/runs/26842104616) [❌](https://github.com/microsoft/aspire/actions/runs/26836821404) [❌](https://github.com/microsoft/aspire/actions/runs/26829638328) [❌](https://github.com/microsoft/aspire/actions/runs/26821939569) |

#### ⚠️ Aspire.Cli.EndToEnd.Tests.ResourceCommandTests.ResourceCommand\_FailsWhenInteractionServiceIsRequired

| OS | Last runs |
| --- | --- |
| **linux** (38/310) | ... [❌](https://github.com/microsoft/aspire/actions/runs/26983421015) [❌](https://github.com/microsoft/aspire/actions/runs/26978272976) [❌](https://github.com/microsoft/aspire/actions/runs/26972236627) [❌](https://github.com/microsoft/aspire/actions/runs/26966788404) [❌](https://github.com/microsoft/aspire/actions/runs/26960086897) [❌](https://github.com/microsoft/aspire/actions/runs/26953209666) [❌](https://github.com/microsoft/aspire/actions/runs/26947714575) [❌](https://github.com/microsoft/aspire/actions/runs/26942691134) [❌](https://github.com/microsoft/aspire/actions/runs/26937702480) [❌](https://github.com/microsoft/aspire/actions/runs/26932982590) [❌](https://github.com/microsoft/aspire/actions/runs/26927745776) [❌](https://github.com/microsoft/aspire/actions/runs/26922547287) [❌](https://github.com/microsoft/aspire/actions/runs/26917592550) [❌](https://github.com/microsoft/aspire/actions/runs/26912787988) [❌](https://github.com/microsoft/aspire/actions/runs/26907325745) [❌](https://github.com/microsoft/aspire/actions/runs/26902173217) [❌](https://github.com/microsoft/aspire/actions/runs/26895259467) [❌](https://github.com/microsoft/aspire/actions/runs/26888150644) [❌](https://github.com/microsoft/aspire/actions/runs/26882111194) [❌](https://github.com/microsoft/aspire/actions/runs/26876254155) [❌](https://github.com/microsoft/aspire/actions/runs/26870633204) [❌](https://github.com/microsoft/aspire/actions/runs/26865893066) [❌](https://github.com/microsoft/aspire/actions/runs/26861206180) [❌](https://github.com/microsoft/aspire/actions/runs/26856719334) [❌](https://github.com/microsoft/aspire/actions/runs/26852252608) [❌](https://github.com/microsoft/aspire/actions/runs/26847787612) [❌](https://github.com/microsoft/aspire/actions/runs/26842104616) [❌](https://github.com/microsoft/aspire/actions/runs/26836821404) [❌](https://github.com/microsoft/aspire/actions/runs/26829638328) [❌](https://github.com/microsoft/aspire/actions/runs/26821939569) |

#### ⚠️ Aspire.Cli.EndToEnd.Tests.LogLevelTests.LogLevelTrace\_ProducesTraceEntriesInCliLogFile

| OS | Last runs |
| --- | --- |
| **linux** (38/310) | ... [❌](https://github.com/microsoft/aspire/actions/runs/26983421015) [❌](https://github.com/microsoft/aspire/actions/runs/26978272976) [❌](https://github.com/microsoft/aspire/actions/runs/26972236627) [❌](https://github.com/microsoft/aspire/actions/runs/26966788404) [❌](https://github.com/microsoft/aspire/actions/runs/26960086897) [❌](https://github.com/microsoft/aspire/actions/runs/26953209666) [❌](https://github.com/microsoft/aspire/actions/runs/26947714575) [❌](https://github.com/microsoft/aspire/actions/runs/26942691134) [❌](https://github.com/microsoft/aspire/actions/runs/26937702480) [❌](https://github.com/microsoft/aspire/actions/runs/26932982590) [❌](https://github.com/microsoft/aspire/actions/runs/26927745776) [❌](https://github.com/microsoft/aspire/actions/runs/26922547287) [❌](https://github.com/microsoft/aspire/actions/runs/26917592550) [❌](https://github.com/microsoft/aspire/actions/runs/26912787988) [❌](https://github.com/microsoft/aspire/actions/runs/26907325745) [❌](https://github.com/microsoft/aspire/actions/runs/26902173217) [❌](https://github.com/microsoft/aspire/actions/runs/26895259467) [❌](https://github.com/microsoft/aspire/actions/runs/26888150644) [❌](https://github.com/microsoft/aspire/actions/runs/26882111194) [❌](https://github.com/microsoft/aspire/actions/runs/26876254155) [❌](https://github.com/microsoft/aspire/actions/runs/26870633204) [❌](https://github.com/microsoft/aspire/actions/runs/26865893066) [❌](https://github.com/microsoft/aspire/actions/runs/26861206180) [❌](https://github.com/microsoft/aspire/actions/runs/26856719334) [❌](https://github.com/microsoft/aspire/actions/runs/26852252608) [❌](https://github.com/microsoft/aspire/actions/runs/26847787612) [❌](https://github.com/microsoft/aspire/actions/runs/26842104616) [❌](https://github.com/microsoft/aspire/actions/runs/26836821404) [❌](https://github.com/microsoft/aspire/actions/runs/26829638328) [❌](https://github.com/microsoft/aspire/actions/runs/26821939569) |

#### ⚠️ Aspire.Cli.EndToEnd.Tests.StopNonInteractiveTests.StopNonInteractiveMultipleAppHostsShowsError

| OS | Last runs |
| --- | --- |
| **linux** (2/310) | ... [✅](https://github.com/microsoft/aspire/actions/runs/27185610794) [✅](https://github.com/microsoft/aspire/actions/runs/27181157518) [✅](https://github.com/microsoft/aspire/actions/runs/27175969670) [✅](https://github.com/microsoft/aspire/actions/runs/27171092143) [✅](https://github.com/microsoft/aspire/actions/runs/27165906820) [✅](https://github.com/microsoft/aspire/actions/runs/27159492178) [✅](https://github.com/microsoft/aspire/actions/runs/27153878675) [✅](https://github.com/microsoft/aspire/actions/runs/27146996937) [✅](https://github.com/microsoft/aspire/actions/runs/27140723269) [✅](https://github.com/microsoft/aspire/actions/runs/27134836923) [✅](https://github.com/microsoft/aspire/actions/runs/27128633583) [✅](https://github.com/microsoft/aspire/actions/runs/27122899489) [✅](https://github.com/microsoft/aspire/actions/runs/27118042553) [✅](https://github.com/microsoft/aspire/actions/runs/27113634717) [✅](https://github.com/microsoft/aspire/actions/runs/27109682389) [✅](https://github.com/microsoft/aspire/actions/runs/27106568029) [✅](https://github.com/microsoft/aspire/actions/runs/27103824636) [✅](https://github.com/microsoft/aspire/actions/runs/27100980028) [❌](https://github.com/microsoft/aspire/actions/runs/27098237732) [✅](https://github.com/microsoft/aspire/actions/runs/27095486140) [✅](https://github.com/microsoft/aspire/actions/runs/27092608798) [✅](https://github.com/microsoft/aspire/actions/runs/27090245645) [✅](https://github.com/microsoft/aspire/actions/runs/27088069576) [✅](https://github.com/microsoft/aspire/actions/runs/27085975542) [✅](https://github.com/microsoft/aspire/actions/runs/27083827239) [✅](https://github.com/microsoft/aspire/actions/runs/27081078413) [✅](https://github.com/microsoft/aspire/actions/runs/27078150290) [✅](https://github.com/microsoft/aspire/actions/runs/27075494780) [✅](https://github.com/microsoft/aspire/actions/runs/27072942452) [❌](https://github.com/microsoft/aspire/actions/runs/27070297962) |

#### ⚠️ Aspire.Hosting.Yarp.Tests.YarpFunctionalTests.VerifyYarpResourceExtensionsConfig

| OS | Last runs |
| --- | --- |
| **linux** (1/311) | ... [✅](https://github.com/microsoft/aspire/actions/runs/27406810595) [✅](https://github.com/microsoft/aspire/actions/runs/27401642012) [✅](https://github.com/microsoft/aspire/actions/runs/27396726559) [✅](https://github.com/microsoft/aspire/actions/runs/27386759187) [✅](https://github.com/microsoft/aspire/actions/runs/27381671606) [✅](https://github.com/microsoft/aspire/actions/runs/27376386750) [✅](https://github.com/microsoft/aspire/actions/runs/27370330409) [✅](https://github.com/microsoft/aspire/actions/runs/27364300445) [✅](https://github.com/microsoft/aspire/actions/runs/27356772566) [✅](https://github.com/microsoft/aspire/actions/runs/27349330401) [✅](https://github.com/microsoft/aspire/actions/runs/27343645502) [✅](https://github.com/microsoft/aspire/actions/runs/27337237400) [✅](https://github.com/microsoft/aspire/actions/runs/27331446648) [✅](https://github.com/microsoft/aspire/actions/runs/27326091903) [✅](https://github.com/microsoft/aspire/actions/runs/27320993585) [✅](https://github.com/microsoft/aspire/actions/runs/27315809058) [✅](https://github.com/microsoft/aspire/actions/runs/27310744108) [✅](https://github.com/microsoft/aspire/actions/runs/27298591881) [✅](https://github.com/microsoft/aspire/actions/runs/27292340097) [✅](https://github.com/microsoft/aspire/actions/runs/27285584578) [✅](https://github.com/microsoft/aspire/actions/runs/27278284439) [✅](https://github.com/microsoft/aspire/actions/runs/27272297429) [✅](https://github.com/microsoft/aspire/actions/runs/27265882075) [✅](https://github.com/microsoft/aspire/actions/runs/27260281076) [✅](https://github.com/microsoft/aspire/actions/runs/27255388685) [✅](https://github.com/microsoft/aspire/actions/runs/27250297678) [✅](https://github.com/microsoft/aspire/actions/runs/27245130910) [✅](https://github.com/microsoft/aspire/actions/runs/27240031308) [✅](https://github.com/microsoft/aspire/actions/runs/27234347210) [❌](https://github.com/microsoft/aspire/actions/runs/27227890823) |

#### ⚠️ Aspire.Cli.EndToEnd.Tests.StopNonInteractiveTests.StopAllAppHostsFromUnrelatedDirectory

| OS | Last runs |
| --- | --- |
| **linux** (1/310) | ... [✅](https://github.com/microsoft/aspire/actions/runs/28432919450) [✅](https://github.com/microsoft/aspire/actions/runs/28427065243) [✅](https://github.com/microsoft/aspire/actions/runs/28417373526) [✅](https://github.com/microsoft/aspire/actions/runs/28412045269) [✅](https://github.com/microsoft/aspire/actions/runs/28406583220) [✅](https://github.com/microsoft/aspire/actions/runs/28400961789) [✅](https://github.com/microsoft/aspire/actions/runs/28394520584) [✅](https://github.com/microsoft/aspire/actions/runs/28389187559) [✅](https://github.com/microsoft/aspire/actions/runs/28382048538) [✅](https://github.com/microsoft/aspire/actions/runs/28375354752) [✅](https://github.com/microsoft/aspire/actions/runs/28369225830) [✅](https://github.com/microsoft/aspire/actions/runs/28362502521) [✅](https://github.com/microsoft/aspire/actions/runs/28356215293) [✅](https://github.com/microsoft/aspire/actions/runs/28350846705) [✅](https://github.com/microsoft/aspire/actions/runs/28345955252) [✅](https://github.com/microsoft/aspire/actions/runs/28341459946) [✅](https://github.com/microsoft/aspire/actions/runs/28337924850) [✅](https://github.com/microsoft/aspire/actions/runs/28334887844) [✅](https://github.com/microsoft/aspire/actions/runs/28331688179) [✅](https://github.com/microsoft/aspire/actions/runs/28325502981) [✅](https://github.com/microsoft/aspire/actions/runs/28322158845) [✅](https://github.com/microsoft/aspire/actions/runs/28317256707) [✅](https://github.com/microsoft/aspire/actions/runs/28314903051) [✅](https://github.com/microsoft/aspire/actions/runs/28312557085) [✅](https://github.com/microsoft/aspire/actions/runs/28309574394) [✅](https://github.com/microsoft/aspire/actions/runs/28306471832) [✅](https://github.com/microsoft/aspire/actions/runs/28303557172) [✅](https://github.com/microsoft/aspire/actions/runs/28300739991) [✅](https://github.com/microsoft/aspire/actions/runs/28297831001) [❌](https://github.com/microsoft/aspire/actions/runs/28294876552) |

### Tests with issues missing quarantine label

These tests have tracking issues but those issues don't have the `quarantined-test` label:

- [Aspire.Cli.EndToEnd.Tests.PersistentContainerEndToEndTests.PersistentContainersPreserveDataAcrossAppHostRuns](https://github.com/microsoft/aspire/issues/17995)

### Stale tracking issues

These issues have the `quarantined-test` label but no matching test was found in the report:

- https://github.com/microsoft/aspire/issues/17485
- https://github.com/microsoft/aspire/issues/17020
- https://github.com/microsoft/aspire/issues/9083
- https://github.com/microsoft/aspire/issues/6866
- https://github.com/microsoft/aspire/issues/5959

### Perpetually broken tests

These tests have failed 100% of the time (5+ runs) — they may need code fixes, not just quarantine:

- Aspire.Cli.EndToEnd.Tests.KubernetesDeployWithNatsTests.DeployK8sWithNats — 310/310 runs failed

-- Updated on 6/30/2026 12:30:35 PM UTC

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.