microsoft / microsoft/mcp

Live tests: ResilienceManagement test-resources deployment hangs and is cancelled by worker timeout (~60min), reproducible across runs

Open
#3,677 1 comment 0 reactions 0 assignees View on GitHub
bug server-Azure.Mcp tools-ResilienceManagement
Dominant language
C#
Stars
3.7k
Forks
624
Avg merge
2d 20h
Merged PRs (30d)
220

Description

## Summary

The `Live tests - toolsAzure.Mcp.Tools.ResilienceManagement` CI job consistently fails because the **"🚀 Deploy test resources"** step never finishes provisioning test infrastructure — it is still polling ARM ("Checking deployment status...") when the ~60 minute CI worker timeout kills the job. This has now been observed in **two consecutive runs**, so it is a persistent/reproducible failure, not a one-off flake.

## Evidence

Example: [Run #20260910.4](https://dev.azure.com/azure-sdk/internal/_build/results?buildId=6812627&view=logs&j=3062cd78-3dd8-5cfa-d581-ea116ba27da8&t=39f71255-8c7a-511e-e12f-47ec4d48350d&l=66)

| Run | Deploy started | Job cancelled (worker timeout) | Elapsed |
|---|---|---|---|
| build 6800475 (run1) | 2026-09-08T21:21:52Z | 2026-09-08T22:27:03Z | ~65 min |
| build 6812627 (run2) | 2026-09-10T23:22:05Z | 2026-09-11T00:29:39Z | ~67 min |

Both runs show the exact same pattern:
```
##[error]The Operation will be canceled. The next steps may not contain expected logs.
##[error]The operation was canceled.
##[section]Finishing: 🚀 Deploy test resources
...
##[error]Step cancelled due to worker timeout
##[error]Job cancelled due to worker timeout.
```

## Suspected root cause

`tools/Azure.Mcp.Tools.ResilienceManagement/tests/test-resources.bicep` deploys, among faster/standard resources (Storage account, Managed Disk, Automation account):

```bicep
resource usagePlan 'Microsoft.AzureResilienceManagement/usagePlans@2026-04-01-preview' = {
name: usagePlanName
location: 'global'
properties: {
planType: 'Standard'
}
}
```

## Environment

- Location: `westus`
- Template: `tools/Azure.Mcp.Tools.ResilienceManagement/tests/test-resources.bicep`
- Post-deploy script: `tools/Azure.Mcp.Tools.ResilienceManagement/tests/test-resources-post.ps1`

Contributor guide

Open the contributing guide

Research direction

Start with tools/Azure.Mcp.Tools.ResilienceManagement/tests/test-resources.bicep and tools/Azure.Mcp.Tools.ResilienceManagement/tests/test-resources-post.ps1, then review the linked CI run's deployment logs. Reproduce the Live tests - toolsAzure.Mcp.Tools.ResilienceManagement job and determine why ARM remains in "Checking deployment status...". Done means test-resource deployment completes within the worker limit across repeated runs.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, powershell
Domain
cloud, devops, infrastructure
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.