microsoft / microsoft/GitHub-Copilot-for-Azure

Integration test failure: azure-deploy – discussion board app service Bicep eastus2 [Assertion mismatch]

Open
#1,289 0 comments 0 reactions 1 assignee Claimed by @wbreza View on GitHub
azure-deploy bug integration-test test-failure
Dominant language
Python
Stars
250
Forks
204
Avg merge
1d 12h
Merged PRs (30d)
67

Description

## Prompt

```
Create a discussion board application and deploy to Azure App Service using my current subscription in eastus2 region.
```

## Summary

**Run:** [Integration Tests - all #86](https://github.com/microsoft/GitHub-Copilot-for-Azure/actions/runs/23083939668)
**Test:** `azure-deploy_ - Integration Tests › app-service-deploy › creates discussion board`
**Result:** Fail
**Duration:** 21m 43s

## Root Cause Category

**Assertion mismatch**

## Diagnosis

### What was expected
The agent should create a discussion board application, deploy it to Azure App Service in eastus2, and return an Azure App Service URL (`*.azurewebsites.net`) in its response. Test expects `.bicep` files in the workspace and no `.tf` files.

### What actually happened
The agent completed within the time limit but no Azure deployment link was present in the assistant's response (`containsDeployLinks = false` at line 177). The deployment did not produce the expected App Service URL.

### Why it failed
The agent ran to completion (21m 43s) but either the deployment failed without returning a URL, or the skill chain was bypassed and the agent used a different approach that did not produce the expected `*.azurewebsites.net` link. Both `creates discussion board` and `creates todo list with frontend and API` (non-Terraform App Service) failed in the same job run, suggesting a systemic issue with Bicep App Service deployments in eastus2.

### Suggested fix
- Investigate App Service Bicep deployment failures in eastus2 (RBAC, quota, or provisioning errors).
- Check if the azure-deploy skill correctly handles App Service deployments with Bicep.

## azure-deploy Skill Invocation

| Skill | Invoked |
|-------|---------|
| **azure-deploy** | Unknown (no deploy links found) |

> In azure-deploy integration tests, the full skill chain is azure-prepare → azure-validate → azure-deploy. The deployment completed without producing the expected App Service URL.

## Skill Report Context

Per-test section from SKILL-REPORT.md (click to expand)

_Skill report not available — artifact download requires network access not available in this environment._

## Environment

- **Runner OS:** ubuntu-latest
- **Node.js:** 24.x
- **Model:** default (no MODEL_OVERRIDE set)
- **Run URL:** https://github.com/microsoft/GitHub-Copilot-for-Azure/actions/runs/23083939668
- **Commit:** c624dcaa1a9820f915eb4b0b8b3fb6e420d4815c

> Generated by [Analyze Test Run](https://github.com/microsoft/GitHub-Copilot-for-Azure/actions/runs/23087898435) · [◷](https://github.com/search?q=repo%3Amicrosoft%2FGitHub-Copilot-for-Azure+is%3Aissue+%22gh-aw-workflow-call-id%3A+microsoft%2FGitHub-Copilot-for-Azure%2Fanalyze-test-run%22&type=issues)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.