azurenoops / azurenoops/spin_agent

[Integration] Baseline: FullBaselineLifecycle + ReselectBaseline failing on main (quarantine tracking)

Closed
#857 1 comment 0 reactions 0 assignees View on GitHub
bug
Dominant language
C#
Stars
3
Forks
1
Avg merge
11h 20m
Merged PRs (30d)
70

Description

## Summary

Two `BaselineIntegrationTests` are failing on `main` independent of any open PR. They are quarantined in the CI `integration-tests` job (via `fix/ci-integration-gate-quarantine`) to preserve merge velocity while this issue is resolved.

**Quarantine lane must trend to zero — do not add new tests without a companion tracking issue.**

## Failing tests

- `Ato.Copilot.Tests.Integration.Tools.BaselineIntegrationTests.FullBaselineLifecycle_SelectTailorInheritCrm`
- `Ato.Copilot.Tests.Integration.Tools.BaselineIntegrationTests.ReselectBaseline_ReplacesPreviousBaseline`

## Evidence

- First confirmed: CI run 33505808350 (pre-existing on `main`, not introduced by any PR)
- Also failing: run 33535952002, run 33542685428 (413 passed, 4 failed)
- Both tests fail fast (47 ms, 70 ms) — consistent with a setup/fixture failure rather than a logic timeout
- Error class: not yet confirmed locally. The fast failure suggests a `Container start failed` or seed-data conflict; run 33542685428 logs also show `SqlException: Cannot insert duplicate key row in 'OrgInheritanceDefaults'` during test host startup, which may be interfering

## Root cause hypothesis

The fast failure (47–70 ms) and concurrent `SqlException: duplicate key (AC-2)` in the same CI run suggest the Baseline test fixture may be attempting to re-seed already-seeded data in a shared in-memory SQLite instance, or the `SelectBaseline` / `ReselectBaseline` flow has a state-ordering dependency that fails when tests run in parallel. Needs local verbose run to confirm.

## Required resolution

1. Run both tests locally: `dotnet test ... --filter "FullyQualifiedName~BaselineIntegrationTests" --logger "console;verbosity=detailed"`
2. Capture full exception chain
3. Fix root cause
4. Remove both test names from the quarantine filter in `.github/workflows/ci.yml`
5. Close this issue

## Owner

Unassigned — needs owner.

Contributor guide

Open the contributing guide

Research direction

Run `dotnet test ... --filter "FullyQualifiedName~BaselineIntegrationTests" --logger "console;verbosity=detailed"` locally and capture the full exception chain for the two named `BaselineIntegrationTests`. Review the fixture behavior around the reported `OrgInheritanceDefaults` duplicate-key error, then verify both tests pass and remove their names from the quarantine filter in `.github/workflows/ci.yml`.

Written by the indexing model from the issue text.

Assessment

Tech stack
csharp, sqlite
Domain
ci-cd, databases, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.