microsoft / microsoft/GitHub-Copilot-for-Azure

Track supported model list in a single configuration source for automated testing

Open
#2,167 2 comments 0 reactions 0 assignees View on GitHub
enhancement integration-test untriaged
Dominant language
Python
Stars
250
Forks
204
Avg merge
1d 12h
Merged PRs (30d)
67

Description

### Problem

There isn't a single source of truth for the supported model list; this makes keeping test coverage consistent across models more challenging.

### Desired Solution

Track the supported model list in a config file or directly in the workflow matrix, so that new models are included in all standard test suites automatically.

### Alternatives and Workarounds

Continue manually updating various locations when new models are added, with risk of missing coverage.

### Impact

Reduces manual effort and human error; ensures every model gets tested consistently; helps onboard new model support faster.

### Additional Context

See [Issue #1647](https://github.com/microsoft/GitHub-Copilot-for-Azure/issues/1647) for historical context.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the workflow matrices and the locations where the supported model list is currently duplicated, then read Issue #1647 for historical context. Done means one configuration source or workflow matrix supplies every standard test suite, so adding a model requires only one update.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ci-cd, testing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.