microsoft / microsoft/GitHub-Copilot-for-Azure

Skill improvement: azure-kusto (run 35398318292)

Open
#3,229 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
250
Forks
204
Avg merge
1d 12h
Merged PRs (30d)
67

Description

# Skill improvement run: azure-kusto

- Status: **completed**
- Baseline: `d7f564e5784347f0b24470d34a155588808cef48`
- Best development candidate: none
- Final acceptance: **not passed**
- Answer models: `gpt-5.6-sol`
- Judge models: `claude-opus-4.8`
- Answer generations: 166/400
- Judge calls: 166/400
- Duration: 34.5 minutes

## Baseline

- Passed: 143/166
- Pass rate: 86.1%
- Average score: 94.7%
- Skill invocation: 83/166
- Judge disagreements: 0

## Iterations

| Iteration | Decision | Quality difference | Score difference | Token difference | Reason |
| ---: | --- | ---: | ---: | ---: | --- |
| 1 | Not evaluated | N/A | N/A | N/A | Change outside allowed paths: node_modules |
| 2 | Not evaluated | N/A | N/A | N/A | Change outside allowed paths: node_modules |

The complete report, trajectories, judge evidence, agent output, and patches are attached to the workflow run.

Workflow run: https://github.com/microsoft/GitHub-Copilot-for-Azure/actions/runs/35398318292

Contributor guide

Open the contributing guide

Research direction

Start with the attached report and workflow run 35398318292, reviewing the failed acceptance and the two iterations rejected for changes outside the allowed paths. Determine what skill change is needed and where it belongs; done means a development candidate is evaluated successfully and final acceptance passes without modifying node_modules.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure
Domain
ai-infra-agents, cloud
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.