Azure / Azure/azure-sdk-tools

[Azsdk-cli] [SDK breaking change detection] Shall we add the classification template version and classified result to telemetry

Open
#16,464 0 comments 0 reactions 0 assignees View on GitHub
needs-triage
Dominant language
C#
Stars
135
Forks
260
Avg merge
3d 1h
Merged PRs (30d)
143

Description

Current there's no mechanism to track which prompt version produced which classification result. If the prompt regresses after edits, there's no way to correlate outputs to versions or rollback.

Current we add a debug log for it. But whether we need to log the version alongside classification results in telemetry? and in which format?

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the existing debug logging in the SDK breaking change detection CLI for the classification template version and classified result. Determine whether telemetry should record both values, choose a format that supports correlating regressions and rollback, and document the agreed behavior as done.

Written by the indexing model from the issue text.

Assessment

Tech stack
csharp
Domain
cli, observability
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.