Azure / Azure/azure-sdk-tools

[TypeSpec Authoring] Collect sanitized user prompts in telemetry

Open
#15,040 2 comments 0 reactions 1 assignee Claimed by @praveenkuttappan View on GitHub
AzSDK Tools Agent azsdk-cli
Dominant language
C#
Stars
135
Forks
260
Avg merge
3d 1h
Merged PRs (30d)
143

Description

Collect sanitized/anonymized user prompts from the azure-typespec-author skill to understand common usage patterns.

- Define sanitization rules to strip PII and sensitive data from prompts
- Integrate sanitized prompt collection into the telemetry pipeline
- Include metadata: timestamp, prompt category, success/failure
- Identify most/least used prompt categories and detect unclear or failing prompt patterns

Parent issue: https://github.com/Azure/azure-sdk-tools/issues/14902

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.