Azure / Azure/azure-sdk-tools

AzSDK agent: Support a tool to provide feedback

Open
#15,608 0 comments 0 reactions 1 assignee Claimed by @praveenkuttappan View on GitHub
API Spec & SDK release process
Dominant language
C#
Stars
135
Forks
260
Avg merge
3d 2h
Merged PRs (30d)
130

Description

Add an option to provide feedback about agent experience that includes prompt, tool args, agent logs and responses as part of the feedback to analyze the feedback.

This helps to understand analyze any issues in using Azure SDK tools agentic experience.

Data should not be put into telemetry Kusto DB to avoid any PII getting ingested to DB.

Goals:
- Create an activity log using copilot instructions to log user prompt, agent responses and actions.
- Add an MCP tool `/azsdk_tools_feedback` that collects usage from activity log and present to the user to submit.
- MCP tool should process the feedback and notify agent tools owners.
- One option is to send an email with the feedback with an alias for AzSDK tools team and user.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.