microsoft / microsoft/Power-CAT-Copilot-Studio-Kit

[FEATURE] - "Rerun" Button to dynamically Re-run the responses for the AI Evaluation

Open
#426 0 comments 0 reactions 1 assignee View on GitHub

@psimolin is already working on this.

Since Oct 29, 2025.

enhancement
Dominant language
TypeScript
Stars
450
Forks
95
Avg merge
26m
Merged PRs (30d)
5

Description

This a FEATURE proposal, - I didn't see in the other option to choose apart from an "Issue"

Hello,

I've been trying to rerun the Tests for my Agent but when I try to Rerun them, nothing is happening, null.
No information if the Rerun started, no background actions.

Image

From the call on Friday, I now now that it only Reruns the Evaluation on generated responses, - But this option would be much more sustainable when the responses would be ones more generated based on newly added one in Test Set, not to manually copy the Test Run every time, - This approach not only would simplify the process, but also creates a good fundamentals of Running Automatic Tests.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.