microsoft / microsoft/Power-CAT-Copilot-Studio-Kit
[FEATURE] - "Rerun" Button to dynamically Re-run the responses for the AI Evaluation
@psimolin is already working on this.
Since Oct 29, 2025.
- Dominant language
- TypeScript
- Stars
- 450
- Forks
- 95
- Avg merge
- 26m
- Merged PRs (30d)
- 5
Description
This a FEATURE proposal, - I didn't see in the other option to choose apart from an "Issue"
Hello,
I've been trying to rerun the Tests for my Agent but when I try to Rerun them, nothing is happening, null.
No information if the Rerun started, no background actions.
From the call on Friday, I now now that it only Reruns the Evaluation on generated responses, - But this option would be much more sustainable when the responses would be ones more generated based on newly added one in Test Set, not to manually copy the Test Run every time, - This approach not only would simplify the process, but also creates a good fundamentals of Running Automatic Tests.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.