dotnet / dotnet/extensions

SummarizingChatReducer_CustomPrompt failed to find expected numbers

Open
#7,143 0 comments 0 reactions 0 assignees View on GitHub
area-ai test-bug
Dominant language
C#
Stars
3.2k
Forks
894
Avg merge
1d 12h
Merged PRs (30d)
23

Description

https://github.com/dotnet/extensions/blob/cc328a764d1b0200a852772b1f163ebecc7f4a22/test/Libraries/Microsoft.Extensions.AI.Integration.Tests/ChatClientIntegrationTests.cs#L1320-L1357

This test failed because the model decided to summarize the conversation with:
```
So, that's about 40 cans of food per month for your pets!
```

It looks to me like this isn't a "summary" but more of a "response". Perhaps this is due to the brief summarization prompt.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.