dotnet / dotnet/extensions

[AI Evaluation] MEAI.Evaluation make MinimumPassingScore configurable

Open
#6,480 3 comments 0 reactions 0 assignees View on GitHub
area-ai-eval
Dominant language
C#
Stars
3.2k
Forks
894
Avg merge
1d 12h
Merged PRs (30d)
23

Description

Hey guys

I have a scenario, where I would like to make the MinimumPassingScore configurable, currently it is hardcoded to 4 in `EvaluationMetricExtensions` in the method `InterpretScore`. I am thinking about using MEAI.Evaluation as a Integration Test for my App, but I can only perform up to 3, which is ok in my scenario.

What do you guys think, any scenario where this is valid for you as well.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.