CIRED / CIRED/cired.digital

Ensure sufficient response quality level

Open
#47 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2
Forks
0
PR merge metrics
No merged PRs in 30d

Description

We need to be able to score the performance of replies for a given set of prompt, model and documents.
This entails
- having a list of test questions.
- a definition of what is a good answer, a quality checklist helps
- an evaluator

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.