biocompute-objects / biocompute-objects/bco-rag

Re-work default eval check

Open
#10 0 comments 0 reactions 1 assignee Claimed by @seankim658 View on GitHub
enhancement
Dominant language
Python
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Description

Right now the default score check prevents erroneously saving default evaluations. Should re-work the logic to exclude some fields such as:

- Score (being implemented here: https://github.com/biocompute-objects/bco-rag/issues/9)
- json format error (which I want to automatically set when falling back to the raw txt file)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.