cleanlab / cleanlab/cleanlab

Hallucination detection

Open
#1,202 2 comments 0 reactions 0 assignees View on GitHub
needs triage
Dominant language
Python
Stars
11.7k
Forks
920
PR merge metrics
No merged PRs in 30d

Description

Detect hallucinations in LLM outputs

# Details

* What is the problem you're trying to solve?
* detect hallucinations in LLM outputs
* What tasks or workflows would be enabled by having support for your
proposed feature in cleanlab?
* selective classification, classification with abstention, and more in general a way to "trust" your LLM output
* Can you share code snippets or pseudocode describing uses of your feature?
* I don't have code, but there are a few GitHub repositories implementing hallucination detection models, such as https://github.com/oneal2000/MIND
* Can you share any datasets that can help us assess the usefulness of the
proposed feature?
* https://github.com/oneal2000/MIND/tree/main/helm

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.