cleanlab/tlm

View on GitHub

Score the trustworthiness of outputs from any LLM in real-time

Stars: 9
Forks: 6
Open beginner issues: 0
Indexed issues: 17

Dominant language: Python
License: Apache-2.0
Last GitHub push: Jul 6, 2026
Latest indexed: Sep 15, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Open All

17 open issues indexed

Implement simplified timeout logic and make configurable through API Open

cleanlab/tlm#1 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Port newer SaaS features into this library Open

cleanlab/tlm#2 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Validate the completion params that are passed as input to the API Open

cleanlab/tlm#3 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Increase unit test coverage Open

cleanlab/tlm#4 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Implement integration test suite Open

cleanlab/tlm#5 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Run benchmarks Open

cleanlab/tlm#6 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Set up docs/CI in repo Open

cleanlab/tlm#7 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Port tutorials into new docs CI Open

cleanlab/tlm#9 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Set up GH action to release to PyPI Open

cleanlab/tlm#10 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
[bug] Chat completions sometimes do not follow requested template Open

bug

cleanlab/tlm#11 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Test the library with different model providers Open

cleanlab/tlm#12 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
add tests to required status checks Open

cleanlab/tlm#18 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Enable --strict flag for mypy Open

cleanlab/tlm#19 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
Set use_logprobs=False in ReferenceCompletionTemplate if model doesnt take that param Open

cleanlab/tlm#22 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Add deepseek support Open

cleanlab/tlm#23 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 15, 2026
Implement lowest latency model for lower quality presets Open

cleanlab/tlm#29 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026
add installation instructions to readme Open

cleanlab/tlm#30 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 15, 2026

cleanlab/tlm

Get new issues in your inbox