cleanlab / cleanlab/tlm

Set use_logprobs=False in ReferenceCompletionTemplate if model doesnt take that param

Open
#22 1 comment 0 reactions 1 assignee Claimed by @kelsey-wong View on GitHub
Dominant language
Python
Stars
9
Forks
6
PR merge metrics
No merged PRs in 30d

Description

Gemini models fail with 'litellm.UnsupportedParamsError: gemini does not support parameters: ['top_logprobs'], for model=gemini-1.5-flash' unless ReferenceCompletionTemplate.create's use_logprobs is set to False.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.