google / google/langfun

Scoring implementation

Open
#433 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
915
Forks
81
Avg merge
21d 21h
Merged PRs (30d)
7

Description

Hi, thanks for the cool project!

I'm trying to run the examples here:
https://github.com/google/langfun/blob/2ae17d3da30d54633fc93620e0316d7c08673aaa/langfun/core/structured/scoring.py#L43C1-L44C1
But the scoring functionality doesn't seem to have been implemented for specific lms, e.g.
```
scores = lf.score('{{x}} + {{y}} =', ['1', '2', '3'], lm=lf.llms.Gpt4o(), x=1, y=2)
# NotImplementedError: Gpt4o does not support scoring.
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.