ollama / ollama/ollama-python

Is logprobs supported in chat()? If not, can it be added?

Open
#517 2 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
10.5k
Forks
1.2k
Avg merge
4m
Merged PRs (30d)
1

Description

Is there currently any support for retrieving logprobs in the chat() API or other Ollama endpoints? I have tried passing a parameter like "logprobs": 1 in my request, but it does not seem to return token-level probabilities, nor is it documented.

If this is not supported yet, I would like to request it as a feature.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the chat() request and response path, then compare logprobs handling across the other Ollama endpoints mentioned in the issue. The scope is not yet defined; done would require an agreed token-level probability response, documented request behavior, and verification that the API returns it as specified.

Written by the indexing model from the issue text.

Assessment

Tech stack
ollama, python
Domain
api, backend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.