Is logprobs supported in chat()? If not, can it be added?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 10.5k
- Forks
- 1.2k
- Avg merge
- 4m
- Merged PRs (30d)
- 1
Description
Is there currently any support for retrieving logprobs in the chat() API or other Ollama endpoints? I have tried passing a parameter like "logprobs": 1 in my request, but it does not seem to return token-level probabilities, nor is it documented.
If this is not supported yet, I would like to request it as a feature.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the chat() request and response path, then compare logprobs handling across the other Ollama endpoints mentioned in the issue. The scope is not yet defined; done would require an agreed token-level probability response, documented request behavior, and verification that the API returns it as specified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- ollama, python
- Domain
- api, backend
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100