No model information retrieval
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 10.5k
- Forks
- 1.2k
- Avg merge
- 4m
- Merged PRs (30d)
- 1
Description
I have faced an issue where I needed to test multiple models and change the desired num_ctx params and other options as well based on the model I'm currently using.
While ollama.show() provides a good output for this, I want these parameters to be retrieved as values without me having to manually change options during ollama.chat() .
Something like modelinfo.py or another tool that would provide methods for various parameter retrieval (i.e. context length, quantization, embedding length, etc.).
If this is something you would like to see, I want to implement it myself and create a PR!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the existing ollama.show() and ollama.chat() behavior described in the issue, then determine which model metadata is available to expose. Done means callers can retrieve values such as context length, quantization, and embedding length without manually changing chat options; no specific files or tests are named.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- ollama, python
- Domain
- ai, api
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100