Unsupported param: tools
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 40.3k
- Forks
- 3.7k
- PR merge metrics
- No merged PRs in 30d
Description
model_name ggml-model-i2_s.gguf
why?
slot print_timing: id 0 | task 0 |
prompt eval time = 11641.76 ms / 291 tokens ( 40.01 ms per token, 25.00 tokens per second)
eval time = 1541.79 ms / 12 tokens ( 128.48 ms per token, 7.78 tokens per second)
total time = 13183.55 ms / 303 tokens
srv update_slots: all slots are idle
request: POST /v1/chat/completions 172.25.218.178 200
terminate called after throwing an instance of 'std::runtime_error'
what(): Unsupported param: tools
Error occurred while running command: Command '['build/bin/llama-server', '-m', 'models/BitNet-b1.58-2B-4T/ggml-model-i2_s.gguf', '-c', '4096', '-t', '5', '-n', '4096', '-ngl', '0', '--temp', '0.8', '--host', '0.0.0.0', '--port', '8000', '-cb', '-p', 'You are a helpful assistant']' died with <Signals.SIGABRT: 6>.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Reproduce the failure using build/bin/llama-server and a POST to /v1/chat/completions that includes tools. Start by tracing the request handling that emits “Unsupported param: tools”; done means the request no longer terminates llama-server unexpectedly and its intended response behavior is verified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- api, backend
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 38/100