Audio upload/transcribe not working on llama-swap
@mythz is already working on this.
Since Nov 1, 2025.
Assessment
This issue has not been assessed yet.
Description
Getting a 500 error when attempting to upload/transcribe audio files (only tested a small mp3). llama-server saying that audio isn't supported (but it works fine with OWUI).
llms output llama-swap error log:
Oct 31 11:34:57 phoenix llama-swap[63587]: main: server is listening on http://127.0.0.1:5818 - starting the main loop
Oct 31 11:34:57 phoenix llama-swap[63587]: srv update_slots: all slots are idle
Oct 31 11:34:58 phoenix llama-swap[63587]: srv log_server_r: request: GET /health 127.0.0.1 200
Oct 31 11:34:58 phoenix llama-swap[63587]: [INFO] <Qwen3-VL-8B-Instruct-BF16> Health check passed on http://localhost:5818/health
Oct 31 11:34:58 phoenix llama-swap[63587]: [DEBUG] <Qwen3-VL-8B-Instruct-BF16> swapState() State transitioned from starting to ready
Oct 31 11:34:58 phoenix llama-swap[63587]: got exception: {"code":500,"message":"audio input is not supported - hint: if this is unexpected, you may need to provide the mmproj","type":"server_error"}
Oct 31 11:34:58 phoenix llama-swap[63587]: srv log_server_r: request: POST /v1/chat/completions 127.0.0.1 500
Oct 31 11:34:58 phoenix llama-swap[63587]: [DEBUG] <Qwen3-VL-8B-Instruct-BF16> request /v1/chat/completions - start: 10.265148086s, total: 10.277691021s
Oct 31 11:34:58 phoenix llama-swap[63587]: [WARN] metrics skipped, HTTP status=500, path=/v1/chat/completions
Oct 31 11:34:58 phoenix llama-swap[63587]: [INFO] Request ::1 "POST /v1/chat/completions HTTP/1.1" 500 151 "llms.py/1.0" 10.278364192s
Open-WebUI output:
Oct 31 11:36:40 phoenix llama-swap[63587]: eval time = 637.21 ms / 19 tokens ( 33.54 ms per token, 29.82 tokens per second)
Oct 31 11:36:40 phoenix llama-swap[63587]: total time = 704.88 ms / 242 tokens
Oct 31 11:36:40 phoenix llama-swap[63587]: slot release: id 0 | task 145 | stop processing: n_tokens = 248, truncated = 0
Oct 31 11:36:40 phoenix llama-swap[63587]: srv update_slots: all slots are idle
Oct 31 11:36:40 phoenix llama-swap[63587]: srv log_server_r: request: POST /v1/chat/completions 127.0.0.1 200
Oct 31 11:36:40 phoenix llama-swap[63587]: [DEBUG] <Qwen3-VL-8B-Instruct-BF16> request /v1/chat/completions - start: 0s, total: 707.956034ms
Oct 31 11:36:40 phoenix llama-swap[63587]: [INFO] Request ::1 "POST /v1/chat/completions HTTP/1.1" 200 661 "Python/3.12 aiohttp/3.12.15" 708.027884ms
- Dominant language
- JavaScript
- Stars
- 629
- Forks
- 31
- PR merge metrics
- No merged PRs in 30d
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from ServiceStack/llms
-
Error adding custom provider (perplexity) "unsupported operand type(s) for +=: 'int' and 'str'" Open
Difficulty 3/5 1-2 days Newbie friendliness 52/100
ServiceStack/llms#42 · 3 comments ·
-
Support Windows Openenhancement help wanted
Difficulty 5/5 Over a week Newbie friendliness 25/100
ServiceStack/llms#28 · 2 reactions ·
-
Google OAuth Openenhancement help wanted
Difficulty 5/5 Over a week Newbie friendliness 25/100
ServiceStack/llms#15 · 11 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 35/100
ServiceStack/llms#11 · 3 comments ·
All issues in ServiceStack/llms
Similar issues
-
code-quality refactoring
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
github/gh-aw-firewall#8816 ·
-
integration:quickjs org:external priority:backlog topic:code-interpreter topic:middleware type:feature
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
langchain-ai/deepagents#6450 ·
-
optimization optimization:agents-md-curator
Difficulty 2/5 1-3 hours Newbie friendliness 86/100
githubnext/gh-aw-cao#13143 ·
-
status: needs triage
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100