Audio upload/transcribe not working on llama-swap

Open
#2 2 comments 0 reactions 1 assignee View on GitHub

@mythz is already working on this.

Since Nov 1, 2025.

Assessment

This issue has not been assessed yet.

Description

Getting a 500 error when attempting to upload/transcribe audio files (only tested a small mp3). llama-server saying that audio isn't supported (but it works fine with OWUI).

llms output llama-swap error log:

Oct 31 11:34:57 phoenix llama-swap[63587]: main: server is listening on http://127.0.0.1:5818 - starting the main loop
Oct 31 11:34:57 phoenix llama-swap[63587]: srv  update_slots: all slots are idle
Oct 31 11:34:58 phoenix llama-swap[63587]: srv  log_server_r: request: GET /health 127.0.0.1 200
Oct 31 11:34:58 phoenix llama-swap[63587]: [INFO] <Qwen3-VL-8B-Instruct-BF16> Health check passed on http://localhost:5818/health
Oct 31 11:34:58 phoenix llama-swap[63587]: [DEBUG] <Qwen3-VL-8B-Instruct-BF16> swapState() State transitioned from starting to ready
Oct 31 11:34:58 phoenix llama-swap[63587]: got exception: {"code":500,"message":"audio input is not supported - hint: if this is unexpected, you may need to provide the mmproj","type":"server_error"}
Oct 31 11:34:58 phoenix llama-swap[63587]: srv  log_server_r: request: POST /v1/chat/completions 127.0.0.1 500
Oct 31 11:34:58 phoenix llama-swap[63587]: [DEBUG] <Qwen3-VL-8B-Instruct-BF16> request /v1/chat/completions - start: 10.265148086s, total: 10.277691021s
Oct 31 11:34:58 phoenix llama-swap[63587]: [WARN] metrics skipped, HTTP status=500, path=/v1/chat/completions
Oct 31 11:34:58 phoenix llama-swap[63587]: [INFO] Request ::1 "POST /v1/chat/completions HTTP/1.1" 500 151 "llms.py/1.0" 10.278364192s

Open-WebUI output:

Oct 31 11:36:40 phoenix llama-swap[63587]:        eval time =     637.21 ms /    19 tokens (   33.54 ms per token,    29.82 tokens per second)
Oct 31 11:36:40 phoenix llama-swap[63587]:       total time =     704.88 ms /   242 tokens
Oct 31 11:36:40 phoenix llama-swap[63587]: slot      release: id  0 | task 145 | stop processing: n_tokens = 248, truncated = 0
Oct 31 11:36:40 phoenix llama-swap[63587]: srv  update_slots: all slots are idle
Oct 31 11:36:40 phoenix llama-swap[63587]: srv  log_server_r: request: POST /v1/chat/completions 127.0.0.1 200
Oct 31 11:36:40 phoenix llama-swap[63587]: [DEBUG] <Qwen3-VL-8B-Instruct-BF16> request /v1/chat/completions - start: 0s, total: 707.956034ms
Oct 31 11:36:40 phoenix llama-swap[63587]: [INFO] Request ::1 "POST /v1/chat/completions HTTP/1.1" 200 661 "Python/3.12 aiohttp/3.12.15" 708.027884ms
Dominant language
JavaScript
Stars
629
Forks
31
PR merge metrics
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from ServiceStack/llms

All issues in ServiceStack/llms

Similar issues

More JavaScript issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.