ollama: attaching a file does not work/results in error 500/400 Bad request

Open
#11 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Assessment

Difficulty
4/5
Estimated time
3-5 days
Newbie friendliness
35/100
Issue type
Bug
Clarity
Mostly clear
Activity status
Stale
Tech stack
javascript, ollama
Domain
api, backend

Research direction

Start with the OllamaProvider path used by the --serve web UI and inspect the POST request to /v1/chat/completions shown in the logs. Reproduce with a text, shell, or Python attachment and compare the file content payload with Ollama's accepted format. Done means the attached document is summarized without the provider returning HTTP 400 or the server returning HTTP 500.

Written by the indexing model from the issue text.

Description

Steps to reproduce:

  • llms --serve 8080 --verbose, access web UI
  • select ollama provider (tested with multiple models)
  • attach a file (tested with multiple text files/shell/python scripts) with a promt su chas Please summarize this document and submit the query
  • the web UI displays an error and not response is returned
HTTP 500 Internal Server Error
{
  "error": "HTTP 400 Bad Request"
}

Logs:

provider: ollama OllamaProvider
POST http://localhost:11434/v1/chat/completions
{
  "model": "deepseek-r1:14b",
  "messages": [
    {
      "role": "user",
      "content": [
        {
          "type": "file",
          "file": {
            "filename": "test.xml",
            "file_data": "data:text/xml;base64,(1325)"
          }
        },
        {
          "type": "text",
          "text": "Summarize the file\n\n[\ud83d\udcce test.xml]"
        }
      ]
    }
  ],
  "enable_thinking": true,
  "metadata": {
    "threadId": "1765739448549"
  },
  "stream": false
}
Provider ollama failed: HTTP 400 Bad Request
Dominant language
JavaScript
Stars
629
Forks
31
PR merge metrics
No merged PRs in 30d

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

More from ServiceStack/llms

All issues in ServiceStack/llms

Similar issues

More JavaScript issues

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.