nextcloud / nextcloud/assistant

Image generation keeps failing, and admin UI for it is unclear/confusing

Open
#423 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
JavaScript
Stars
88
Forks
43
Avg merge
18h 49m
Merged PRs (30d)
3

Description

Which version of assistant are you using?

2.11.0

Which version of Nextcloud are you using?

32.0.2

Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.

143.0.7499.41

Describe the Bug

Image generation via LocalAI with an external provider keeps failing, and I can't figure out why. I believe one issue might be that the options in the Assistant admin settings are confusing, and I'm not even sure if image generation is now on or off – or if there is a bug in the UI (which I suspect).

"Unified task processing" lists Generate Image as enabled:

Image

The "Image Generation" section pretends there's no provider (despite LocalAI being installed and configured):

Image

The "OpenAI and LocalAI integration" lists image generation as enabled and configured:

Image

So which one is true, and why is "Image Generation" shown as not supported?

Text generation / chat works fine, so the model provider (OpenRouter, with its OpenAI-compatible API) is set up correctly.

Expected Behavior

Either the image generation is not configured correctly – then the Assistant should not show "Image Generation" at all.

Or it is configured correctly – then there should be clear notes on whether things are set up correctly or what the actual error is. The Admin UI should then properly show me if it's configured correctly.

It would also be great if there was a testing section in the setup – right now it's very easy to configure wrong models (e.g. set a text model for image generation) and the way to testing is over the Assistant UI and not in the admin settings.

To Reproduce
  • Set up LocalAI with OpenAI
  • Install Assistant
  • Make sure to choose both a text and image model (that have these capabilities)
  • Note that the Admin UI will still show "Image Generation: no provider"
  • Note that image generation won't work even when model is configured correctly

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the LocalAI/OpenAI-compatible setup described in the issue and compare the Unified task processing, Image Generation, and OpenAI/LocalAI integration sections in the Assistant admin UI. Trace how provider and model capability status is reported for image generation, then verify the UI consistently identifies whether it is configured and explains any error. Done means a correctly configured image model is clearly reported and an invalid or unavailable setup gives an actionable status.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
ai, frontend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.