mudler / mudler/LocalAI

flux.1 kontext won't do image edits

Open
#9,232 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

area/backends bug diffusers unconfirmed
Dominant language
Go
Stars
49.2k
Forks
4.5k
Avg merge
1d 3m
Merged PRs (30d)
239

Description

LocalAI version:

4.0.0

Environment, CPU architecture, OS, and Version:

x86_64 Ubuntu using docker container

Describe the bug

I installed the flux.1 kontext model from gallery that uses stablediffusion.cpp. If I attach any reference images(or img2img), it fails and says Error: rpc error: code = Unavailable desc = error reading from server: EOF. If I don't use a reference image, it generates an image fine.

To Reproduce

localai 4.0.0 with vulkan

  1. install flux.1 kontext
  2. add reference image and prompt
  3. click generate

Expected behavior

Logs

Additional context

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the failure in LocalAI 4.0.0 with the flux.1 kontext gallery model, Vulkan, Docker, and a reference image. Inspect the stablediffusion.cpp integration and collect debug logs around the RPC EOF. Done means reference-image or img2img generation completes successfully while text-only generation remains working.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, docker
Domain
computer-graphics, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.