flux.1 kontext won't do image edits
Nobody has claimed this yet.
- Dominant language
- Go
- Stars
- 49.2k
- Forks
- 4.5k
- Avg merge
- 1d 3m
- Merged PRs (30d)
- 239
Description
LocalAI version:
4.0.0
Environment, CPU architecture, OS, and Version:
x86_64 Ubuntu using docker container
Describe the bug
I installed the flux.1 kontext model from gallery that uses stablediffusion.cpp. If I attach any reference images(or img2img), it fails and says Error: rpc error: code = Unavailable desc = error reading from server: EOF. If I don't use a reference image, it generates an image fine.
To Reproduce
localai 4.0.0 with vulkan
- install flux.1 kontext
- add reference image and prompt
- click generate
Expected behavior
Logs
Additional context
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the failure in LocalAI 4.0.0 with the flux.1 kontext gallery model, Vulkan, Docker, and a reference image. Inspect the stablediffusion.cpp integration and collect debug logs around the RPC EOF. Done means reference-image or img2img generation completes successfully while text-only generation remains working.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, docker
- Domain
- computer-graphics, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100