huggingface / huggingface/swift-coreml-diffusers
Stable Diffusion 2.1-based models fail to load or generate blank black images
- Dominant language
- Swift
- Stars
- 2.8k
- Forks
- 235
- PR merge metrics
- No merged PRs in 30d
Description
Hi š
Iāve been doing some experiments with the app and, for the most part, it works. However, Iāve noticed that the `Diffusion` app fails to work with models that are based on **Stable Diffusion 2.1**.
- For `split_einsum_compiled` CoreML models, the app reports that itās āPreparing the model...ā or āGenerating...ā in the console and never (after waiting hours) finishes or starts generating an image.
- For `original_compiled` CoreML models, the app does load the model but it produces images that are completely black; no images are generated.
This behavior is consistent among a variety of SD-2.1 checkpoints. Here are some that Iāve confirmed to have this issue:
- [Artius V2.1](https://civitai.com/models/27739/artius-v21)
- [rMada Merge - SD 2.1 768](https://civitai.com/models/15303/rmada-merge-sd-21-768)
- [Isometric Dreams SD2.1](https://civitai.com/models/8013/isometric-dreams-sd21) (GPU is fine; ANE isnāt)
Strangely, the `stable-diffusion-2-1-base` does work so Iām pretty confused and wanted to report this issue because this would heavily restrict users who want to use models beyond SD 1.x.
Even more peculiarly, this behavior isnāt unique to just this app. Other Stable Diffusion apps are exhibiting similar issues ([see here](https://github.com/godly-devotion/MochiDiffusion/issues/227))
ā
System Info:
- Mac mini (M1, 2020)
- RAM: 16 GB
- macOS 13.3 (22E252)
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.