lllyasviel / lllyasviel/stable-diffusion-webui-forge

Operations handling VAE / Text Encoders

Open
#1,532 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
13k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

### Edit- Most of these sub issues have been solved. Outstanding issues are at the top

---

I'm making this as a broad topic for the functions related to "VAE" and "Text Encoders".

According to Illyasviel, **these are now one and the same in Forge.**

If anyone makes comments for related issues, I'll add to the OP.

I've attempted to do these things myself, but they were over my head (except the last item).

---

### Sending PNGInfo to txt2img / img2img

`Module 1, Module 2, Module 3, etc` - these settings should automatically populate the **VAE/Text Encoders** multi-select menu.

Or, in Extra Parameters field that can appear below the main sliders

Screenshot 2024-08-25 204623

---

### XYZ Parameters

Currently, only "VAE" can be used via XYZ.

Screenshot 2024-08-25 205610

---

### ✅ Checkpoint Preferences

Original Issue
Currently no way to set default Text Encoders for checkpoints.

Screenshot 2024-09-08 102511

---

### ✅ API `override_settings`

Original Issue
Ideally, a `list` of modules (VAEs and Text Encoders) should be able to be provided in the `override_settings` dict.

![361053476-bb400d93-2080-4a03-8b0e-d3d815ef6337](https://github.com/user-attachments/assets/c90ddd89-d5a2-40f9-99bd-50eec0b073af)

---

### ✅ Get all VAE / Text Encoders via API

**Already done and merged** - https://github.com/lllyasviel/stable-diffusion-webui-forge/pull/1463

Screenshot

![361048886-875d9158-72bb-4b51-8668-355309df56ac](https://github.com/user-attachments/assets/d08ab392-2f7f-4ecf-92c9-d9a69682a72a)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Review the outstanding sections at the top of the issue, especially PNGInfo population of the VAE/Text Encoders menu and XYZ support beyond VAE. Treat checkpoint preferences, API override_settings, and listing all modules as completed or already merged, and verify completion against the requested UI behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.