lllyasviel / lllyasviel/stable-diffusion-webui-forge

Here’s a better solution(?) to preloading models before generation.

Open
#1,164 5 comments 3 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
13k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

Forge recently changed how models are loaded, which was a sensical thing to do as selecting a flux model will take forever to load in the background. My idea is simple.

If it’s possible, make it so the model only loads on “generate” for the first generation, then stores the loaded model for future generations until a different model is used to generate an image— at which point it loads that model instead.

This would speed up Forge significantly in my workflow!

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Trace the current model-loading path and the generation entry point to understand when models are loaded and released. Compare the behavior for the first generation and for switching models, then verify that the selected model remains available for later generations and that changing models loads the replacement before generation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.