lllyasviel / lllyasviel/ControlNet

can unlocked diffuison model be saved?

Open
#608 0 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
34.1k
Forks
3k
PR merge metrics
No merged PRs in 30d

Description

Thanks for the great work!

I'm training ControlNet on my dataset, and setting `sd_locked = False` turns out to improve model performance significantly.
I learned that unlocking sd will also train some parts of the diffusion model, so the base model also changed, right? But one of the problems is that I can not use it on automatical1111 sd webui, which I can use to combine other techniques like LoRA with ControlNet. Does it mean if I unlocked SD when training ControlNet, I have to use the official code base to take full use of the trained model, i.e. running in prediction mode?
Is it possible to save the fine-tuned SD along with ControlNet so I can use them in other places together? Appreciate any advice.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No file, test, or entry point is named in the issue. Start by locating the ControlNet training and model save/load entry points, then determine whether unlocked diffusion weights are preserved and usable with AUTOMATIC1111; done means the supported workflow or limitation is clearly established.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
18/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.