lllyasviel / lllyasviel/sd-forge-layerdiffuse
Question regarding foreground and background LoRA.
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.1k
- Forks
- 352
- PR merge metrics
- No merged PRs in 30d
Description
In Fig. 3 in your paper, you mentioned two LoRAs, foreground and background LoRA trained on top of the base model.
You also mentioned that when training the base diffusion model (a), all model weights are trainable.
However, it seems that the base diffusion model is a UNet with LoRA layers. If this is the foreground model, where is the "background LoRA"?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Read Fig. 3 and the paper sections describing the base diffusion model, foreground LoRA, and background LoRA. Then inspect the repository's model-loading and training entry points to locate how each component is represented; done means documenting the relationship clearly enough to answer where the background LoRA is.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100