lllyasviel / lllyasviel/sd-forge-layerdiffuse

High-level instruction on how to use the LatentTransparencyOffsetEncoder model

Open
#96 3 comments 2 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
4.1k
Forks
352
PR merge metrics
No merged PRs in 30d

Description

Hi,
Thanks again for this awesome tech.
I see in several issues that Encoder support will come in the near future. Thank you for that.
In the mean time, if I want to use LatentTransparencyOffsetEncoder and test a few things out, what's the expected input?
From reading the decoder,
1. seems like the input should be alpha then rgb. Is this correct?
2. Are the input values [-1,1] or [0,1]
3. From my simple testing of autoencoding, e.g. LatentTransparencyOffsetEncoder(alpha, RGB) + sdvae.encode( masked_rgb ) -> decode, it seems like not adding the offset performs better. Is this expected?
Thanks again.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the decoder and the LatentTransparencyOffsetEncoder entry point, then trace the sdvae.encode(...)->decode path described in the issue. Document the expected channel order, value range, and offset behavior, including a minimal usage example once these questions are verified.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
32/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.