lllyasviel / lllyasviel/ControlNet

About the grad=0, which have 2 continuous zero convolution

Open
#510 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
34.1k
Forks
3k
PR merge metrics
No merged PRs in 30d

Description

in your code in SpatialTransformer Or Resblock,
![image](https://github.com/lllyasviel/ControlNet/assets/79788571/570f0937-eb7a-4cc5-bbb3-18a6265abc30)
proj_out will output zero ,then x will be zero
and zero will input to the zero-convlotion in below:
![image](https://github.com/lllyasviel/ControlNet/assets/79788571/50d30854-d7e2-4053-9812-6d9fd9582994)

and your persume: x not equal 0 is false
I'm sorry for the inconvenience

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the SpatialTransformer, Resblock, proj_out, and zero-convolution implementations referenced in the issue, then trace the forward and gradient paths around the two consecutive zero-initialized layers. Confirm the behavior with the relevant existing tests or a minimal gradient check, and document whether the stated assumption about x and gradient flow is valid.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.