lllyasviel / lllyasviel/ControlNet
Is it necessary to use a zero convolution layer?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 34.1k
- Forks
- 3k
- PR merge metrics
- No merged PRs in 30d
Description
Thanks to the authors for providing such a nice project!
In ControlNet, `y=w_ori * x + w_copy * x` for simplify.
Can we directly use `y = (w_ori + w_copy) * x` to implement ContralNet? And what will happen if we do so?
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue does not name a file, test, or entry point. Start by locating the ControlNet implementation of the zero convolution and read how its two branches are initialized and trained. Compare that behavior with the proposed combined convolution, and consider the issue addressed when the equivalence or difference is demonstrated and documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100