lllyasviel / lllyasviel/ControlNet
Possible Handfix?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 34.1k
- Forks
- 3k
- PR merge metrics
- No merged PRs in 30d
Description
Although there are many workflows to repair deformed hands, the truth is that it is still a problem. Controlnet works for various contexts and purposes, but not all, and where it does it still has its limitations.
Therefore, my question is the following. Can we pass hand photos into Img2Img so that it generates the "StableDiffusion" version of them, and then train a controlnet to reverse the process? Wouldn't that allow to return in most contexts the natural shape in a single inpaint step? Or maybe even within the same build on multinet?
It is a doubt that I have. I'd like to give it a try but my hardware isn't powerful enough to jump right into it without professional advice.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by reviewing the proposed Img2Img, StableDiffusion, ControlNet, and multinet workflow and determine whether it can be scoped into a reproducible experiment. Done would require a documented feasibility result or a concrete implementation plan.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100