lllyasviel / lllyasviel/ControlNet

OpenPifpaf pretrained data

Open
#467 1 comment 3 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
34.1k
Forks
3k
PR merge metrics
No merged PRs in 30d

Description

Hi,
As mentioned in the paper [https://arxiv.org/abs/2302.05543](url):

> Human Pose (OpenPifPaf) We use learning-based pose estimation method [27] to “find” humans
> from internet using a simple rule: an image with human must have at least 30% of the key points
> of the whole body detected. We obtain 80k pose-image-caption pairs. Note that we directly use
> visualized pose images with human skeletons as training condition. The model is trained with 400
> GPU-hours on Nvidia RTX 3090TI. The base model is Stable Diffusion 2.1. (See also Fig. 8.)

you have trained the SD2.1 on openpifpaf whole body and that is fascinating!

But i was wondering why there are no pretrained model or demo for openpifpof wholebody in the github page nor in the @huggingface !

Are you plan to release the model?
No matter how accurate it is, we all wanted to use it.
@lllyasviel @williamyang1991 @scarbain @eltociear @camenduru @sethupavan12
![image](https://github.com/lllyasviel/ControlNet/assets/131435526/8735b4d0-9850-403f-bce7-dce8adbe2b16)

I also found some other people asking about it in issues but no answer!
@anwoflow @LCorleone @Olwaro @huytuong010101 @Paludgus @BlueAccords @ninjasaid2k @sALTaccount @richard-schwab @richard-schwab @TheLukaDragar

Thanks
Best regards

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue asks whether the OpenPifPaf whole-body pretrained model or demo described in the linked paper will be released. Start by reading the paper reference and checking the existing ControlNet and Hugging Face resources; no files or tests are identified. Done would require a maintainer decision and, if approved, a model or demo release.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.