facebookresearch / facebookresearch/detectron2

Create UV Texture map from DensePose Output

Open
#3,154 3 comments 5 reactions 0 assignees View on GitHub
densepose documentation
Dominant language
Python
Stars
34.7k
Forks
7.9k
PR merge metrics
No merged PRs in 30d

Description

## 📚 Documentation Improvements
I am trying to generate a single UV-texture map in the format of the SURREAL dataset. There is a notebook in the original DensePose repository that discusses how to apply texture transfer using an image from SMPL: github.com/facebookresearch/DensePose/blob/master/notebooks/DensePose-RCNN-Texture-Transfer.ipynb

However, in this case I am trying to use the outputs we get from DensePose directly:
1. In dump mode, I get the uv coordinates in `data[0]['pred_densepose'][0].uv` with dimensions: torch.Size([2, 1098, 529])
2. I overlayed the output from running inference on an image with `dp_u,dp_v` visualization on a black background. Here is the link to the image: https://densepose.s3.amazonaws.com/test1uv.0001.png
* This is the command I used to get this inference: ```python3 apply_net.py show configs/densepose_rcnn_R_101_FPN_DL_WC2M_s1x.yaml model_final_de6e7a.pkl input.jpg dp_u,dp_v -v --output output.png```

3. This is the link to the original image: https://densepose.s3.amazonaws.com/02_1_front.jpg

Using these components, I am trying to generate the 24 part uv texture map in the same format as SMPL:
https://densepose.s3.amazonaws.com/extracted_smpl_texture_apprearance.png
https://densepose.s3.amazonaws.com/texture_from_SURREAL.png

It would be extremely helpful if someone can share how to solve this problem. Please let me know if additional information is needed.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.