facebookresearch / facebookresearch/detectron2
Create UV Texture map from DensePose Output
- Dominant language
- Python
- Stars
- 34.7k
- Forks
- 7.9k
- PR merge metrics
- No merged PRs in 30d
Description
## 📚 Documentation Improvements
I am trying to generate a single UV-texture map in the format of the SURREAL dataset. There is a notebook in the original DensePose repository that discusses how to apply texture transfer using an image from SMPL: github.com/facebookresearch/DensePose/blob/master/notebooks/DensePose-RCNN-Texture-Transfer.ipynb
However, in this case I am trying to use the outputs we get from DensePose directly:
1. In dump mode, I get the uv coordinates in `data[0]['pred_densepose'][0].uv` with dimensions: torch.Size([2, 1098, 529])
2. I overlayed the output from running inference on an image with `dp_u,dp_v` visualization on a black background. Here is the link to the image: https://densepose.s3.amazonaws.com/test1uv.0001.png
* This is the command I used to get this inference: ```python3 apply_net.py show configs/densepose_rcnn_R_101_FPN_DL_WC2M_s1x.yaml model_final_de6e7a.pkl input.jpg dp_u,dp_v -v --output output.png```
3. This is the link to the original image: https://densepose.s3.amazonaws.com/02_1_front.jpg
Using these components, I am trying to generate the 24 part uv texture map in the same format as SMPL:
https://densepose.s3.amazonaws.com/extracted_smpl_texture_apprearance.png
https://densepose.s3.amazonaws.com/texture_from_SURREAL.png
It would be extremely helpful if someone can share how to solve this problem. Please let me know if additional information is needed.
Contributor guide
Assessment
This issue has not been assessed yet.